Writing code: use of LLM AI or not

[jchd]

Interesting study!

https://arxiv.org/pdf/2211.03622.pdf

[argumentum]

..this study bring me a sense of job security. I will not be replaced by "AI" this year. Unless the interviewer got the questions and answers via "AI"

Might as well save the lazy ones ( not me  ) 16 page reading:

8 CONCLUSION
We conducted the first user study examining how people interact
with an AI code assistant (built with OpenAI’s Codex) to solve
a variety of security related tasks across different programming
languages. We observed that participants who had access to the AI
assistant were more likely to introduce security vulnerabilities for
the majority of programming tasks, yet were also more likely to rate
their insecure answers as secure compared to those in our control
group. Additionally, we found that participants who invested more
in the creation of their queries to the AI assistant, such as providing
helper functions or adjusting the parameters, were more likely to
eventually provide secure solutions. Finally, to conduct this study,
we created a User Interface specifically designed to explore the
consequences of people using AI-based code generation tools to
write software. We released our UI as well as all user prompt and
interaction data to encourage further research on the variety of
ways users may choose to interact with AI code assistants.

Edited February 15 by argumentum

[jchd]

Unless big names in the LLM area invest real money to improve the state of art (and I hardly see a strong motivation for doing so) I fear that we'll have to face a tsunami of serious bugs in a large number of applications.

[Ganreizu]

Mundane coding will get a big boost but the hard problems still need a human touch. May not stay that way forever though.