Negatives of Coding with AI

1 month ago 1

I have been using Claude code for a several months now. I am quite impressed by it’s abilities. Although I have a growing sense that using LLMs for code generation is a double edged sword which can easily swing in the wrong direction.

Here are some of the negatives of using AI for code generation at a large scale.

  1. Hard to release new languages and frameworks. Now seeding would be needed. Teaching the LLMs about new language and frameworks would require upfront effort from the creators. The inertia to learn new framework or languages for developers will become much higher because you would need to invest a lot of time in explaining the code to LLMs. It is yet to be seen how fast can LLMs learn totally new things.
  2. Margin of error is too high. It is almost impossible to predict if your prompt will work or not.
  3. Possibility of generating a Rube Goldberg machine. Instead of a single coherent backend, you will have to use multiple scripts or multiple services which talk to each other. Resulting in a Rube Goldberg’s machine like apparatus. LLMs cannot handle large code bases. As dependence on LLMs increase developers will give in to use smaller code bases with a micro services architecture. The risk is to go too micro. 1
  4. Uncontrollable behaviour shown by LLMs like in classic Mickey Mouse cartoon Fantasia. When I asked Claude to write an unit test, Claude replied that it found some bugs. But it is not going to fix them since I only asked to write the unit tests. It went ahead to write the unit tests without flagging any bugs. Without a human in the loop LLMs can be quite literal in what you ask them to do. 2
  5. Arthur C Clarke’s prediction that at some point people will stop understanding how technology really works. This is the worst risk of all because soon enough, we will reach a point where everything just works. People were talking about making programming as basic as mathematics and English, but now vibing seems to be the norm. Clarke’s third, and probably most well-known, law was that: Any sufficiently advanced technology is indistinguishable from magic. 3
Read Entire Article