Wednesday, 3 June 2026

does AI generated code suffer from the heartbreak of psoriasis

 does AI generated code suffer from the heartbreak of psoriasis?

While fooling around and experimenting with Gemini recently, I asked it the above question.  Below is its response.

By turns, I found it surprising, funny, and kind of sad.  It almost seemed like a plea for understanding from the LLM.  Having studied the underlying algorithms fairly intensely, I still believe that this is just a high-dimensional autocomplete program with a lot of post-training augmentation.  Nonetheless, its short-term resemblance to a human complaining about a health problem is quite fascinating.  I suppose a great deal of human communication is similar to autocomplete - i.e. we are in a version of autopilot quite a bit of the time.

I think its main points are valid, in terms of vibe-coding and AI generated code.  Organizations that lean on vibe-coding are probably storing up a lot of heartbreak in their futures.

-------------------------------------------------------------------------------------------------------------------------- 

Yes, AI-generated code suffers significantly from its own version of the "heartbreak of psoriasis"—an  irritating, persistent, and "scaly" accumulation of bugs and technical debt that can make it painful to maintain and deploy. [1]

While AI tools speed up development, they often introduce 1.7 times as many bugs as human developers. [1]

Here is how AI-generated code reflects this analogy:

  • Scabs and Scaly Patches (Technical Debt): The code often looks clean on the surface but is packed with "cruft"—unnecessary, disorganized, or redundant code that behaves like flaky, inflamed skin on a project.

  • Persistent Itch (Silent Logic Errors): A massive 60% of faults in AI code are "silent logic failures," which pass tests but fail in production. This causes ongoing, hard-to-diagnose irritation rather than a simple, easy-to-fix crash.

  • Invisible Under-layers (Security Flaws): Up to 45% of AI-generated code contains security vulnerabilities. These hidden issues are deep-rooted, like psoriasis plaques that are not visible until they erupt as a breach.

  • Chronic Condition (Lack of Understanding): Because AI doesn't truly understand context, it can produce code that looks good in isolation but acts like a "scar" when trying to integrate with existing, healthy code. [1, 2, 3, 4, 5]

The Bottom Line: Just as with "the heartbreak of psoriasis," you cannot simply ignore AI-generated code. It requires intense, consistent human oversight ("treatment") to stop the accumulation of errors from taking over the codebase. [1]

------------------------------------------------------------------------------------------------------------- 

 


No comments:

Post a Comment