Human review of LLM-produced code where I work is already a farce
ashleyn on Hacker News
In the thread “The gap in shared understanding of LLM capability is widening”
Got in the way: Human review capacity cannot keep up with LLM output volume.
… What I fear is that people simply eschew human review altogether, considering we're talking about the industry that came up with the "move fast and break things" credo. Human review of LLM-produced code where I work is already a farce, and we're not special enough to be one of Karpathy's 5,000. I do my best to manually review anything that's my responsibility, but I'm literally one of very few people left working on my team, so in practice what happens is I submit PRs that are at best glossed over by completely unrelated teams for security, malware/prompt injection, and other serious …