All 4,799 reports

NoGrok, ChatGPT · 11 Oct 2025

Both makes too much assumptions despite explicitly instructing them to do "verification & validation" of a pathway given a sample statement

egberts1 on Hacker News

In the thread “Two things LLM coding agents are still bad at”

Helped: Gemini barely cut the mustard compared to others.

Got in the way: Navigating semantic pathways and making assumptions based on outdated info.

… And getting them to find 'stmt', 'expr_stmt', and 'primary_stmt_expr' semantic production rules (one is Bison-generated .y file, other is hand-rolled). Both makes too much assumptions despite explicitly instructing them to do "verification & validation" of a pathway given a sample statement. Only Google Gemini barely cut the mustard. …