none of the models I tried are able to produce meaningful results over long periods on this upgrade task without good tooling and strong feedback loops
janee on Hacker News
500k LoC
In the thread “Claude Sonnet 4.5”, replying to this comment
Helped: Custom DSLs and headless browser feedback loops.
Got in the way: Models producing meaningful results over long periods without tooling.
… authorised sessions in a headless browser with basic html parsing tooling so it can "see" what affect it's fixes have. Then you somehow need to also give it a reliable way to keep track of the past and it's own learnings, which sound simple but I have yet to see any tool or model solve it on this scale...will give sonnet 4.5 a try this weekend, but yeah none of the models I tried are able to produce meaningful results over long periods on this upgrade task without good tooling and strong feedback loops Btw I have upgraded the app and taking it to alpha testing now so it is possible