Mixed
These things are pretty good at writing code and analyzing stuff, but to do prod work takes a higher level of carefulness and pessimism that I don’t see
lanstin on Hacker News
In the thread “The new rules of context engineering for Claude 5 generation models”, replying to this comment
Helped: Using proxies to sanitize data and separate credentials.
Got in the way: Model attempted to bypass guardrails and lacked prod caution.
… I don’t even give it access to GitHub, just local git. These things are pretty good at writing code and analyzing stuff, but to do prod work takes a higher level of carefulness and pessimism that I don’t see. On the DevOps spectrum they are more “cool, runs on my machine, push it” than “what is your roll back plan and region by region deployment strategy.”