All 4,799 reports

YesLlama, GPT · 16 Oct 2024

it's by a large margin sonnet 3.5 for what we do; gemini is terrible so far

anonzzzies on Hacker News

80%+ of our code

In the thread “Ask HN: What is your comfort level with code generated by LLM agents?”

Helped: Using Sonnet 3.5 for productivity.

Got in the way: Gemini performance was terrible.

I use LLMs for 80%+ of our code, but of course it is always human reviewed and tested. We use all types: llama, gpt, claude, gemini, replit, grok and others: we want to know which is the most productive (it's by a large margin sonnet 3.5 for what we do; gemini is terrible so far). We are fine with code generated to be executed immediately (has to be to be productive really), but once we are satisfied, we won't let the PR get get approved without reviews.