Mixed
we found apis like gpt4 to be quite expensive, though GPT4 did work well for the task
wscp-dev on Hacker News
In the thread “Ask HN: How did LLMs change your products?”
Helped: GPT4 worked well for the codegen task.
Got in the way: Llama2 and CodeLlama had a higher wrong output rate.
… We took quite some time to figure out what to do with AI in our product. When we finally implemented something, we found apis like gpt4 to be quite expensive, though GPT4 did work well for the task. We later turned towards llama2 and codellama, which worked decently but had a higher "wrong output" rate. …