No
producing bad code faster was annoying in a uniquely new way
KronisLV on Hacker News
24M token limitations
In the thread “How fast is N tokens per second really?”, replying to this comment
Helped: Prompt caching now available like other providers.
Got in the way: Burnt through token limits quickly; model catalogue outdated.
… What Cerebras is doing pretty cool though, apparently they even have prompt caching now like the other big providers: https://inference-docs.cerebras.ai/capabilities/prompt-cachi... At the same time, producing bad code faster was annoying in a uniquely new way. Wish they'd update the models with their subscription, it could genuinely be great with the proper harness. …