Providing the latest models with good context can result in extreme savings
awesan on Hacker News
In the thread “Spending on AI is becoming almost impossible for businesses to budget”, replying to this comment
Helped: Excessive documentation and extracting skills to provide good context.
Got in the way: Vague open-ended prompts causing excessive token usage for verification.
I have some bias as a software dev/manager but at least in our org I noticed you can get a lot better value out of your tokens with some proper configuration of context and skills. Providing the latest models with good context can result in extreme savings. After we started excessively documenting and extracting skills everyone has stopped complaining about running out of tokens, because agents stopped having to reconstruct the full context each time from scratch. …