No
I have not found them useful if I need to just stuff everything in a giant context window
Tostino on Hacker News
hundreds of thousands of tokens
In the thread “Integrating AI”, replying to this comment
Got in the way: Stuffing everything into a giant context window due to model degradation.
… These models degrade like crazy at those long token counts though. I have not found them useful if I need to just stuff everything in a giant context window. I'm mostly using Claude though, so slightly different context scale.