1m is too high, they used to autocompact a little too soon, maybe I tweaked defaults, it was kind of annoying, 200k tokens is too soon for me, I feel like the sweet spot is around 400k tokens.
Funnily enough Groks API charges less when you are below 400k tokens.
Half a million can get you reasonably far with enough of your codebase within the models context window.
I lowkey blame the 1m context window as the start of Anthropics worse woes earlier this year.
Comments
1m is too high, they used to autocompact a little too soon, maybe I tweaked defaults, it was kind of annoying, 200k tokens is too soon for me, I feel like the sweet spot is around 400k tokens.
Funnily enough Groks API charges less when you are below 400k tokens.
Half a million can get you reasonably far with enough of your codebase within the models context window.
I lowkey blame the 1m context window as the start of Anthropics worse woes earlier this year.
You can change your compaction token limit to 400k if you want.
CLAUDE_AUTOCOMPACT_PCT_OVERRIDE
And
CLAUDE_CODE_AUTO_COMPACT_WINDOW