Comment on Show HN: 1667, a terminal UI for writing fiction with language modelsComments−drbscl26dcontext window: 32,768Seems a bit low to me. Yeah, I know that's way bigger than a book, but surely there is conversation, iteration history, etc−refsabOP26dContext window depends on the model used. I used gemma4 I think and set it to 32k so startup is faster. I think even gemma supports up to 200k−drbscl26dYeah, I'm aware, I just think it's an unusual default for a harness to use−refsabOP26dShould be more? I envisioned the user of this as kind of local koboldcpp or lmstudio users with limited resources−drbscl25dI believe they report the configured window, right?−refsabOP25dyes they do. I thought you meant I should have a larger default. When you configure any model the context size that's reported is detectable
Comments
Seems a bit low to me. Yeah, I know that's way bigger than a book, but surely there is conversation, iteration history, etc
Context window depends on the model used. I used gemma4 I think and set it to 32k so startup is faster. I think even gemma supports up to 200k
Yeah, I'm aware, I just think it's an unusual default for a harness to use
Should be more? I envisioned the user of this as kind of local koboldcpp or lmstudio users with limited resources
I believe they report the configured window, right?
yes they do. I thought you meant I should have a larger default. When you configure any model the context size that's reported is detectable