Skip to content

Comment on Show HN: 1667, a terminal UI for writing fiction with language modelsparent

Comments

Whole story up to the context limit. Then it starts dropping stuff. But I didn't want auto dropping or auto summaries like what other tools do.

I like to be strategic summarize the correct places when the context gets full.

There is a request inspector that shows everything that is sent.

I'm experimenting with prompt ordering strategies as well. this is surprisingly complext when you take into account the different model providers.

For example local models usually do a different form of prompt caching than for example openai and anthropic

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.