Comment on Prompt caching for cheaper LLM tokensparentComments−IanCal8moDo any providers do this level of granularity? Anthropic require explicit cache markers, for example.−jgeralnik8moAnthropic requires explicit cache markers but will “look backwards” some amount, so you don’t need to fall on the exact split to get cached tokens
Comments
Do any providers do this level of granularity? Anthropic require explicit cache markers, for example.
Anthropic requires explicit cache markers but will “look backwards” some amount, so you don’t need to fall on the exact split to get cached tokens