Comment on Prompt caching for cheaper LLM tokensparentComments−IanCal8moIt gets used massively in a conversation, also anything that has a lot of explain actions in the system prompt means you have a large matching prefix.
Comments
It gets used massively in a conversation, also anything that has a lot of explain actions in the system prompt means you have a large matching prefix.