Comment on Qwen3-4B-Thinking-2507parentComments−DSingularity1yNo. Your KV cache is kept in memory also.
Comments
No. Your KV cache is kept in memory also.