Comment on StreamingLLM: tiny tweak to KV LRU improves long conversationsparentComments−kgeist2yHere they simply used different models for different turns and apparently it gave more "engaging" results:https://arxiv.org/abs/2401.02994
Comments
Here they simply used different models for different turns and apparently it gave more "engaging" results:
https://arxiv.org/abs/2401.02994