Comment on δ-mem: Efficient Online Memory for Large Language ModelsComments−3form3moInteresting points:- fixed size of the memory seems like a good idea to overcome the current limitations- skimming through the thing, I can't find any mention of the cost?- I would need more time to read it in-depth to see if this is legitimate and not just fancy form of overfitting or training on testing data
Comments
Interesting points:
- fixed size of the memory seems like a good idea to overcome the current limitations
- skimming through the thing, I can't find any mention of the cost?
- I would need more time to read it in-depth to see if this is legitimate and not just fancy form of overfitting or training on testing data