Skip to content

Comment on LLMLingua: Compressing Prompts for Faster Inferencing

Comments

Redundancy is resiliency - wonder if there’s still enough error correction in the compressed language?

Error connection is not really required here since there is no lossy communication medium.

Until your prompts looks like the following:

<Do something> with the following text:

<some text>

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.