Comment on LeftoverLocals: Listening to LLM responses through leaked GPU local memoryComments−Kab1r2yI've been told that historically performance has been prioritized over security in the GPU space. Mitigating things like this does incur a performance penalty.
Comments
I've been told that historically performance has been prioritized over security in the GPU space. Mitigating things like this does incur a performance penalty.