Comment on LeftoverLocals: Listening to LLM responses through leaked GPU local memoryparentComments−ks6g10OP2yThis is specific to local/scratch memory which is not exposed for allocation in the same way dram is.
Comments
This is specific to local/scratch memory which is not exposed for allocation in the same way dram is.