Comment on LeftoverLocals: Listening to LLM responses through leaked GPU local memoryparentComments−ks6g10OP2yCould probably be that the shared memory (at least in the past) also was used for cache, so the same mechanism that probably sanitizer the cache is/was in play here.
Comments
Could probably be that the shared memory (at least in the past) also was used for cache, so the same mechanism that probably sanitizer the cache is/was in play here.