Comment on DeepSeek V4 Flash on a Single AMD MI300XparentComments−langs1moYou need to optimize the KVCache part(save to disk to save compute) to achieve this goal.
Comments
You need to optimize the KVCache part(save to disk to save compute) to achieve this goal.