Xiaomi AI Cube and Xring O100: 1.22 TB/S, 330 Tokens/S and 120B Local AIaicybr.com 9 pointsqb19 days ago2 commentsSaveHideCopy link On HNComments−qbOP19dhttps://old.reddit.com/r/LocalLLaMA/comments/1vwvghi/xiaomi_...−tmikaeld19dTOPS seems to be low though, so fill rate is probably ~10x slower than a 4090.
Comments
https://old.reddit.com/r/LocalLLaMA/comments/1vwvghi/xiaomi_...
TOPS seems to be low though, so fill rate is probably ~10x slower than a 4090.