Comment on Unified Memory, Explained: Why Mini PCs Can Run 70B Models a Big GPU Can'tparentComments−throwa3562622moI thought it was easier to find a possible cut in a MoE where the amount of data transferred between layers is very small (kilo bytes) while in dense architecture this is much harder?
Comments
I thought it was easier to find a possible cut in a MoE where the amount of data transferred between layers is very small (kilo bytes) while in dense architecture this is much harder?