Comment on Mesh LLM: distributed AI computing on irohparentComments−stymaar2moThroughput is not a problem as you just share relatively small vectors (a few kilobytes in size), the key issue is network latency.−jmercouris2moI didn't mean the throughput of the network, I meant the throughput of the calculations. Yes, the latency is the issue.
Comments
Throughput is not a problem as you just share relatively small vectors (a few kilobytes in size), the key issue is network latency.
I didn't mean the throughput of the network, I meant the throughput of the calculations. Yes, the latency is the issue.