Comment on Mesh LLM: distributed AI computing on irohparentComments−i3862moOur skippy library is a patch queue on top of llama that allows us to access internal information, such as activations, and filter tensors on model load.−rao-v2moThis really should be in the blogpost. It’s both useful info and basic courtesy to be explicit about which underlying inferencing engine you are using−sig_kill2moWe didnt post it, we use a library (iroh) who featured us - so we are here answering any Q’s instead :)
Comments
Our skippy library is a patch queue on top of llama that allows us to access internal information, such as activations, and filter tensors on model load.
This really should be in the blogpost. It’s both useful info and basic courtesy to be explicit about which underlying inferencing engine you are using
We didnt post it, we use a library (iroh) who featured us - so we are here answering any Q’s instead :)