Comment on Show HN: Rapid-MLX – Run local LLMs on Mac, 2-3x faster than alternativesComments−c0rruptbytes4moi use this, big fan - i have unlimited codex tokens if you ever need some dev assistanceWould definitely love benchmarks against omlx and fast-mlx one day (i also have a 256gb m3 ultra)−taylorhou4mois this available for other open source projects? i'm stealing tokens from my employer effectively and keep hitting my limits re: codex tokens o_Oi'm working on github.com/teale-ai (distributed inference)−Johnny_Bonk4moThis looks somewhat interesting. Is the premise that if you have a strong Mac, you can rent out your hardware for someone to run inference on it?
Comments
i use this, big fan - i have unlimited codex tokens if you ever need some dev assistance
Would definitely love benchmarks against omlx and fast-mlx one day (i also have a 256gb m3 ultra)
is this available for other open source projects? i'm stealing tokens from my employer effectively and keep hitting my limits re: codex tokens o_O
i'm working on github.com/teale-ai (distributed inference)
This looks somewhat interesting. Is the premise that if you have a strong Mac, you can rent out your hardware for someone to run inference on it?