Skip to content

Comment on Apple rebuilt its on-device AI stack at WWDC 2026

Comments

ABSOP

among the many things I found that were not highlighted anywhere (that I could find) is the distributed inference across Macs (JACCL over Thunderbolt 5), an OpenAI-compatible mlx_lm.server, agentic-on-Mac.

Apple keeps MLX (bring-your-own-weights) separate from Foundation Models / Core AI.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.