Surprised this didn't get more traction, as it's really interesting.

Is there a reason it's ASi-only? I don't know the technical details of MLX, whether it runs or can be run on other hardware, etc.

Also, why does the HF token need to be in an environment variable and passed on the command line?