Comment on Ask HN: Is it feasible to run a model on device for complete privacy?parentComments−mazinzOP3moWhy financially crippling? It’s free to run on device. The native Apple Intelligence works well for smaller context windows and text only.−benoau3moYou can get poor results "for free" from your laptop, but the devices you need for the large models are very expensive.
Comments
Why financially crippling? It’s free to run on device. The native Apple Intelligence works well for smaller context windows and text only.
You can get poor results "for free" from your laptop, but the devices you need for the large models are very expensive.