Comment on Ask HN: Is it feasible to run a model on device for complete privacy?Comments−benoau3moIt's technically feasible, really just a question of whether this is worth $10,000(s) to you and you're willing to spend it.−mazinzOP3moWhy financially crippling? It’s free to run on device. The native Apple Intelligence works well for smaller context windows and text only.−benoau3moYou can get poor results "for free" from your laptop, but the devices you need for the large models are very expensive.
Comments
It's technically feasible, really just a question of whether this is worth $10,000(s) to you and you're willing to spend it.
Why financially crippling? It’s free to run on device. The native Apple Intelligence works well for smaller context windows and text only.
You can get poor results "for free" from your laptop, but the devices you need for the large models are very expensive.