I’m sure the big tech companies are working on exactly this and trimming resources from other areas, both from a simple logistics standpoint and from conversations I’ve had with folks who work (or worked) for these places doing AI.
I personally don’t think LLMs are anywhere near ready for this type of rollout, so it will be a while before we see results. The cost of something like GPT 3.5 deployed at scale is tremendous. The censoring of responses will make it an obstreperous assistant, unless this has gotten considerably better in the last few months. And are we all just going to accept hallucinated results over something that is either vetted or clearly misunderstood?
I don’t even know how far away we are from sufficiently powerful TPUs that fit a mobile case and power profile. But I do think this is likely to be the next big mobile advancement, however far off it may be.
Comments
I’m sure the big tech companies are working on exactly this and trimming resources from other areas, both from a simple logistics standpoint and from conversations I’ve had with folks who work (or worked) for these places doing AI.
I personally don’t think LLMs are anywhere near ready for this type of rollout, so it will be a while before we see results. The cost of something like GPT 3.5 deployed at scale is tremendous. The censoring of responses will make it an obstreperous assistant, unless this has gotten considerably better in the last few months. And are we all just going to accept hallucinated results over something that is either vetted or clearly misunderstood?
I don’t even know how far away we are from sufficiently powerful TPUs that fit a mobile case and power profile. But I do think this is likely to be the next big mobile advancement, however far off it may be.