Based on the intro video on their website and the linked article, it's an LLM agent for your Mac, so in short, what Apple Intelligence should've been from the very start. Create calendar events, look up information, send messages, etc.
Where a lot of these tools fail is "first instruction accuracy". Put another way, what percent of requests are fulfilled accurately without needing to clarify your intention to the AI.
For voice assistants to really work, they need to nail the request on the first attempt in 95%+ of cases.
When the first time success rate for a request drops too low, it indeed becomes way easier to just do it yourself rather than asking the voice assistant for help.
The fact that we haven't solved this problem for basic things like turning on or off a TV doesn't give me much confidence in the future of voice assistants. I find myself frustratingly repeating commands to Siri way too often.
Comments
Based on the intro video on their website and the linked article, it's an LLM agent for your Mac, so in short, what Apple Intelligence should've been from the very start. Create calendar events, look up information, send messages, etc.
These all seem like things that are more work to instruct and AI to do then to just do yourself
Where a lot of these tools fail is "first instruction accuracy". Put another way, what percent of requests are fulfilled accurately without needing to clarify your intention to the AI.
For voice assistants to really work, they need to nail the request on the first attempt in 95%+ of cases.
When the first time success rate for a request drops too low, it indeed becomes way easier to just do it yourself rather than asking the voice assistant for help.
The fact that we haven't solved this problem for basic things like turning on or off a TV doesn't give me much confidence in the future of voice assistants. I find myself frustratingly repeating commands to Siri way too often.