I'm frustrated with Gemini Advanced because of this. It's very good at interacting with calendar and stuff like a digital assistant IF you use text to talk to it. The speech to text is awful (and borderline dangerous).