Comment on Gemini responds to request to turn on lights with hallucinated jailbreak promptComments−sd97moConcerning for sure. This jailbreak comes as a “system” message, which will have more force than a "user" message.The user posted the full chat history below in the thread; they literally just asked to turn on the lights with a voice command [1].[1] https://www.reddit.com/r/googlehome/comments/1qyvl8b/comment...
Comments
Concerning for sure. This jailbreak comes as a “system” message, which will have more force than a "user" message.
The user posted the full chat history below in the thread; they literally just asked to turn on the lights with a voice command [1].
[1] https://www.reddit.com/r/googlehome/comments/1qyvl8b/comment...