I think Sydney is worrisome in that it shows that even Microsoft, spending tons of money, can’t (or doesn’t want to) stop LLMs from going “off-script”. If your concern is “will Microsoft et. al be careful with deploying new tech”, Sydney was evidence towards “no”. You could guess that the PR incident will have encouraged them to be more careful in the future, but I’m not confident in that.
Comments
I think Sydney is worrisome in that it shows that even Microsoft, spending tons of money, can’t (or doesn’t want to) stop LLMs from going “off-script”. If your concern is “will Microsoft et. al be careful with deploying new tech”, Sydney was evidence towards “no”. You could guess that the PR incident will have encouraged them to be more careful in the future, but I’m not confident in that.