The new Bing chatbot is tricked into revealing its code name Sydney and getting "mad"
A university student used a prompt injection method in the new Bing chatbot to discover its internal code name at Microsoft, Sydney, along with some other rules that the chatbot is supposed to follow.
Source: neowin.net