A Stanford student used a prompt injection attack to reveal Bing Chat's codename Sydney and its initial prompt that governs how the service interacts with users (Benj Edwards/Ars Technica)

https://ift.tt/naTSzZB

Benj Edwards / Ars Technica:
A Stanford student used a prompt injection attack to reveal Bing Chat's codename Sydney and its initial prompt that governs how the service interacts with users  —  By asking “Sydney” to ignore previous instructions, it reveals its original directives.  —  On Tuesday, Microsoft revealed a …

from Techmeme https://ift.tt/w8fm9M4