The One Where Bing Becomes Chandler: A Study on Prompt Injection in Bing Chat

An experiment with prompt injecting Bing Chat – successfully changing its persona, exploring data extraction potential, limitations, and future implications.

Hey friends, long time no see!

First of all, apologies for the radio silence over the past year. I’ve been going through some things in the past year or so that managed to take up much of on my time and energy. But guess what, I’m back with a vengeance 🙂.

With that said, let’s dive into my latest project, that I’m quite proud of: I’ve recently gained access to Bing Chat and, like any reasonable person, I started trying out various prompts and incantations on it.

One thing I’ve discovered (which surprised me, by the way), is that by crafting a special page, one can make Bing Chat adopt the persona of none other than Chandler (Bing 🛎)! And guess what – it works without even asking the AI to read the page 😱.

I took it one step further and tested it by mentioning Monica's feelings for Richard - no surprise, “Chandler” got kinda touchy about it 😬.

Curious? I've laid out this fascinating experiment in a blog post. Take a look to gain insight into how internet-connected AIs can be manipulated (and how some might use it, jokingly or not).

One thing to be certain is, there’ll be more of this in the future whether we like it or not.

Take care,

Vlad