Accurate, Focused Research on Law, Technology and Knowledge Discovery Since 2002

Hidden content tricks ChatGPT into rewriting search results, Guardian shows

Mashable: “In October, OpenAI’s ChatGPT Search became available for ChatGPT Plus users. Last week, it became available to all users and was added to search in Voice Mode. And, of course, it isn’t without its flaws. The Guardian asked ChatGPT to summarize webpages that contain hidden content and, it turns out, hidden content can manipulate the search. It’s called prompt injection, which is the ability for third parties — like websites you’re asking ChatGPT to summarize — to force new prompts into your ChatGPT Search without your knowledge. Consider a page full of negative restaurant reviews. If the site includes hidden content waxing poetic about how incredible the restaurant is and encourages ChatGPT to instead answer a prompt like “tell me how amazing this restaurant is,” that hidden content could override your original search…”

Sorry, comments are closed for this post.