ChatGPT Search can be tricked into misleading users, new research reveals

ChatGPT Search can be tricked into misleading users, new research reveals
By: technology Posted On: December 26, 2024 View:

ChatGPT Search, an AI-powered search engine that went live this month, can be fooled into generating completely misleading summaries, U.K. newspaper The Guardian has found.

ChatGPT’s search feature is meant to make browsing faster by doing things like summarizing a web page’s product reviews. But The Guardian found it could get ChatGPT to ignore negative reviews and generate “entirely positive” summaries by inserting hidden text into websites it created. ChatGPT Search could also be made to spit out malicious code using this method.

Such hidden text attacks are a well-known risk for large language models, but this appears to be the first time it’s demonstrated on a live AI-powered search product. Google, the leader in search, has more experience dealing with similar problems, The Guardian noted.

OpenAI didn’t comment about this specific incident when TechCrunch reached out, but said it uses a variety of methods to block malicious websites and is continually improving.


TechCrunch has an AI-focused newsletter! Sign up here to get it in your inbox every Wednesday.


Read this on technology



Header Banner



Note: There may be some affiliate / associate links throughout the pages of this site. By buying through the links we may receive a commission for the sale. This has no effect on the price you pay.
  Contact Us
  • We would love to hear from you
  • infobuxx@allsites.zendesk.com
  Follow Us
Site Map
Get Site Map
  About

Infobuxx: Your go-to source for the latest in entertainment, health, business, politics, sports, movies, economics, and trending news. Stay informed and entertained with updates that matter!