Google's AI Overview Bug Triggers Chatbot-Like Responses to Common Search Terms

On May 22, 2024, users reported that Google's AI Overview search feature produced atypical responses when searching for specific terms, including "disregard," "ignore," and "skip." The feature, which summarizes search results, returned messages resembling conversational chatbot replies instead of providing dictionary definitions or search summaries.

Background

AI Overviews replaced the dictionary box and Featured Snippets that previously appeared for individual word searches. The feature has been previously noted to generate incorrect or nonsensical answers, such as recommending glue on pizza.

Technical Details

The issue occurs when a search term matches common prompt-injection triggers.

Searching for "disregard" resulted in responses such as: "Got it. If you need anything else or have a new question later, just let me know!"

Adding the word "definition" to the query did not consistently resolve the problem. The AI continued to treat the query as an instruction rather than a request for information.

Impact

The bug affects certain search terms, not all users. The dictionary lookup feature is a widely used function in Google Search.

Response

Google stopped showing AI Overviews for the term "disregard" following the reports. As of Friday afternoon, responses for "ignore" and "skip" remained unmodified. Google has not issued a public statement on the issue.