Google study finds five fake documents can wreck AI search retrieval

Researchers show query-echoing documents can sharply degrade RAG retrieval, and the obvious filters carry a real cost Google researchers have found a weak spot in the systems that feed outside knowledge to AI models. The attack is uncomfortably simple: plant documents that repeat the question back. According to a preprint posted to arXiv on November 3, 2026, just five of these ‘query-echoing’ documents per target query cut retrieval quality by 40.2% to 61.5%. The defenses that do work come with a catch. They also make clean, unpoisoned search results worse. What the researchers actually tested The paper, listed as arXiv:2611.04264, focuses on the retrieval step. It studies what the authors call query-relevant corpus poisoning. An attacker adds documents to the searchable collection, written to look highly relevant to a specific query. The team ran its tests on 623 queries drawn from two benchmarks, SciFact and NFCorpus. Both are standard research datasets for measuring how well search systems find the right documents. The scorecard was nDCG@10. That metric checks whether the best documents appear near the top of the first ten results, giving more credit for higher placement. The re...