A paper published in the Proceedings of the National Academy of Sciences (PNAS) characterized large language models as posing an “existential threat” to online survey research. The study demonstrated that autonomous AI agents can pass 99.8% of standard attention checks, CAPTCHAs and open-ended content analysis. AI agents can also maintain coherent demographic personas and generate survey responses indistinguishable from human participants.
The implications for the market research industry are stark. The paper estimates that a single survey can be completed by an AI agent for only five cents, yielding large profit margins for bad actors and creating powerful incentives for fraud at scale. For researchers and insights professionals who depend on survey data, these findings raise urgent questions about data integrity and the future of online research.
But how serious is this threat in practice? And what can be done about it?
This session separates hype from reality, examining what AI agents can and cannot do. AI agents produce behavioral signatures that are unmistakably non-human and 100% detectable. We will demonstrate this with actual behavioral data from AI agents showing exactly what these signatures look like and why they cannot be faked.