Survey fraud has evolved beyond duplicates and obvious speeders. Synthetic identities, automated scripts, and generative AI can now pass screeners and produce plausible-looking answers. This is a vendor-neutral guide to the modern threat — and the layered stack of behavioural and technical signals, backed by human review, that detects it.
CatalystMR Research Team. (2026). Survey Fraud: AI-Generated Responses and New Detection Methods. CatalystMR Methodology Papers. https://www.catalystmr.com/insights/methodology-papers/survey-fraud-ai-detection/
@techreport{catalystmr_survey_fraud_ai_detection,
author={{CatalystMR Research Team}},
title={Survey Fraud: AI-Generated Responses and New Detection Methods},
institution={CatalystMR}, year={2026}, type={Methodology Paper},
url={https://www.catalystmr.com/insights/methodology-papers/survey-fraud-ai-detection/}
}TY - RPRT AU - CatalystMR Research Team TI - Survey Fraud: AI-Generated Responses and New Detection Methods PB - CatalystMR PY - 2026 UR - https://www.catalystmr.com/insights/methodology-papers/survey-fraud-ai-detection/ ER -
For years, fraudulent survey respondents gave themselves away — duplicate IPs, impossible completion times, gibberish open-ends. That era is ending. Bad actors now use VPNs and synthetic identities, automated scripts and survey farms, and generative AI that produces fluent, on-topic open-ends able to pass naïve checks. The tells researchers relied on are exactly the ones modern fraud has learned to avoid.
This paper is a vendor-neutral guide to the current threat and how to meet it. It maps how survey fraud has escalated; explains why no single signal is sufficient any longer; sets out a layered detection stack of behavioural and technical signals; argues why human review remains decisive against fluent fraud; and frames detection as an ongoing arms race rather than a fixed checklist. It is the threat-and-detection companion to the eleven-point QC framework of Paper No. 137.
Historically, many fraudulent respondents were caught by the obvious: duplicate IPs, impossible completion times, or open-ends full of gibberish. Those signals still matter — but on their own they now catch only the laziest fraud. The economics of paid research attract organised, technically capable bad actors, and the tools available to them have changed faster than many QC routines have.
VPNs, proxies, disposable emails, and fabricated profiles let one actor appear as many distinct, plausible respondents.
Scripts and bots — some able to defeat naïve CAPTCHAs — complete surveys en masse, and survey farms coordinate human click-work.
AI can produce fluent, on-topic, non-duplicated open-ends that read like a real respondent and sail past exact-match checks.
Peer-reviewed research into online recruitment has documented just how quickly bots and bad actors can overwhelm a study, and how sophisticated their evasion has become — some bots bypassing CAPTCHAs and generating false contact details.4 The shift is not that fraud appeared; it is that fraud learned to look legitimate.
The clearest way to see why detection had to change is to set the fraud of a few years ago beside its 2025 form. In each row, the defence that used to suffice on its own is now just one signal among many — because the threat has adapted around it.
If each row's old defence can now be individually defeated, then any QC approach resting on one or two signals is, by construction, beatable. The response is not a better single test — it is layering, so that defeating one signal still leaves a respondent exposed by others. That is the subject of the next two sections.
Every individual fraud signal has a blind spot a determined actor can exploit. A VPN check is defeated by residential proxies; a speed threshold by a bot that waits; an exact-match de-duplication by AI that paraphrases. The power of modern detection comes not from any one check being perfect, but from combining independent signals so the evasions required to beat all of them at once rarely co-occur.
A respondent who clears the device-fingerprint check may still straight-line the grid; one who writes a fluent open-end may still arrive on a flagged proxy from an out-of-quota geography. Each signal a fraudster must satisfy multiplies the effort and cost of passing — until, for most, the study is no longer worth gaming. Layering does not need any single signal to be infallible; it needs the signals to fail independently.
Generative AI specifically neutralised the open-end — historically one of the strongest single tells, because gibberish and copy-paste were easy to spot. Now that a fraudulent verbatim can be fluent and unique, the open-end must be read for pattern (uniformity, generic phrasing, mismatch with stated experience) and corroborated against behavioural and technical signals — not trusted on its surface.
Modern fraud detection combines technical and behavioural signals across the field. Each layer below catches something the others can miss; a complete is judged on the weight of the stack, not any single flag. The first layers act before and during fielding; the last reaches into the finished data.
Automated signals are essential and do most of the volume, but they are tuned to patterns; the most advanced fraud is engineered specifically to satisfy those patterns. Experienced reviewers catch what automated validation cannot — context. The ICC/ESOMAR Code's emphasis on human oversight of automated processes is not a formality here; against generated text it is the decisive layer.1
The point is not that humans outperform automation — at scale they cannot. It is that the two fail differently: automation handles volume and catches the technical signals; human review catches meaning and context. Generated text is designed to beat the first, which is precisely why the second has become indispensable rather than optional.
Ask: "What share of open-ends does a person actually read — and who?" A provider relying on automated scoring alone is, against AI-generated text, fighting the last war.
Detection is not a checklist you complete once; it is a moving contest in which each defence prompts a new evasion, and each evasion a new defence. The pairs below show the current state of play — and why the only durable posture is a layered stack that is monitored and updated, not a fixed test.
AI-generated open-ends that are fluent and unique
Pattern & human review of verbatims, not exact-match de-duplication
Residential proxies that defeat simple VPN lists
Device fingerprinting + geo/quota anomaly monitoring across sources
Human-paced bots that mimic realistic timing
Behavioural & consistency signals the timing fix alone doesn't satisfy
Survey fraud has crossed a threshold: it now reads like a real respondent. The defences that once worked alone — de-duplication, a gibberish scan, a speed limit — still belong in the kit, but no longer suffice on their own. The durable response is a layered stack of independent behavioural and technical signals, an open-end discipline that reads for generated-text patterns rather than trusting fluency, a human reviewer as the last layer, and the humility to treat detection as an arms race that must be monitored and updated. The ICC/ESOMAR Code, ESOMAR 37, and ISO 20252 frameworks exist precisely so buyers can ask for this rigour in consistent terms — and recognise it when they see it.1,2,3
CatalystMR is a global market-research panel and fieldwork partner specialising in hard-to-reach B2B, healthcare, and niche audiences. We layer technical and behavioural fraud signals across pre-field, in-field, and post-field stages — backed by experienced human open-end review — and apply them to every project as the standard, not an optional tier.
We publish our own responses to ESOMAR's 37 Questions and treat fraud detection as a monitored, evolving discipline rather than a fixed end-of-field scrub.
Compliance posture: our methodology is aligned to the ESOMAR Code and Guidelines and the ISO 20252 framework, and we are certified under the EU–U.S., UK, and Swiss Data Privacy Frameworks, with personal data siloed from response data.