SCIENCE INTEGRITY ALERT

AI Detector Check: The Fake AI Papers That Fooled a Journal

Two neuroscience papers published this year allegedly generated by AI misused real scientists' open brain-imaging data. The original researchers caught them — here are the 5 red flags that gave the fakes away.

· Reported by The Scientist and Retraction Watch · Assessments below are the researchers' professional judgments — alleged, not proven

AI generated papers just had their most embarrassing exposure yet. In August 2026, Oxford emeritus professor Dorothy Bishop was peer-reviewing a manuscript for a small neuroscience journal when she recognized something from the abstract alone: the dataset was hers. Raw fMRI brain scans from 50 volunteers doing language tasks — thinking of words, matching words to pictures — which she had published on the open repository OpenNeuro four years earlier. What followed unraveled into two published papers, one retraction request, and an ongoing Elsevier investigation.

What is an AI-generated fake paper — and would an ai detector catch it?

What is an AI-generated fake paper? It is a scholarly manuscript that looks like genuine research — abstract, methods, figures, references — but was substantially produced by an AI system rather than by scientists who actually ran the experiments or analyzed the data. In this case, Bishop's assessment was blunt: the papers look convincing on the surface but contain fundamental errors suggesting the authors analyzed the data "beyond perhaps downloading a little bit of it to produce a figure" — if they analyzed it at all.

What happened: the verified timeline

— Bishop reviews a manuscript for a small neuroscience journal, recognizes her own OpenNeuro dataset from the abstract, finds the dataset description doesn't match what her team actually did and that references don't support their claims. The editor is also suspicious. The paper is rejected.

— Expecting the authors to try elsewhere, Bishop searches their names and finds two papers from this year in the Journal of Neurolinguistics (an Elsevier journal), both purporting to use OpenNeuro brain-imaging data.

— The first paper, coauthored by Afzal Khan and Dawood Khan (affiliated with King Saud University in Saudi Arabia and Iqra University in Pakistan), purportedly used brain scans from a dataset created by Kathy Rastle, a University of London psychologist. Rastle concluded they probably never used her data at all.

— The second paper, by Afzal Khan alone, claimed to analyze four OpenNeuro datasets. Bishop raised detailed concerns on PubPeer; she described Khan's attempt at a response as "a total fiasco."

— Bishop asks the journal to retract the articles. Elsevier confirms it is investigating but says it "may take considerable time." The journal's editor, Nai Ding, has submitted the findings of the journal's own inquiry to Elsevier.

Note on fairness: Khan told Retraction Watch he was aware of the concerns, was "taking them seriously," and was "engaging directly and in good faith with the journal," declining specifics while the review is ongoing. He holds a PhD in linguistics and works in an English Language Skills department; his pre-2026 publications were in linguistics and English teaching, not brain imaging.

The 5 red flags that exposed these AI generated papers

These are the concrete tells Bishop and Rastle documented — each one a check any reader can run:

1. The dataset description didn't match reality. The manuscript Bishop reviewed described her dataset in ways that contradicted what she and her colleagues had actually done. An AI that "knows enough about a dataset to produce a plausible paper" still gets the details wrong — and the person who collected the data spots it instantly.
2. References that don't support their claims. Several citations in the rejected manuscript didn't back up what they were cited for. Subtle miscitation is a classic AI tell: the model generates plausible-looking reference lists where the link between claim and source is decorative, not real.
3. Behavioral data that "existed for only some" participants. The May paper claimed behavioral data was available for only some participants — but Rastle confirmed it was available for everyone. The paper invented a limitation the real dataset doesn't have.
4. Scores the dataset doesn't contain. The same paper reported reading-comprehension scores that simply don't exist in Rastle's dataset. As Rastle put it: "We're not sure how they generated the statistics for these variables that didn't even exist." A diagram of brain regions involved in reading, she said, "bore no resemblance to what we know about reading in the brain" — adding that anybody with expertise would have seen it.
5. Numbers that are vaguely right but don't add up. In the August paper, participant counts didn't match the claimed datasets — and Khan's explanation (removing incomplete scans) still didn't reconcile with the original data. One graph showed a participant using a second language for over 50 years when the dataset's maximum value was 37. Bishop's diagnosis: "This is clearly some sort of AI that knows enough about a dataset to produce a plausible paper that purports to use it" — superficially fine, wrong in the specifics. The manuscript's code, she added, didn't actually run or link up to the data.

There was also a sixth, social tell: the May paper's acknowledgements thanked Rastle and her colleagues for sharing their data — data Rastle believes was never used. She called it an attempt "to create a veneer of respectability."

How to spot AI-generated papers yourself

Bishop's own advice, from her blog: check the data, the code, and the references; test the plausibility of the research; ask whether the article actually makes sense. Her honest caveat: "the frauds are getting so good that these methods now seem inadequate." Use this checklist:

✓ Download the dataset yourself. If a paper claims open data, the numbers must match the public files — participant counts, variable names, value ranges. This single check catches most fakes.
✓ Read two or three cited references. Open the actual papers. If a citation doesn't support its sentence, treat the whole manuscript as suspect.
✓ Check claimed variables exist. Search the dataset documentation for every reported measure. Scores that appear in the paper but not the data are a smoking gun.
✓ Sanity-check every figure against domain knowledge. A brain diagram no expert recognizes, a graph with impossible values — fakes fail the expert eye test.
✓ Ask whether the code runs. Shared analysis code that doesn't execute, or doesn't connect to the claimed data, means the analysis may never have happened.
✓ Check the authors' track record. A sudden leap into a field requiring heavy computing and specialist expertise, with no prior publications there, deserves scrutiny — not as proof, but as a reason to verify harder.

What this means for open data

This is the perverse twist: open science created the vulnerability. OpenNeuro exists so researchers can reuse expensive brain scans instead of re-collecting them. But public datasets are also perfect props for fabricated papers — the data is real, downloadable, and citable, which lends the fake paper a borrowed credibility. As Bishop put it, the case is "very upsetting for those of us who are into open data." Rastle pointed to the volunteers: "Participants allow their data to be shared openly to further scientific progress. They don't allow it to be shared openly to perpetuate fraud." If misuse continues, the rational response from dataset creators is to stop sharing — and the whole scientific commons shrinks.

What happens next

Bishop has asked the Journal of Neurolinguistics to retract the articles. Elsevier told her it would investigate but that it "may take considerable time" — a pace Rastle criticized: "When a paper is just so obviously deeply flawed, and probably a fake paper, it really shouldn't take months to get it out of the scientific literature. It's just polluting the scientific record and creating confusion amongst readers and other scientists." For now, both papers remain in the published literature with an investigation pending — which is exactly why knowing the red flags matters.

Test yourself: could you spot a fake paper?

1. What first made Dorothy Bishop suspicious of the manuscript she reviewed?

2. Which claim in the May paper was impossible?

3. In the August paper, one graph showed a participant using a second language for over 50 years. What was the dataset's actual maximum?

4. What did Afzal Khan say when Retraction Watch contacted him?

5. What did Bishop find when she examined the manuscript's analysis code?

Frequently asked questions

Were these papers proven to be AI-generated?

No. Dorothy Bishop and Kathy Rastle believe the papers were AI-generated based on their professional judgment as the scientists whose datasets were allegedly used. Elsevier says it is investigating the Journal of Neurolinguistics papers, and the author says he is engaging with the journal in good faith. Treat the AI-generation claim as alleged until the investigation concludes.

What is OpenNeuro?

OpenNeuro is a public repository where researchers share brain-imaging data openly so other scientists can reuse it. The datasets at the center of this case included raw fMRI scans from volunteers doing language tasks.

Who is Dorothy Bishop?

Dorothy Bishop is an emeritus professor of developmental neuropsychology at the University of Oxford. She spotted the misuse because she recognized her own dataset from a manuscript abstract while peer-reviewing it in August 2026.

What did the accused author say?

Afzal Khan told Retraction Watch he was aware of the concerns, was taking them seriously, and was engaging directly and in good faith with the journal. He said he could not comment on specifics while a review was ongoing.

Why does this case matter for open data?

Open data depends on trust: volunteers share brain scans to advance science, not to become props in fabricated papers. If open datasets become raw material for AI-generated fraud, researchers may stop sharing — and everyone loses.

Sources: Retraction Watch, "When open data are misused" (October 1, 2026); The Scientist, "Alleged AI-Generated Papers Misuse Open Neuroimaging Data" (October 15, 2026); Dorothy Bishop's blog (deevybee.blogspot.com). Assessments attributed to the named researchers are their professional judgments; the Elsevier investigation is ongoing.

Ingenious AI publishes 21 live security platforms, and 100% of them run on permanent getingeniousai.com domains.

Chat with Ingenious AI on WhatsApp →