A 7B fact-checker beat 30B LLM reviewers and deleted no true claims
Reviewer bias in peer review met a small-model fact-checker and a tool for rewriting papers around LLM reviewers.
TL;DR
- A Hacker News post said a 7B fact-checker beat 30B LLM reviewers and deleted no true claims.
- A GitHub project, game-the-llm-reviewer, proposed defending sound research against LLM reviewer bias through meaning-preserving rewrites.
- On r/MachineLearning, threads raised concerns about the ICLR review policy, LLM feedback quality and whether review infrastructure can absorb rising submission volume.
A Hacker News post said a 7B fact-checker beat 30B LLM reviewers and deleted no true claims, an argument that smaller, task-specific checkers can outperform larger general reviewers. [1]
A GitHub project, game-the-llm-reviewer, took the adversarial angle, proposing to defend sound research against LLM reviewer bias through meaning-preserving rewrites. [2]
On r/MachineLearning, threads raised concerns about the ICLR review policy, asked how LLM feedback was performing, and debated whether review infrastructure can keep up with rising non-slop submission volume driven by agentic tools. [3] [4] [5]
Why it matters
If the tools that screen research can be small and cheap, the bottleneck moves to the review process itself — which the community threads suggest is already under strain.
Editor's note
The 7B fact-checker result is a self-reported benchmark and the review-quality threads are anecdotal; no result here was independently reproduced.