Research papers found carrying hidden white text giving instructions not to highlight negatives as concern grows over use of large language models for peer review
This is the biggest issue - peer review is supposed to be about critical analysis and domain expertise, not just following promts blindly, and no AI today has actual scientific understanding to catch subtle methodological flaws.
Or maybe AI shouldn’t review things? Who knows what they are hallucinating.
This is the biggest issue - peer review is supposed to be about critical analysis and domain expertise, not just following promts blindly, and no AI today has actual scientific understanding to catch subtle methodological flaws.
Yeah absolutely, but researchers who are attempting skirt review processes to only receice positive feedback are not respecting the process.
What’s to respect in an AI review where they didn’t even review the output. It’s an LLM lazy review. Deserves to be gamed.
Yes, the reviewers should not be using it. The researcher shouldnt be submitting it with the intention of gaming it.
AI is not all LLM chat bots, there are legitimate AI implementations used in research.