Artificial Intelligence in Peer Review: Enhancing Efficiency While Preserving Integrity

Journal of Korean Medical Science, 2025

Full text Open access: Gold Metadata (CSL-JSON)
DOI 10.3346/jkms.2025.40.e92
Data confidence 85 high
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

The rapid advancement of artificial intelligence (AI) has transformed various aspects of scientific research, including academic publishing and peer review. In recent years, AI tools such as large language models have demonstrated their capability to streamline numerous tasks traditionally handled by human editors and reviewers. These applications range from automated language and grammar checks to plagiarism detection, format compliance, and even preliminary assessment of research significance. While AI substantially benefits the efficiency and accuracy of academic processes, its integration raises critical ethical and methodological questions, particularly in peer review. AI lacks the subtle understanding of complex scientific content that human expertise provides, posing challenges in evaluating research novelty and significance. Additionally, there are risks associated with over-reliance on AI, potential biases in AI algorithms, and ethical concerns related to transparency, accountability, and data privacy. This review evaluates the perspectives within the scientific community on integrating AI in peer review and academic publishing. By exploring both AI's potential benefits and limitations, we aim to offer practical recommendations that ensure AI is used as a supportive tool, supporting but not replacing human expertise. Such guidelines are essential for preserving the integrity and quality of academic work while benefiting from AI's efficiencies in editorial processes.