Fluency Illusion: A Review on Influence of ChatGPT in Classroom Settings

Information, 2026

Full text Open access: Gold Metadata (CSL-JSON)
DOI 10.3390/info17030299
Data confidence 85 high
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

The rapid adoption of generative artificial intelligence tools such as ChatGPT in educational settings has generated both enthusiasm and concern regarding their influence on student learning. While several studies report improvements in efficiency, confidence, and perceived understanding, evidence for durable conceptual learning and knowledge transfer remains mixed. This article examines these tensions through the concept of fluency illusion, a cognitive phenomenon in which information that is easy to process is mistakenly judged as being well understood. Using a narrative conceptual review approach, this study synthesizes findings from 41 publications identified through searches of Google Scholar, Scopus, Web of Science, and ERIC covering the period from 2022 to early 2026. The reviewed literature includes 28 empirical studies, nine conceptual or theoretical analyses, and four review articles addressing the use of ChatGPT in educational contexts. Across domains such as writing and language learning, STEM problem solving, feedback and tutoring, and assessment, the literature shows a recurring pattern in which fluent AI-generated responses increase learners’ confidence without consistently improving deeper conceptual understanding. Drawing on research from cognitive psychology and metacognition, this review proposes an integrative conceptual account of how fluent AI output may shape learners’ judgments of understanding and influence their engagement with learning tasks. The paper concludes by discussing implications for instructional design, assessment practices, and metacognitive scaffolding, and outlines directions for future research aimed at empirically examining the proposed framework and identifying strategies to reduce fluency-driven misjudgments while preserving the potential benefits of generative AI in education.