DATA SCIENCE IN THE MANAGEMENT OF EDUCATIONAL SPACE

To believe or not to believe: on AI hallucinations in education

Authors

How to cite

GOST Nikolaev A. A., Kuznetsov M. Y., Nikolaev V. A. To believe or not to believe: on AI hallucinations in education // Education Management Review. 2026. Vol. 16. No. 3-1. P. 91-101. DOI: 10.25726/b0302-1872-4517-g
APA Nikolaev, A. A., Kuznetsov, M. Y. & Nikolaev, V. A. (2026). To believe or not to believe: on AI hallucinations in education. Education Management Review, 16(3-1), 91-101. https://doi.org/10.25726/b0302-1872-4517-g

Abstract

The development of AI technology has led to the use of large language models (LLM, MLLM) in the education system. However, the problem of AI hallucinations remains a pressing issue when using such models in the educational process. The article examines the problem of hallucinations in LLMs and MLLMs in the context of the educational process. It has been shown that as a result of hallucinations, AI can generate erroneous information, unreliable, fictional content, fabrications, and disinformation. This can negatively impact all participants in the educational process and the education system as a whole. To address the problem of AI hallucinations in the education system, a comprehensive approach is needed, involving the improvement of technologies, training in the use of AI, the development of pedagogical practices, and the creation of regulatory measures.

Keywords

AI hallucinations in education LLM in the educational process chatbot errors AI problems in solving educational problems AI epistemic fallacy AI errors AI false belief

References

Маджумдер М.Ш., Бегунова Д.Д. Причины искажения контента: Анализ и классификация галлюцинаций в больших языковых моделях GPT // Искусственный интеллект и принятие решений. 2024. № 3. С. 32-41.

Понкин И.В., Лаптева А.И. Методология научных исследований и прикладной аналитики. Издание 3-е, дополн. и перераб. М.: Буки Веди, 2022. С. 754.

Промпт: запрос к языковой модели // Грамота.ru. URL: https://gramota.ru/journal/stati/zhizn yazyka/prompt-zapros-k-yazykovoy-modeli (Дата обращения: 18.01.2026).

Aljamaan F., et al. Reference hallucination score for medical artificial intelligence Chatbots: Development and usability study // JMIR Med Inform. 2024. Vol. 12. № 1. e54345.

Bai Z., et al. Hallucination of multimodal large language models: A survey // Comp. Vis. Patt. Recog. 2025. Vol. 1. № 1. pp. 1-40.

Bewersdorff A., et al. Taking the next step with generative artificial intelligence: The transformative role of multimodal large language models in science education // Learn. Individ. Differ. 2025. Vol. 118. № 102601. pp. 1-13.

Gutierrez J.A.A., et al. From error to insight: Pedagogical reflections on AI hallucinations and prompt engineering // J. Hunan Univ. Nat. Sci. 2025. Vol. 52. № 12. pp. 161-170.

Huang L., et al. A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions // ACM Trans. Inf. Syst. 2025. Vol. 43. № 2. pp. 1-55.

Kamel H. Understanding the impact of AI hallucinations on the university community // Cybrarians Journal. 2024. № 73. pp. 111-134.

Küchemann S., et al. On opportunities and challenges of large multimodal foundation models in education // NPJ Sci. Learn. 2025. Vol. 10. № 1. pp. 1-11.

López-Borrull A., Lopezosa C. Mapping the impact of generative AI on disinformation: Insights from a scoping review // Publications. 2025. Vol. 13. № 3. pp. 1-18.

Park S., Nan X. Generative AI and misinformation: A scoping review of the role of generative AI in the generation, detection, mitigation, and impact of misinformation // AI and Soc. 2025. pp. 1-15.

Rashid A.B., Kausik A.K. AI revolutionizing industries worldwide: A comprehensive overview of its diverse applications // Hybrid. Adv. 2024. Vol. 7. № 100277. pp. 1-34.

Shi Y., et al. Large language models in education: A systematic review of empirical applications, benefits, and challenges // Comput. Educ. Artif. Intell. 2025. Vol. 10. № 100529. pp. 1-16.

Sun S., et al. Hallucinations of large multimodal models: Problem and countermeasures // Inform Fusion. 2025. Vol. 118. № 102970. pp. 1-9.

Sun Y., et al. AI hallucination: Towards a comprehensive classification of distorted information in artificial intelligence-generated content // Humanit. Soc. Sci. Commun. 2024. Vol. 11. № 1278. pp. 1-14.

Torres R. AI Hallucination in the context of education: Exploring college students’ use of generative AI for academic tasks // 16th International Conference on E-Education, E-Business, E-Management and E-Learning (IC4e). Instit. Electr. Electron. Eng. Inc. 2025. pp. 445-449.

Wenjuan M.A., et al. The who, why, and how of AI-based chatbots for learning and teaching in higher education: A systematic review // Educ. Inf. Technol. 2025. Vol. 30. pp. 7781-7805.

Yeung L.K.C., et al. In ChatGPT they trust: A study of students’ perceptions and misuse of ChatGPT in higher education // AI Ethics. 2026. Vol. 6. № 11. pp. 1-20.

Yingzhe L.I. Addressing hallucinations in AI-generated content: Strategies for developing student fact-checking and information evaluation skills // Artificial Intelligence Education Studies. 2025. Vol. 1. № 2. pp. 48-62.

Zhou J., et al. Integrating AI into clinical education: Evaluating general practice trainees' proficiency in distinguishing AI-generated hallucinations and impacting factors // BMC Med. Educ. 2025. Vol. 25. № 1. pp. 1-9.

Issue

Section

DATA SCIENCE IN THE MANAGEMENT OF EDUCATIONAL SPACE

Metrics

181 views
0 downloads
Want to publish with us?
Submit an article