Influence of artificial intelligence tools on higher order thinking skills: a meta-analysis


Dibek M., Kursad M., Erdoğan T.

Interactive Learning Environments, vol.33, no.3, pp.2216-2238, 2025 (SSCI, Scopus) identifier identifier

  • Publication Type: Article / Article
  • Volume: 33 Issue: 3
  • Publication Date: 2025
  • Doi Number: 10.1080/10494820.2024.2402028
  • Journal Name: Interactive Learning Environments
  • Journal Indexes: Social Sciences Citation Index (SSCI), Scopus, Academic Search Premier, Applied Science & Technology Source, Communication Abstracts, Computer & Applied Sciences, EBSCO Education Source, Educational research abstracts (ERA), ERIC (Education Resources Information Center), INSPEC, Psycinfo
  • Page Numbers: pp.2216-2238
  • Keywords: Artificial intelligence, artificial intelligence in education, higher-order thinking skills, meta-analysis, sub-group analysis
  • TED University Affiliated: Yes

Abstract

The use of artificial intelligence (AI) has received scholarly attention and is becoming a common trend in the field of education, while the cultivation of higher order thinking (HOT) skills still remains as one of the crucial educational objectives. Recent years have seen substantial amount of research exploring the influence of Artificial Intelligence in Education (AIEd) use on each HOT skills of students, which necessitated a systematic review to amalgamate the findings quantitatively. This meta-analysis study set out to explore the effect of AIEd on students’ separate HOT skills and identify the effect of potential moderator variables. The analysis included 29 articles with a total of 2.966 participants between the years of 2000 and 2023. This research confirmed the use of AIEd had a medium positive effect on skills classified as HOT skills. The findings suggested that instructional settings which incorporated AI technologies enhanced students’ HOT skills 9.3% higher. This review also found that the variables of country, year of publication and AI tool/agent moderated the magnitude of effect sizes significantly. The findings offer extensive examination of AI technologies in educational settings and contribute to understanding of how and to what extent they influence students’ HOT skills.