AI素养测评的研究图景——基于69项研究的系统回顾

马蕴哲, 唐琼

知识管理论坛 ›› 2026, Vol. 11 ›› Issue (1) : 50-60.

PDF(4016 KB)
PDF(4016 KB)
知识管理论坛 ›› 2026, Vol. 11 ›› Issue (1) : 50-60. DOI: 10.13266/j.issn.2095-5472.2026.005  CSTR: 32306.14.CN11-6036.2026.005
AI赋能知识管理与服务的拓荒探索专题

AI素养测评的研究图景——基于69项研究的系统回顾

作者信息 +

Practices and Advances in Assessing AI Literacy: A Synthesized Review of 69 Empirical Studies

Author information +
文章历史 +

摘要

【目的/意义】 随着AI技术全面融入社会生活,AI素养已成为智能时代公众必备的基础性能力。通过系统梳理国内外AI素养测评实证研究的进展,为后续相关研究提供参考和借鉴。 【方法/过程】 遵循系统综述法,共筛选69篇国内外AI素养测评的实证研究作为分析样本,通过遍历文章内容的方式,统计样本文献的描述性特征,并从测评对象、测评维度、测评工具的开发与验证、影响因素及研究局限等方面进行系统梳理。 【结果/结论】 现有AI素养测评的对象主要包括社会公众、学生、教育工作者;测评的核心维度包括认知、应用、评估、伦理;测评流程涵盖样本选取和测评工具的开发与验证;AI素养水平会受到性别、年龄、国籍、教育背景等变量的影响;现有研究存在测评工具、测评样本、测评方式等方面的局限性,有待在未来研究中进一步完善。

Abstract

[Purpose/Significance] As AI technologies become deeply embedded in social life, AI literacy has emerged as a fundamental competency for the public in the intelligent era. This study aims to systematically review the progress of empirical research on AI literacy assessment worldwide, providing reference and insights for future studies. [Method/Process] Following the principles of systematic review, this study selected 69 empirical studies on AI literacy assessment as the analytical sample. Through a comprehensive examination of the included literature, descriptive characteristics were summarized, and key elements of AI literacy assessment—including assessment targets, assessment dimensions, development and validation of assessment tools, influencing factors, and research limitations—were systematically analyzed. [Result/Conclusion] Existing research shows that AI literacy assessments primarily target the general public, students, and educators. Core assessment dimensions commonly include cognition, application, evaluation, and ethics. The assessment process generally involves sample selection and the development and validation of assessment tools. Empirical findings indicate that AI literacy levels are influenced by variables such as gender, age, nationality, and educational background. Current studies still exhibit limitations regarding assessment tools, sample characteristics, and assessment methods, suggesting the need for further refinement in future research.

关键词

AI素养 / 素养测评 / 测评工具 / 系统综述

Key words

AI literacy / literacy assessment / assessment tools / systematic review

引用本文

导出引用
马蕴哲 , 唐琼. AI素养测评的研究图景——基于69项研究的系统回顾[J]. 知识管理论坛. 2026, 11(1): 50-60 https://doi.org/10.13266/j.issn.2095-5472.2026.005
Ma Yunzhe , Tang Qiong. Practices and Advances in Assessing AI Literacy: A Synthesized Review of 69 Empirical Studies[J]. Knowledge Management Forum. 2026, 11(1): 50-60 https://doi.org/10.13266/j.issn.2095-5472.2026.005
中图分类号: G252.7   

参考文献

[1]
赵益民, 彭雪琴, 寸国美. 人工智能素养的内涵、结构和评价体系[J]. 图书情报工作, 2025, 69(13): 83-93.
ZHAO Y M, PENG X Q, CUN G M. Artificial intelligence literacy: connotation, framework, and evaluation system[J]. Library and information service, 2025, 69(13): 83-93.
[2]
OECD, Commission European. Empowering learners for the age of AI[EB/OL]. [2026-01-04].
[3]
UNESCO. Artificial intelligence and digital transformation: competencies for civil servants[EB/OL]. [2026-01-04].
[4]
McMILLAN S. Literacy and computer literacy: definitions and comparisons[J]. Computers & education, 1996, 27(3/4): 161-170.
[5]
GRASSINI S. A psychometric validation of the PAILQ-6: perceived artificial intelligence literacy questionnaire[C]//Proceedings of the 13th Nordic conference on human-computer interaction. New York: ACM, 2024:1-10.
[6]
KNOTH N, DECKER M, LAUPICHLER M C, et al. Developing a holistic AI literacy assessment matrix–Bridging generic, domain-specific, and ethical competencies[J]. Computers and education open, 2024, 6:100177.
[7]
NG D T K, WU W, LEUNG J K L, et al. Design and validation of the AI literacy questionnaire: the affective, behavioural, cognitive and ethical approach[J]. British journal of educational technology, 2024, 55(3): 1082-1104.
[8]
CALVANI A, FINI A, RANIERI M. Digital competence in K-12. Theoretical models, assessment tools and empirical research[J]. Anàlisi, 2010(40): 157-171.
[9]
CELIK I. Exploring the determinants of artificial intelligence(AI) literacy: digital divide, computational thinking, cognitive absorption[J]. Telematics and informatics, 2023, 83:102026.
[10]
LONG D, MAGERKO B. What is AI literacy? competencies and design considerations[C]// Proceedings of the 2020 CHI conference on human factors in computing systems. New York: ACM, 2020:1-16.
[11]
BLUT M, WANG C, WÜNDERLICH N V, et al. Understanding anthropomorphism in service provision: a meta-analysis of physical robots, chatbots, and other AI[J]. Journal of the Academy of Marketing Science, 2021, 49(4): 632-658.
[12]
BRUCE A, NOURBAKHSH I, SIMMONS R. The role of expressiveness and attention in human-robot interaction[C]//Proceedings 2002 IEEE international conference on robotics and automation. New York: IEEE, 2002:4138-4142.
[13]
VOSSEN S, HAM J, MIDDEN C. What makes social feedback from a robot work? disentangling the effect of speech, physical appearance and evaluation[C]//PLOUG T, HASLE P, OINASKUKKONEN H. International conference on persuasive technology. Heidelberg: Springer Berlin Heidelberg, 2010:52-57.
[14]
KANDLHOFER M, STEINBAUER G, HIRSCHMUGL-GAISCH S, et al. Artificial intelligence and computer science in education: from kindergarten to university[C]//2016 IEEE frontiers in education conference. New York: IEEE, 2016:1-9.
[15]
LAUPICHLER M C, ASTER A, SCHIRCH J, et al. Artificial intelligence literacy in higher and adult education: a scoping literature review[J]. Computers and education: artificial intelligence, 2022, 3:100101.
[16]
NG D T K, LEUNG J K L, CHU S K W, et al. Conceptualizing AI literacy: an exploratory review[J]. Computers and education: artificial intelligence, 2021, 2:100041.
[17]
林燕, 孙海霞, 蒲思樾, 等.国内外人工智能素养测评工具综述[J]. 医学信息学杂志, 2025, 46(10): 25-36.
LIN Y, SUN H X, PU S Y, et al. A systematic review of domestic and international artificial intelligence literacy assessment tools[J]. Journal of medical informatics, 2025, 46(10): 25-36.
[18]
MANSOOR H M H, BAWAZIR A, ALSABRI M A, et al. Artificial intelligence literacy among university students—a comparative transnational survey[J]. Frontiers in communication, 2024(9): 1478476.
[19]
SOTO-SANFIEL M T, ANGULO-BRUNET A, LUTZ C. The scale of artificial intelligence literacy for all (SAIL4ALL): assessing knowledge of artificial intelligence in all adult populations[J]. Humanities and social sciences communications, 2025, 12(1): 1-14.
[20]
XIONG X B, CAO S, GAO T, et al. AI literacy in Chinese preschoolers: evidence from scale validation study[J/OL]. Early education and development, 1-19[2026-01-04].
[21]
DING L, KIM S, Allday R A. Development of an AI literacy assessment for non-technical individuals: what do teachers know?[J]. Contemporary educational technology, 2024, 16(3): ep512.
[22]
DELCKER J, HEIL J, IFENTHALER D. Evidence-based development of an instrument for the assessment of teachers’ self-perceptions of their artificial intelligence competence[J]. Educational technology research and development, 2025, 73(1): 115-133.
[23]
CHENG C C, WANG J S, ZHAI X, et al. AI literacy and gender equity in elementary education: a quasi-experimental study of a STEAM–PBL–AIoT course with questionnaire validation[J]. International journal of STEM education, 2025, 12(1): 50.
[24]
HOBEIKA E, HALLIT R, MALAEB D, et al. Multinational validation of the Arabic version of the artificial intelligence literacy scale (AILS) in university students[J]. Cogent psychology, 2024, 11(1): 2395637.
[25]
SHARIFABADI S R, Shamsi A, Heidari H. AI literacy among librarians in Qom: a case study in Iran[J]. AIB studi, 2025, 65(1): 99-114.
[26]
SI J. Exploring AI literacy, attitudes toward AI, and intentions to use AI in clinical contexts among healthcare students in Korea: a cross-sectional study[J]. BMC medical education, 2025, 25(1): 1233.
[27]
DONG Y, XU W, HUANG J, et al. Validating and refining a multi-dimensional scale for measuring AI literacy in education using the Rasch Model[J]. Humanities and social sciences communications, 2025, 12(1): 1-13.
[28]
HAN S, ZHANG Y. Developing a validated assessment of artificial intelligence literacy for Chinese university students based on educational objectives taxonomy[J/OL]. Journal of research on technology in education, 1-16[2026-01-04].
[29]
TOPAL A D, GÖKÇE A T, EREN C D, et al. Artificial intelligence literacy scale: a study of reliability and validity in Turkish university students[J]. Journal of learning and teaching in digital age, 2025, 10(1): 58-67.
[30]
XU L, ZHANG L, OU L, et al. The development and validation of a scale on student AI literacy in L2 writing: a domain-specific perspective[J]. Journal of second language writing, 2025, 69:101227.
[31]
ZHONG B, LIU X. Evaluating AI literacy of secondary students: framework and scale development[J]. Computers & education, 2025, 227:105230.
[32]
NING Y, ZHANG W, YAO D, et al. Development and validation of the artificial intelligence literacy scale for teachers (AILST)[J]. Education and information technologies, 2025, 30:17769-17803.
[33]
WANG B, RAU P L P, YUAN T. Measuring user competence in using artificial intelligence: validity and reliability of artificial intelligence literacy scale[J]. Behaviour & information technology, 2023, 42(9): 1324-1337.
[34]
郭亚军, 寇旭颍, 冯思倩, 等.人工智能素养:内涵剖析与评估标准构建[J]. 图书馆论坛, 2025, 45(2): 42-50.
GUO Y J, KOU X Y, FENG S Q, et al. Artificial intelligence literacy: connotation analysis and evaluation criteria[J]. Library tribune, 2025, 45(2): 42-50.
[35]
LIU X, ZHANG L, WEI X. Generative artificial intelligence literacy: scale development and its effect on job performance[J]. Behavioral sciences, 2025, 15(6): 811.
[36]
LAUPICHLER M C, ASTER A, HAVERKAMP N, et al. Development of the “Scale for the assessment of non-experts’ AI literacy”–an exploratory factor analysis[J]. Computers in human behavior reports, 2023, 12:100338.
[37]
CELIK I. Towards Intelligent-TPACK: an empirical study on teachers’ professional knowledge to ethically integrate artificial intelligence (AI)-based tools into education[J]. Computers in human behavior, 2023, 138:107468.
[38]
WAELEN R, WIECZOREK M. The struggle for AI’s recognition: understanding the normative implications of gender bias in AI with Honneth’s theory of recognition[J]. Philosophy & technology, 2022, 35(2): 53.
[39]
SIMS R R. Business ethics teaching for effective learning[J]. Teaching business ethics, 2002, 6(4): 393-410.
[40]
CAROLUS A, KOCH M J, STRAKA S, et al. MAILS-Meta AI literacy scale: development and testing of an AI literacy questionnaire based on well-founded competency models and psychological change-and meta-competencies[J]. Computers in human behavior: artificial humans, 2023, 1(2): 100014.
[41]
CHIU T K F, AHMAD Z, ÇOBAN M. Development and validation of teacher artificial intelligence (AI) competence self-efficacy(TAICS) scale[J]. Education and information technologies, 2025, 30(5): 6667-6685.
[42]
YUAN C W, TSAI H S, CHEN Y T. Charting competence: a holistic scale for measuring proficiency in artificial intelligence literacy[J]. Journal of educational computing research, 2024, 62(7): 1455-1484.
[43]
HUANG Z, NAZAR N, ABBAS G, et al. Assessing AI literacy in second language writing: a scale development and validation study[J]. Education and information technologies, 2025, 30(18): 25909-25935.
[44]
EYAL L. Rethinking artificial-intelligence literacy through the lens of teacher educators: the adaptive AI model[J]. Computers and education open, 2025, 9:100291.
[45]
ZHANG H, PERRY A, LEE I. Developing and validating the artificial intelligence literacy concept inventory: an instrument to assess artificial intelligence literacy among middle school students[J]. International journal of artificial intelligence in education, 2025, 35(1): 398-438.
[46]
ULUĞ E, ÖNER K, ARSLANTAŞ S, et al. Adaptation of the artificial intelligence literacy scale into Turkish: a cross-sectional application among healthcare workers, students, and children[J]. Education and information technologies, 2025, 30:21041-21077.
[47]
ITC. ITC guidelines for the large-scale assessment of linguistically and culturally diverse populations[J]. International journal of testing, 2019, 19(4): 301-336.
[48]
LEE SC, BABY T, VONGVIT R, et al. Development and validation of generative AI competence scale (GenAIComp) among university students[J]. Technology in society, 2025, 84:103059.
[49]
刘明, 郭烁, 苏逸飞, 等.大学生生成式人工智能素养测评工具开发与应用[J]. 现代远程教育研究, 2025, 37(6): 24-33, 70.
LIU M, GUO S, SU Y F, et al. Development and application of the assessment tool for college students' generative artificial intelligence literacy[J]. Modern distance education research, 2025, 37(6): 24-33, 70.
[50]
MA S, CHEN Z. The development and validation of the artificial intelligence literacy scale for Chinese college students (AILS-CCS)[J]. IEEE access, 2024, 12:146419-146429.
[51]
SU J. Development and validation of an artificial intelligence literacy assessment for kindergarten children[J]. Education and information technologies, 2024, 29(16): 21811-21831.
[52]
AYDINLAR A, MAVI A, KÜTÜKÇÜ E, et al. Awareness and level of digital literacy among students receiving health-based education[J]. BMC medical education, 2024, 24(1), article number:38.
[53]
BEROÍZA-VALENZUELA F. Implicit gender stereotypes in STEM: measuring cognitive bias and group differences through reaction times[J]. International journal of STEM education, 2025, 12(1), article number:20.
[54]
ABOALSHAMAT K, ALHUZALI R, ALALYANI A, et al. Medical and dental professionals readiness for artificial intelligence for Saudi Arabia vision 2030[J]. International journal of pharmaceutical research and allied sciences, 2022, 11(4): 52-59.
[55]
CHUNG K, KIM S, JANG Y, et al. Developing an AI literacy diagnostic tool for elementary school students[J]. Education and information technologies, 2025, 30(1): 1013-1044.
[56]
GOKCE A T, TOPAL A D, GEÇER A K, et al. Investigating the level of artificial intelligence literacy of university students using decision trees[J]. Education and information technologies, 2025, 30(5): 6765-6784.
[57]
ROŽMAN M, OREŠKI D, ELIAS A, et al. AI literacy among university students: a comparative study of three countries-Slovenia, Croatia, and India[J]. IEEE access, 2025, 13:110671-110688.
[58]
TENBERGA I, DANIELA L. Artificial intelligence literacy competencies for teachers through self-assessment tools[J]. Sustainability, 2024, 16(23): 10386.
[59]
KIREMIT B Y. Validation and reliability of the Turkish adaptation of the artificial intelligence literacy scale (AILS) for healthcare professionals[J/OL]. Journal of research on technology in education, 1-12[2026-01-04].
[60]
PINSKI M, BENLIAN A. AI literacy-towards measuring human competency in artificial intelligence[C]//Proceedings of the 56th annual Hawaii international conference on system sciences. Honolulu: HICSS, 2023:165-174.

PDF(4016 KB)

Accesses

Citation

Detail

段落导航
相关文章

/