大语言模型辅助核查对用户信息真伪甄别效果影响的差异研究

李汪煦, 夏志杰

知识管理论坛 ›› 2026, Vol. 11 ›› Issue (3) : 0.

知识管理论坛 ›› 2026, Vol. 11 ›› Issue (3) : 0. DOI: 10.13266/j.issn.2095-5472.2026.020  CSTR: 32306.14.j.issn.2095-5472.2026.020
研究论文

大语言模型辅助核查对用户信息真伪甄别效果影响的差异研究

作者信息 +

A Study on the Differences in the Impact of Large Language Model-Assisted Verification on the Authenticity Discrimination of User Information

Author information +
文章历史 +

摘要

【目的/意义】聚焦大语言模型在事实核查领域的应用效果,系统探究其对用户信息真伪甄别效果的影响,并考察人口统计学变量的调节效应,为社交平台打击虚假信息提供实证支持。【方法/过程】以健康类信息为具体情境和实验材料,基于双过程理论采用组间对照实验设计,招募142名参与者,构建使用LLM进行事实核查的实验组和依靠自身知识判断的对照组,通过单因素方差分析与调节效应分析,探究LLM对用户信息真伪甄别效果的影响及性别、年龄、受教育程度的调节作用。【结果/结论】LLM辅助事实核查显著提升用户信息的真伪甄别效果,其识别虚假信息准确率显著提高,但对真实信息的识别准确率提升未达到显著水平。进一步分析表明,低受教育程度用户在借助LLM辅助事实核查时,信息真伪甄别效果提升更为突出,而性别与年龄变量未呈现显著调节效果。

Abstract

[Purpose/Significance] This study focuses on the application effect of large language models in the field of fact-checking, aiming to systematically explore their impact on users' ability to distinguish the authenticity of information and examine the moderating effect of demographic variables, providing empirical support for social platforms to combat false information. [Method/Process] This study used health-related information as the specific context and experimental material, adopting an inter-group control experiment design based on the dual-process theory. A total of 142 participants were recruited, and an experimental group using LLM for fact-checking and a control group relying on their own knowledge for judgment were established. Through one-way ANOVA and moderation effect analysis, the impact of LLM on users' ability to distinguish the authenticity of information and the moderating effects of gender, age, and education level were explored. [Result/Conclusion] LLM-assisted fact-checking significantly improves users' ability to distinguish the authenticity of information, with a significant increase in the accuracy of identifying false information, but the improvement in the accuracy of identifying true information does not reach a significant level. Further analysis indicates that users with lower educational attainment show a more pronounced improvement in their ability to distinguish the authenticity of information when assisted by LLMs in fact-checking, while gender and age variables do not exhibit significant moderating effects.

关键词

大语言模型 / 事实核查 / 信息真伪甄别效果 / 人口统计学差异 / 调节效应

Key words

large language models / fact-checking / effect of information authenticity discrimination / demographic differences / moderating effect

引用本文

导出引用
李汪煦 , 夏志杰. 大语言模型辅助核查对用户信息真伪甄别效果影响的差异研究[J]. 知识管理论坛. 2026, 11(3): 0 https://doi.org/10.13266/j.issn.2095-5472.2026.020
Li Wangxu , Xia Zhijie. A Study on the Differences in the Impact of Large Language Model-Assisted Verification on the Authenticity Discrimination of User Information[J]. Knowledge Management Forum. 2026, 11(3): 0 https://doi.org/10.13266/j.issn.2095-5472.2026.020
中图分类号: G206   

参考文献

[1]
PORTER E, WOOD T J. The global effectiveness of fact-checking: evidence from simultaneous experiments in Argentina, Nigeria, South Africa, and the United Kingdom[J]. Proceedings of the National Academy of Sciences, 2021, 118(37): e2104235118.
[2]
ROOZENBEEK J, VAN DER LINDEN S, GOLDBERG B, et al. Psychological inoculation improves resilience against misinformation on social media[J]. Science advances, 2022, 8(34): eabo6254.
[3]
DAS A, LIU H, KOVATCHEV V, et al. The state of human-centered NLP technology for fact-checking[J]. Information processing management, 2023, 60(2): 103219.
[4]
QIN C, ZHANG A, ZHANG Z, et al. Is ChatGPT a general-purpose natural language processing task solver?[J]. arXiv preprint arXiv:2302.06476, 2023.
[5]
孟健, 方媛.在线新闻核查“众包”模式的应用、困境及对策[J]. 传媒, 2024(14): 90-92.
MENG J, FANG Y. Application, dilemmas and countermeasures of the "crowdsourcing" model in online news verification [J]. Media, 2024 (14): 90-92.
[6]
李瑾颉, 聂凯伦, 吴联仁, 等.众包事实核查对信息参与行为的影响:基于来源可信度的调节[J]. 知识管理论坛, 2024, 9(4): 367-379.
LI J J, NIE K L, WU L R, et al. The impact of crowdsourced Fact-checking on user information engagement behavior: the moderating of source credibility [J]. Knowledge management forum, 2024, 9(4): 367-379.
[7]
王智超, 许祯臻, 俞怡帆, 等.社交媒体上错误信息的分享:影响因素、理论解释和干预[J]. 心理学探新, 2024, 44(6): 507-515.
WANG Z C, XU Z Z, YU Y F, et al. Sharing of misinformation on social media: influencing factors, theoretical explanations, and interventions [J]. Psychological exploration, 2024, 44(6): 507-515.
[8]
CLAYTON K, BLAIR S, BUSAM J A, et al. Real solutions for fake news? measuring the effectiveness of general warnings and fact-check tags in reducing belief in false stories on social media[J]. Political behavior, 2020, 42(4): 1073-1095.
[9]
王孝盼, 张淼, 吴懿, 等.社交媒体中健康信息可信度的影响因素研究:先验知识的调节作用[J]. 信息资源管理学报, 2024, 14(1): 55-67.
WANG X P, ZHANG M, WU Y, et al. Exploring the antecedents of health information credibility at social media platforms: the moderating role of prior knowledge [J]. Journal of information resources management, 2024, 14(1): 55-67.
[10]
张翔然, 李璐旸.PromptWE:一种融合解释的提示学习事实核查模型[J]. 清华大学学报(自然科学版), 2024, 64(5): 760-769.
ZHANG X R, LI L Y. PromptWE: a fact-checking method based on prompt learning with explanations [J]. Journal of Tsinghua University (science and technology), 2024, 64(5): 760-769.
[11]
张欣, 孙靖超.基于大语言模型的虚假信息检测框架综述[J]. 计算机科学与探索, 2025, 19(6): 1414-1436.
ZHANG X, SUN J C. Review of false information detection frameworks based on large language models [J]. Journal of frontiers of computer science and technology, 2025, 19(6): 1414-1436.
[12]
ROUMELIOTIS K I, TSELIKAS N D, NASIOPOULOS D K. Fake news detection and classification: a comparative study of convolutional neural networks, large language models, and natural language processing models[J]. Future internet, 2025, 17(1): 28.
[13]
TRAN T, VALECHA R, RAO H R. Machine and human roles for mitigation of misinformation harms during crises: an activity theory conceptualization and validation[J]. International journal of information management, 2023, 70: 102627.
[14]
何宇华, 李霞.生成式人工智能虚假信息治理的新挑战及应对策略——基于敏捷治理的视角[J]. 治理研究, 2024, 40(4): 142-156, 160.
HE Y H, LI X. New challenges and countermeasures of false information governance in generative artificial intelligence——based on the agile governance perspective [J]. Governance studies, 2024, 40(4): 142-156, 160.
[151]
祁凯, 周燕生.基于大语言模型生成内容的负面舆情态势恶化牵引作用研究[J]. 情报杂志, 2025, 44(8): 153-161, 171.
QI K, ZHOU Y S. Research on the traction effect of the deterioration of negative public opinion situation based on content generated by large language models [J/OL]. Journal of intelligence, 2025, 44(8): 153-161, 171.
[16]
SHAH S B, THAPA S, ACHARYA A, et al. Navigating the Web of disinformation and misinformation: large language models as double-edged swords[J]. IEEE access, 2024.
[17]
ALI K, LI C, ZAIN-UL-ABDIN K, et al. Fake news on Facebook: examining the impact of heuristic cues on perceived credibility and sharing intention[J]. Internet research, 2022, 32(1): 379-397.
[18]
DEVERNA M R, YAN H Y, YANG K C, et al. Fact-checking information from large language models can decrease headline discernment[J]. Proceedings of the National Academy of Sciences, 2024, 121(50): e2322823121.
[19]
TRUICA C O, APOSTOL E S. It’s all in the embedding! fake news detection using document embeddings[J]. Mathematics, 2023, 11(3): 508.
[20]
付少雄, 孙岚, 邓胜利, 等.应对理论视角下短视频用户虚假健康信息采纳的动因研究[J]. 情报资料工作, 2023, 44(6): 100-110.
FU S X, SUN L, DENG S L, et al. A study on the motivation of short video users' false health information adoption from the perspective of coping theory [J]. Information and documentation services, 2023, 44(6): 100-110.
[21]
姜雨杉, 张仰森.大语言模型驱动的立场感知事实核查[J]. 计算机应用, 2024, 44(10): 3067-3073.
JIANG Y S, ZHANG Y S. Large language model-driven stance-aware fact-checking[J]. Journal of computer applications, 2024, 44(10): 3067-3073.
[22]
RIJO A, WALDZUS S. That's interesting! the role of epistemic emotions and perceived credibility in the relation between prior beliefs and susceptibility to fake-news[J]. Computers in human behavior, 2023, 141: 107619.
[23]
郑铭, 李婕, 成佩霞, 等.新型冠状病毒肺炎流行期间公众对典型谣言正确甄别率的调查[J]. 中南大学学报(医学版), 2022, 47(12): 1704-1710.
ZHENG M, LI J, CHENG P X, et al. A survey on the public’s discrimination rate of typical rumors during the coronavirus disease 2019 epidemic [J]. Journal of Central South University (medical sciences), 2022, 47(12): 1704-1710.
[24]
虞鑫, 王金鹏.“真实”的鸿沟:人类认知与大语言模型判定新闻真实的比较研究[J]. 当代传播, 2024(5): 17-23.
YU X, WANG J P. "The gap of 'truth': a comparative study of human cognition and large language models in judging the truth of news [J]. Journalism communication, 2024(5): 17-23.
[25]
周国韬, 邓胜利.突发公共卫生事件下老年人信息感知与保护性行动决策研究[J]. 情报资料工作, 2021, 42(2): 31-42.
ZHOU G T, DENG S L. Research on the elderly's information perception and protective action decision under the sudden public health event [J]. Information and documentation services, 2021, 42(2): 31-42.
[26]
张秀, 李月琳.年龄梯度视角下网络用户健康信息甄别能力研究[J]. 情报学报, 2019, 38(8): 838-848.
ZHANG X, LI Y L. Ability of users in different age groups to screen health information in social media[J]. Journal of the China Society for Scientific and Technical Information, 2019, 38(8): 838-848.
[27]
BRASHIER N M, SCHACTER D L. Aging in an era of fake news[J]. Current directions in psychological science, 2020, 29(3): 316-323.
[28]
刘鸣筝, 孔泽鸣.媒介素养视阈下公众谣言辨别能力及其影响因素的实证研究[J]. 新闻大学, 2017(4): 102-109, 151.
LIU M Z, KONG Z M. An Empirical study on the nature and determinants of rumor discrimination ability from the perspective of media literacy[J]. Journalism bimonthly, 2017(4): 102-109, 151.
[29]
邓胜利, 顾一飞.网络虚假健康信息研究综述:认知、行为与治理[J]. 图书馆杂志, 2022, 41(5): 14-22.
DENG S L, GU Y F. A review of online health misinformation: recognition, action and governance[J]. Library journal, 2022, 41(5): 14-22.

作者贡献声明/Author contributions:

李汪煦:撰写论文初稿,修改论文。

夏志杰:进行选题的把握与指导,对论文初稿提出修改意见以及最终定稿。

基金

国家社会科学基金一般项目“大数据支持下网络谣言智慧治理机制及运行策略研究”(21BGL243)

Accesses

Citation

Detail

段落导航
相关文章

/