大语言模型辅助核查对用户信息真伪甄别效果影响的差异研究
A Study on the Differences in the Impact of Large Language Model-Assisted Verification on the Authenticity Discrimination of User Information
摘要
【目的/意义】聚焦大语言模型在事实核查领域的应用效果,系统探究其对用户信息真伪甄别效果的影响,并考察人口统计学变量的调节效应,为社交平台打击虚假信息提供实证支持。【方法/过程】以健康类信息为具体情境和实验材料,基于双过程理论采用组间对照实验设计,招募142名参与者,构建使用LLM进行事实核查的实验组和依靠自身知识判断的对照组,通过单因素方差分析与调节效应分析,探究LLM对用户信息真伪甄别效果的影响及性别、年龄、受教育程度的调节作用。【结果/结论】LLM辅助事实核查显著提升用户信息的真伪甄别效果,其识别虚假信息准确率显著提高,但对真实信息的识别准确率提升未达到显著水平。进一步分析表明,低受教育程度用户在借助LLM辅助事实核查时,信息真伪甄别效果提升更为突出,而性别与年龄变量未呈现显著调节效果。
Abstract
[Purpose/Significance] This study focuses on the application effect of large language models in the field of fact-checking, aiming to systematically explore their impact on users' ability to distinguish the authenticity of information and examine the moderating effect of demographic variables, providing empirical support for social platforms to combat false information. [Method/Process] This study used health-related information as the specific context and experimental material, adopting an inter-group control experiment design based on the dual-process theory. A total of 142 participants were recruited, and an experimental group using LLM for fact-checking and a control group relying on their own knowledge for judgment were established. Through one-way ANOVA and moderation effect analysis, the impact of LLM on users' ability to distinguish the authenticity of information and the moderating effects of gender, age, and education level were explored. [Result/Conclusion] LLM-assisted fact-checking significantly improves users' ability to distinguish the authenticity of information, with a significant increase in the accuracy of identifying false information, but the improvement in the accuracy of identifying true information does not reach a significant level. Further analysis indicates that users with lower educational attainment show a more pronounced improvement in their ability to distinguish the authenticity of information when assisted by LLMs in fact-checking, while gender and age variables do not exhibit significant moderating effects.
关键词
大语言模型 / 事实核查 / 信息真伪甄别效果 / 人口统计学差异 / 调节效应
Key words
large language models / fact-checking / effect of information authenticity discrimination / demographic differences / moderating effect
{{custom_sec.title}}
{{custom_sec.title}}
| [1] |
|
| [2] |
|
| [3] |
DAS A,
|
| [4] |
|
| [5] |
孟健, 方媛.在线新闻核查“众包”模式的应用、困境及对策[J]. 传媒, 2024(14): 90-92.
|
| [6] |
李瑾颉, 聂凯伦, 吴联仁, 等.众包事实核查对信息参与行为的影响:基于来源可信度的调节[J]. 知识管理论坛, 2024, 9(4): 367-379.
|
| [7] |
王智超, 许祯臻, 俞怡帆, 等.社交媒体上错误信息的分享:影响因素、理论解释和干预[J]. 心理学探新, 2024, 44(6): 507-515.
|
| [8] |
|
| [9] |
王孝盼, 张淼, 吴懿, 等.社交媒体中健康信息可信度的影响因素研究:先验知识的调节作用[J]. 信息资源管理学报, 2024, 14(1): 55-67.
|
| [10] |
张翔然, 李璐旸.PromptWE:一种融合解释的提示学习事实核查模型[J]. 清华大学学报(自然科学版), 2024, 64(5): 760-769.
|
| [11] |
张欣, 孙靖超.基于大语言模型的虚假信息检测框架综述[J]. 计算机科学与探索, 2025, 19(6): 1414-1436.
|
| [12] |
|
| [13] |
|
| [14] |
何宇华, 李霞.生成式人工智能虚假信息治理的新挑战及应对策略——基于敏捷治理的视角[J]. 治理研究, 2024, 40(4): 142-156, 160.
|
| [151] |
祁凯, 周燕生.基于大语言模型生成内容的负面舆情态势恶化牵引作用研究[J]. 情报杂志, 2025, 44(8): 153-161, 171.
|
| [16] |
|
| [17] |
ALI K,
|
| [18] |
|
| [19] |
|
| [20] |
付少雄, 孙岚, 邓胜利, 等.应对理论视角下短视频用户虚假健康信息采纳的动因研究[J]. 情报资料工作, 2023, 44(6): 100-110.
|
| [21] |
姜雨杉, 张仰森.大语言模型驱动的立场感知事实核查[J]. 计算机应用, 2024, 44(10): 3067-3073.
|
| [22] |
|
| [23] |
郑铭, 李婕, 成佩霞, 等.新型冠状病毒肺炎流行期间公众对典型谣言正确甄别率的调查[J]. 中南大学学报(医学版), 2022, 47(12): 1704-1710.
|
| [24] |
虞鑫, 王金鹏.“真实”的鸿沟:人类认知与大语言模型判定新闻真实的比较研究[J]. 当代传播, 2024(5): 17-23.
|
| [25] |
周国韬, 邓胜利.突发公共卫生事件下老年人信息感知与保护性行动决策研究[J]. 情报资料工作, 2021, 42(2): 31-42.
|
| [26] |
张秀, 李月琳.年龄梯度视角下网络用户健康信息甄别能力研究[J]. 情报学报, 2019, 38(8): 838-848.
|
| [27] |
|
| [28] |
刘鸣筝, 孔泽鸣.媒介素养视阈下公众谣言辨别能力及其影响因素的实证研究[J]. 新闻大学, 2017(4): 102-109, 151.
|
| [29] |
邓胜利, 顾一飞.网络虚假健康信息研究综述:认知、行为与治理[J]. 图书馆杂志, 2022, 41(5): 14-22.
|
作者贡献声明/Author contributions:
李汪煦:撰写论文初稿,修改论文。
夏志杰:进行选题的把握与指导,对论文初稿提出修改意见以及最终定稿。
基金
/
| 〈 |
|
〉 |




