A Multi-Dimensional Feature Analysis for Detecting and Mitigating AI-Generated Content in Academic Journal Articles

An Tong, Xue Dejun, Zhou Zhe, Kong Xiangyu, Geng Chong

Knowledge Management Forum ›› 2025, Vol. 10 ›› Issue (2) : 99-108.

PDF(1768 KB)
PDF(1768 KB)
Knowledge Management Forum ›› 2025, Vol. 10 ›› Issue (2) : 99-108. DOI: 10.13266/j.issn.2095-5472.2025.007  CSTR: 32306.14.CN11-6036.2025.007

A Multi-Dimensional Feature Analysis for Detecting and Mitigating AI-Generated Content in Academic Journal Articles

Author information +
History +

Abstract

[Purpose/Significance] Investigating the characteristics of AI-generated academic journal content and establishing a multidimensional analytical framework are crucial for identifying improper use of AIGC in manuscripts, addressing challenges in peer review complexity, and upholding the quality and credibility of academic publishing. [Method/Process] This study analyzed journal articles with varying AIGC values across eight dimensions: citations, data, viewpoints and conclusions, structural framework, logical coherence, content consistency, conceptual clarity, and linguistic expression. Both explicit and implicit features of AI-generated content were systematically extracted. The practical efficacy of this approach in peer review was validated through cross-verification between AIGC-CHECK system outputs and empirically observed characteristics of AI-generated texts. A tri-level strategy was subsequently formulated, encompassing rapid preliminary screening, in-depth verification, and comprehensive countermeasures. [Result/Conclusion] Compared to relying solely on detection systems or reviewers' experience, this approach offers a more effective method to address inappropriate AIGC usage, overcomes the limitations of single review techniques, and provides practical value in enhancing review efficiency and publication quality.

Key words

artificial intelligence generated content (AIGC) / AIGC detection / academic editor / man-machine collaboration / academic publication quality

Cite this article

Download Citations
An Tong , Xue Dejun , Zhou Zhe , et al . A Multi-Dimensional Feature Analysis for Detecting and Mitigating AI-Generated Content in Academic Journal Articles[J]. Knowledge Management Forum. 2025, 10(2): 99-108 https://doi.org/10.13266/j.issn.2095-5472.2025.007

References

1
COPE. Authorship and AI tools.[EB/OL]. [2024-10-15]. http://publicationethics.org/cope-position-statements/ai-author.
2
ICMJE. Recommendations[EB/OL]. [2024-10-15]. http://www.icmje.org/recommendations/.
3
ELSEVIER. The use of generative AI and AI-assisted technologies in writing for Elsevier[EB/OL]. [2024-10-15]. http://www.elsevier.com/about/policies-and-standards/the-use-of-generative-ai-and-ai-assisted-technologies-in-writing-for-elsevier.
4
Nature Springer. Springer Nature publishing and editorial policies[EB/OL]. [2024-10-15]. http://www.springernature.com/gp/policies.
5
Nature. Editorial policies[EB/OL]. [2024-10-15]. http://www.nature.com/nature-portfolio/editorial-policies.
6
Science. Science journals: editorial policies[EB/OL]. [2024-10-15]. http://www.science.org/content/page/science-journals-editorial-policies#AI.
7
科学技术部监督司. 负责任研究行为规范指引(2023)[EB/OL]. [2024-10-15]. http://www.most.gov.cn/kjbgz/202312/t20231221_189240.html.
(Ministry of Science and Technology, Department Supervision. Guidelines for responsible research conduct (2023)[EB/OL]. [2024-10-15]. http://www.most.gov.cn/kjbgz/202312/t20231221_189240.html.)
8
中国科学技术信息研究所, 爱思唯尔, 施普林格·自然, 等.学术出版中AIGC使用边界指南(中文版)[EB/OL]. [2024-10-15]. http://www.istic.ac.cn/ueditor/jsp/upload/file/20230922/1695373131354098301.pdf.
(Institute of Scientific and Technical Information of China (ISTIC), Elsevier, Springer Nature, et al. Boundary guidelines for AIGC use in academic publishing (Chinese Version) [EB/OL]. [2024-10-15]. http://www.istic.ac.cn/ueditor/jsp/upload/file/20230922/1695373131354098301.pdf.)
9
中国科学技术信息研究所, 爱思唯尔, 施普林格·自然, 等.学术出版中AIGC使用边界指南2.0(中文版)[EB/OL]. [2024-10-15]. http://www.istic.ac.cn/ueditor/jsp/upload/file/20241009/1728463944539087271.pdf.
(Institute of Scientific and Technical Information of China (ISTIC), Elsevier, Springer Nature, et al. Boundary guidelines for AIGC use in academic publishing 2.0 (Chinese Version) [EB/OL]. [2024-10-15]. http://www.istic.ac.cn/ueditor/jsp/upload/file/20241009/1728463944539087271.pdf.)
10
中国科学院科研道德委员会.关于在科研活动中规范使用人工智能技术的诚信提醒[EB/OL]. [2024-10-15]. http://www.cssar.cas.cn/ztzl2015/kycx/xfjs2021/zdgf2/202409/t20240913_7362745.html.
(Chinese Academy of Sciences, Committee on Research Ethics. Ethical alert on regulating artificial intelligence technology use in scientific research activities [EB/OL]. [2024-10-15]. http://www.cssar.cas.cn/ztzl2015/kycx/xfjs2021/zdgf2/202409/t20240913_7362745.html.)
11
中华医学会杂志社.关于在论文写作和评审过程中使用生成式人工智能技术的有关规定[EB/OL]. [2024-10-15]. http://stm.castscs.org.cn/yw/40598.jhtml.
(Chinese Medical Association Publishing House. Official provisions on generative artificial intelligence technologies in manuscript composition and peer review procedures [EB/OL]. [2024-10-15]. http://stm.castscs.org.cn/yw/40598.jhtml.)
12
中山大学医学期刊联盟.关于生成性人工智能的声明[EB/OL]. [2024-10-15]. http://journal.gzzoc.com/Es/Online/ArticleList.aspx?CID=296.
(Sun Yat-sen University Medical Journals Consortium. Statement on generative artificial intelligence[EB/OL]. [2024-10-15]. http://journal.gzzoc.com/Es/Online/ArticleList.aspx?CID=296.)
13
Sciengine. Requirements for the use of AI technology in scientific writing[EB/OL]. [2024-10-15]. http://www.sciengine.com/policies/use-of-ai-tools.
14
知乎. 多所大学放宽对AI限制!英国大学宣布AI使用新规, 澳洲教育部支持AI使用[EB/OL]. [2024-10-15]. http://zhuanlan.zhihu.com/p/668344435.
(Zhihu. Multiple universities ease AI restrictions: UK universities announce new regulations on AI usage and Australian education ministry endorses AI adoption [EB/OL]. [2024-10-15]. http://zhuanlan.zhihu.com/p/668344435.)
15
新华网.华师大北师大传播院系联合发布AIGC学生使用指南[EB/OL]. [2024-10-31]. http://comm.ecnu.edu.cn/4b/70/c41512a609136/page.htm.
(Net Xinhua. ECNU and BNU communication departments jointly release AIGC student usage guidelines[EB/OL]. [2024-10-31]. http://comm.ecnu.edu.cn/4b/70/c41512a609136/page.htm.)
16
THORP H H. ChatGPT is fun, but not an author[J]. Science, 2023, 379(6630): 313-313.
17
LI K Y, YAO H D. Revitalizing our earth: unleashing the power of green energy in soil remediation for a sustainable future[EB/OL]. [2024-10-15]. http://link.springer.com/article/10.1007/s11356-023-29672-6.
18
ELISABETH B. The rat with the big balls and the enormous penis–how Frontiers published a paper with botched AI-generated images[EB/OL]. [2024-10-15]. http://scienceintegritydigest.com/2024/02/15/the-rat-with-the-big-balls-and-enormous-penis-how-frontiers-published-a-paper-with-botched-ai-generated-images/.
19
聂慧超. 学术出版交手AIGC产生“双重魔法”[N]. 中国出版传媒商报, 2024-04-05(1).
(NIE H C. The “dual magic” of academic publishing’s engagement with AI-generated content[N]. China Publishing & Media Business Journal, 2024-04-05(1).)
20
Bloomberg. AI detectors are wrongfully flagging students’ papers as cheating[EB/OL]. [2024-10-15]. http://www.bloomberg.com/news/articles/2024-01-12/ai-detectors-are-wrongfully-flagging-students-papers-as-cheating.
21
郭英剑. 利用人工智能的学术作弊激增, 高校如何应对[EB/OL]. [2024-10-15]. http://news.sciencenet.cn/sbhtmlnews/2024/11/381842.shtm?share_token=d25ad102-c045-4f4c-93bb-167f8f3456ff.
(GUO Y J. Surge in AI-facilitated academic misconduct: strategic responses for higher education institutions [EB/OL]. [2024-10-15]. http://news.sciencenet.cn/sbhtmlnews/2024/11/381842.shtm?share_token=d25ad102-c045-4f4c-93bb-167f8f3456ff.)
22
薛德军, 孔祥煜, 耿崇, 等. 人工智能生成中文学术论文文本检测研究[J]. 北京电子科技学院学报, 2024, 32(3): 104-112.
(XUE D J, KONG X Y, GENG C, et al. Research on detecting AI-generated Chinese academic text[J]. Journal of Beijing Electronic Science and Technology Institute, 2024, 32(3): 104-112.)

安 彤:设计研究框架,进行数据分析,撰写论文;

薛德军:提出研究思路,指导论文修改;

周 哲:提供实验数据;

孔祥煜:提供实验数据;

耿 崇:提出修改意见。

PDF(1768 KB)

Accesses

Citation

Detail

Sections
Recommended

/