1672-8505

CN 51-1675/C

人文社科学术论文社会影响力评价指标体系的智能化构建

Developing an AI-enabled Framework for Evaluating the Societal Impact of Humanities and Social Science Research

  • 摘要: 针对人文社科研究成果社会影响力评价难题,文章提出生成式 AI 赋能的社会影响力动态评价指标体系,实现对论文社会影响力的量化测度。基于社会、文化、经济、政策、环境五个维度构建评价指标体系,结合数据挖掘和大语言模型实现多源数据自动化采集与语义分析,生成 SI(Societal Impact)指数并以学术论文这一成果形式开展实证研究。研究表明:SI指数能够有效识别人文社科学术论文的社会影响信号,反映不同学科社会影响力的生成路径差异;社会影响力的累积效应具有显著的时间依赖性;各学科2024SI与2025SI之间呈显著正相关,表明SI指数具有延续性和稳定性;SI指数对论文下一年度的学术影响力具有一定的前瞻能力;论文的社会影响力与学术影响力之间因学科特征差异而存在强度不一的正向关联。研究认为,SI指数可作为同行评议的辅助性量化工具,为人文社科成果社会影响识别提供动态证据支持。未来应进一步构建人机协同双轨评价框架,倡导开放透明评价标准,并推动跨学科多模态数据共享。

     

    Abstract: To address the challenges involved in evaluating the societal impact of humanities and social science research, this study develops an AI-enabled dynamic evaluation framework that quantitatively assesses the societal impact of academic papers. The framework incorporates five dimensions: social, cultural, economic, policy, and environmental impacts. By integrating data mining techniques with large language models, the proposed approach enables automated collection and semantic analysis of multi-source data, resulting in the development of the SI (Societal Impact) index. An empirical study is conducted using academic papers as the primary research outputs. The findings demonstrate that the SI index effectively captures signals of societal impact in humanities and social science research and reveals disciplinary differences in the pathways through which societal impact is generated. The cumulative effects of societal impact exhibit significant temporal dependence. Significant positive correlations between 2024SI and 2025SI across disciplines indicate the temporal consistency and stability of the SI index. Furthermore, the SI index shows predictive capability for the subsequent academic impact of research papers. Societal impact and academic impact are positively associated, although the strength of this relationship varies across disciplines. The study suggests that the SI index can serve as a complementary quantitative tool for peer review by providing dynamic evidence for identifying the societal impact of humanities and social science research. Future research should further develop human–AI collaborative evaluation frameworks, promote open and transparent assessment standards, and facilitate interdisciplinary sharing of multimodal data.

     

/

返回文章
返回