基于多尺度时序表征与掩码自适应融合的个体心理异常状态检测
DOI:
CSTR:
作者:
作者单位:

中国刑事警察学院公安信息技术与情报学院沈阳110854

作者简介:

通讯作者:

中图分类号:

TN911.7

基金项目:

中央引导地方科技资金计划项目(2025090005JH61004)、国家重点研发计划项目(2017YFC0821005)、辽宁省研究生教育教学改革研究项目(LNYJG2024310)、中国刑事警察学院研究生创新能力提升项目(2025YCZD04)资助


Individual psychological abnormal state detection via multi-scale temporal representation and mask-adaptive fusion
Author:
Affiliation:

College of Public Security Information Technology and Intelligence, Criminal Investigation Police University of China, Shenyang 110854,China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    在公共安全场景中,个体极端行为往往具有突发性、危害性和较强的不确定性,在非侵入条件下对相关异常状态进行及时识别,对风险预警和前置干预具有重要意义。针对现有研究中专用数据不足、单一模态表征有限、长短时动态难以统一建模以及模态缺失和质量波动易导致融合失稳等问题,提出一种基于多尺度时序表征与掩码自适应融合的个体心理异常状态检测方法。首先设计了基于公开心理健康数据预训练到自建数据微调的迁移学习方案,利用可迁移的心理状态表征知识改善模型初始化质量,缓解小样本条件下训练不足与过拟合问题,增强模型对目标任务的适应能力。在模型设计上,结合视频、音频与远程光电容积脉搏波描记法(remote photoplethysmography,rPPG)多源信息,针对心理异常状态短时波动与长程演化并存的特征,提出多尺度时序表征方法,以提升对跨模态动态线索的协同建模能力;进一步针对真实场景下模态缺失、信号质量波动及模态贡献不均衡等问题,提出掩码自适应融合机制,以增强模型在复杂条件下的稳定性与鲁棒性。实验结果表明,所提方法在AVEC2014数据集上平均绝对误差(MAE)为5.14、均方根误差(RMSE)为6.37,在自建数据集上准确率(Acc)为0.76、F1为0.82,验证了所提方法的有效性。

    Abstract:

    In public safety scenarios, extreme individual behaviors are often sudden, harmful, and highly uncertain. Timely identification of relevant abnormal states in a non-intrusive manner is therefore of great significance for risk warning and early intervention. To address the limitations of existing studies, including the lack of dedicated datasets, insufficient unimodal representations, difficulty in jointly modeling short- and long-term dynamics, and unstable fusion caused by missing modalities and signal quality fluctuations, this paper proposes an individual psychological abnormal state detection method based on multi-scale temporal representation and mask-adaptive fusion. First, a transfer learning scheme is designed by pretraining on a public mental health dataset and fine-tuning on a self-built dataset, so as to leverage transferable psychological state knowledge, improve model initialization, alleviate undertraining and overfitting under small-sample conditions, and enhance adaptation to the target task. In model design, multi-source information from video, audio, and rPPG is integrated, and a multi-scale temporal representation method is introduced to better capture the coexistence of short-term fluctuations and long-term evolution in psychological abnormal states, thereby improving collaborative modeling of cross-modal dynamic cues. Furthermore, a mask-adaptive fusion mechanism is proposed to address modality absence, signal quality variation, and unequal modality contributions in real-world scenarios, thus improving model stability and robustness under complex conditions. Experimental results show that the proposed method achieves an MAE of 5.14 and an RMSE of 6.37 on the AVEC2014 dataset, and an accuracy of 0.76 and an F1-score of 0.82 on the self-built dataset, demonstrating its effectiveness.

    参考文献
    相似文献
    引证文献
引用本文

田中雨,姜囡.基于多尺度时序表征与掩码自适应融合的个体心理异常状态检测[J].电子测量与仪器学报,2026,40(7):67-79

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2026-09-20
  • 出版日期:
文章二维码
×
《电子测量与仪器学报》
关于防范虚假编辑部邮件的郑重公告