渐进式融合知识蒸馏的工业异常检测方法
DOI:
CSTR:
作者:
作者单位:

沈阳工业大学信息科学与工程学院 沈阳 110872

作者简介:

通讯作者:

中图分类号:

TN98

基金项目:

辽宁省教育厅基本科研面上项目(JYTMS20231213)、辽宁省科技计划联合计划面上项目(2024-MSLH-349)、国家自然科学基金 (62301339)、辽宁省科技厅联合计划项目 (2023JH2/101700279)资助


Asymptotic fusion knowledge distillation for industrial anomaly detection
Author:
Affiliation:

School of Information Science and Engineering,Shenyang University of Technology,Shenyang 110872, China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    为解决知识蒸馏异常检测模型中出现知识冗余的问题,本文提出一种渐进式知识融合蒸馏的工业检测方法。本文采用反向知识蒸馏作为检测模型的基础网络,虽然反向知识蒸馏能阻止异常表征传播至学生网络,但是该方法下学生网络获取的知识不仅复杂且冗余,难以保证学生网络能够重建出对应的浅层表征。为转化教师网络输出的高层次复杂且冗余的信息,提出了渐进式知识融合机制。为转化复杂表征,该机制将基础几何知识逐步迁移至深层语义知识,促进学生网络有效地学习特征表示;为剔除多级教师网络输出的信息中的冗余知识,该机制采用可学习的特征权重分配方式,促进了学生网络重建,实现了模型异常检测能力的提升。该方法在MVTec AD数据集上进行实验,实验结果显示,在数据集各个类别下的评价指标AUROC-image为99%,AUROC-pixel为97.9%,AUPRO为94.8%,超越了绝大部分目前主流的检测模型,验证了方法的有效性和优越性。

    Abstract:

    To address the issue of knowledge redundancy in knowledge distillation-based anomaly detection models, this paper proposes an industrial detection method based on asymptotic knowledge fusion distillation. This paper adopts reverse knowledge distillation as the backbone network of the detection model. Although reverse knowledge distillation can prevent the propagation of abnormal representations to the student network, the knowledge acquired by the student network under this method is not only complex but also redundant, making it difficult to ensure that the student network can reconstruct the corresponding shallow representations. To transform the high-level, complex, and redundant information output by the teacher network, an asymptotic knowledge fusion mechanism is proposed. For transforming complex representations, this mechanism gradually transfers basic geometric knowledge to deep semantic knowledge, enabling the student network to learn feature representations effectively. For eliminating redundant knowledge from the information output by multi-level teacher networks, this mechanism adopts a learnable feature weight assignment method, which promotes the reconstruction of the student network and improves the anomaly detection capability of the model. Experiments are conducted on the MVTec AD dataset. The results show that the evaluation metrics under all categories of the dataset are 99% for AUROC-image, 97.9% for AUROC-pixel, and 94.8% for AUPRO, which outperform most of the current mainstream detection models, verifying the effectiveness and superiority of the proposed method.

    参考文献
    相似文献
    引证文献
引用本文

赵智斌,王浩,朱建光,薛丹.渐进式融合知识蒸馏的工业异常检测方法[J].电子测量技术,2026,49(5):251-260

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2026-05-08
  • 出版日期:
文章二维码

重要通知公告

①《电子测量技术》期刊收款账户变更公告