面向工业环境气体泄漏检测的多模态融合模型*
DOI:
CSTR:
作者:
作者单位:

1.昆明理工大学;2.中国铜业有限公司;3.昆明信息港传媒有限责任公司

作者简介:

通讯作者:

中图分类号:

TP274

基金项目:

云南省重大科技专项计划项目(No. 202202AD080006)


Multi-Modal Fusion Model for Industry Environment Gas Leakage Detection
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    目前工业气体泄漏检测的方法主要使用单一模态的数据,忽略了不同模态数据之间的互补性。由于单一模态数据刻画复杂环境能力的局限性,影响了检测的准确性和鲁棒性?针对上述问题,本文提出了一种融合工业多模态数据的气体泄漏检测模型 (MFT)?为了充分挖掘不同模态数据之间的信息,依据不同数据的特性,引入了两种特征编码器,有效地提取各模态数据的特征;此外,为了充分融合多模态数据,采用了基于多头注意力机制的融合策略,有效融合不同模态数据之间的潜在表示?实验结果表明,本文所提出的方法可以充分利用各模态的之间的互补信息,并在公开的 MultimodalGasData 数据集上取得了 98.05% 准确率,提高气体泄漏检测的准确性和鲁棒性?

    Abstract:

    Industrial gas leak detection remains a critical challenge, with existing methods predominantly relying on single-modality data. This reliance neglects the complementary nature of different modalities and limits the ability to accurately and robustly detect leaks in complex environments. To address these limitations, this study proposes a novel gas leak detection model, the Multimodal Fusion Transformer (MFT), which integrates data from multiple industrial modalities. The MFT model employs two distinct feature encoders to effectively extract features from each modality, tailored to their unique characteristics. To fully leverage the potential of multimodal data, a multi-head attention mechanism is utilized to fuse the latent representations of different modalities. This approach ensures that the complementary information from each modality is effectively combined. Experimental results demonstrate that the proposed method significantly improves the accuracy and robustness of gas leak detection. The MFT model achieves an impressive 98.05% accuracy on the publicly available MultimodalGasData dataset, highlighting its efficacy in utilizing the complementary information across various modalities. This advancement marks a substantial step forward in enhancing the reliability and performance of industrial gas leak detection systems.

    参考文献
    相似文献
    引证文献
引用本文
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2024-07-27
  • 最后修改日期:2024-12-31
  • 录用日期:2025-01-07
  • 在线发布日期:
  • 出版日期:
文章二维码