基于约束优化的渐进式多任务学习方法
DOI:
CSTR:
作者:
作者单位:

中国电子科技集团第二十八研究所 南京 210007

作者简介:

通讯作者:

中图分类号:

TP391.4;TN911.73

基金项目:

信息系统工程全国重点实验室开放基金(05202303)项目资助


Progressive multi-task learning via constrained optimization
Author:
Affiliation:

The 28th Research Institute of China Electronics Technology Group Corporation,Nanjing 210007, China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    随着多任务学习在智能推荐、自动驾驶等复杂业务场景中的深度应用,其任务优先级异质性处理机制逐渐成为制约模型性能的关键瓶颈。现有研究普遍基于损失函数线性组合的经验性策略,存在双重缺陷:一是通过人工调参确定任务权重的范式导致超参数搜索空间随任务量呈组合爆炸式增长;二是任务间梯度竞争引发的负迁移效应会显著侵蚀高优先级任务的性能边界。针对上述挑战,本研究创新性地提出一种基于约束优化的渐进式多任务学习方法,通过将任务优先级结构编码为不等式约束条件,构建具有严格优先级保障的优化范式,基于拉格朗日乘子法建立约束优化框架,确保高优先级任务的性能下限约束不被次级任务优化过程的影响,同时利用渐进式梯度投影算法实现约束空间的动态调整。理论层面,本研究基于非凸优化理论证明算法的收敛性。通过在公开数据集上的实验结果,所提方法在提升次要任务性能的同时确保了高优先级任务的性能稳定,为多任务学习提供了新的理论框架和技术路径。

    Abstract:

    With the extensive application of multi-task learning in complex business scenarios such as intelligent recommendation and autonomous driving, the handling mechanism for heterogeneous task priorities has emerged as a critical bottleneck constraining model performance. Existing approaches predominantly rely on empirical strategies of linear loss function combination, which suffer from dual deficiencies: First, The manual parameter-tuning paradigm for task weighting leads to combinatorial explosion in hyperparameter search space as task quantity increases; second, gradient competition among tasks induces negative transfer effects that significantly erode the performance boundaries of high-priority tasks. To address these challenges, this study proposes an innovative constrained optimization-based progressive multi-task learning method. By encoding task priority structures into inequality constraints, we formulate an optimization paradigm with strict priority guarantees. A constrained optimization framework is established through Lagrangian duality theory to ensure that the performance lower-bound constraints of high-priority tasks remain unaffected by secondary task optimization processes. Meanwhile, a progressive gradient projection algorithm enables dynamic adjustment of constraint spaces. Theoretically, we provide convergence guarantees through non-convex optimization theory. Experimental results on public datasets demonstrate that our method enhances the performance of secondary tasks while ensuring the stability of high-priority tasks, establishing a novel theoretical framework and technical pathway for multitask learning.

    参考文献
    相似文献
    引证文献
引用本文

邱继栋,林泽,于靖,关佳兴,汪亚斌.基于约束优化的渐进式多任务学习方法[J].电子测量技术,2026,49(10):152-161

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2026-08-25
  • 出版日期:
文章二维码

重要通知公告

①《电子测量技术》期刊收款账户变更公告