利用判别采样的视频人脸亲属关系验证
DOI:
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP391. 4

基金项目:

国家自然科学基金(61976023)、北京市自然科学基金(4174101)项目资助


Discriminative sampling for video-based facial kinship verification
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对人脸视频数据中包含大量低质量数据和冗余信息的问题,提出了一种利用深度强化学习实现人脸视频的关键帧和 困难负样本的判别采样,实现了视频人脸亲属关系的验证。 设计了 3 个深度网络来实现特征的学习与关键帧的采样,其中基于 残差网络(Resnet)训练的亲属关系验证网络(KVN)用于验证亲属分类;通过深度强化学习方法分别设计了两个采样网络:关键 帧采样网络(KSN)和负样本采样网络(NESN),用于实现视频关键帧的选取以及负样本的筛选。 实验结果表明,相比于现有的 主流人脸亲属关系验证算法,方法有效提高了亲属关系验证识别率。

    Abstract:

    In this paper, we propose a discriminative sampling method to select most effective samples via deep reinforcement learning for video-based kinship verification. Unlike most existing facial kinship verification methods which focus on extracting effective features with the random sampling strategy, we develop two deep reinforcement learning methods to select samples which are more suitable for learning discriminative features, so that the overall performance can be improved. Compared with the conventional kinship verification problem, video-based kinship verification has received less attention. However, this work has greater value in practical applications. When we try to use kinship verification to solve, for example, the problem of missing population, we often get video data. Compared with images, videos contain more information, and through reasonable use we will get better performance than image-based kinship verification. Specifically, our method uses three subnetworks to achieve the kinship verification task: one DQN-based sampling network to filter the key frame, one DQN-based sampling network to filter the negative sample, and one multi-layer convolutional network to verify the kin relationship. Experimental results on the KFVW datasets show the superiority of our proposed approach over the state-of-the-arts.

    参考文献
    相似文献
    引证文献
引用本文

王仕伟,闫海滨.利用判别采样的视频人脸亲属关系验证[J].电子测量与仪器学报,2021,35(8):12-19

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2023-02-27
  • 出版日期:
文章二维码