结合深度线索和几何结构的稀疏光场密集重建
DOI:
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP391. 41;TN91

基金项目:

国家自然基金(61876057)、安徽省科技重大专项(202103a06020010)、安徽省重点研发计划-科技强警专项(202004d07020012)项目资助


Sparse light fields dense reconstruction combining depth cues and geometric structures
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    光场一次成像可以同时获得空间和角度的四维信息。 现有方法进行角度超分辨率重建时多用于小基线场景的光场图 像,在处理大基线场景重建时存在模糊等现象,同时在光场重建过程中遮挡区域重建效果差、长距离的空间关系难以捕获。 针 对上述问题,提出一种结合深度线索和几何结构的稀疏光场密集重建方法。 该方法采用空间金字塔池化提取多尺度特征,更好 地保留了图像的纹理细节和高频信息;通过在深度估计模块的部分引入空洞卷积并进行密集连接,扩大了感受野,提高了大基 线场景深度估计的精度;利用视图细化模块对图像进行优化处理,在保留视差结构的同时重建了遮挡区域。 实验结果表明,本 文方法较好地解决了大基线场景光场重建问题,在光场大基线场景数据集上超越了其他算法,PSNR 提高了 2 dB,SSIM 提高了 0. 018,重建图像的质量均优于现有的算法。

    Abstract:

    The four-dimensional information of space and angle can be obtained by one-time imaging of light field. The existing methods are mostly used for the light field image of small baseline scene in the angular super-resolution reconstruction, and there are some phenomena such as blur when reconstructing the large baseline scenes. At the same time, the reconstruction effect of the occlusion area is poor in the process of light field reconstruction, and the long-distance spatial relationship is difficult to capture. To solve this problem, a sparse light field intensive reconstruction method combining depth clues and geometric structure is proposed. This method uses spatial pyramid pool to extract multi-scale features, which can preserve the texture details and high frequency information of images better. By introducing void convolution and dense connection in the depth estimation module, the receptive field is expanded and the accuracy of depth estimation of large baseline scene is improved. The view refinement module is used to optimize the image and reconstruct the occlusion area while preserving the parallax structure. Experimental results show that the proposed method solves the problem of largebaseline scene optical field reconstruction well, and exceeds other algorithms in the large-baseline scene data set, with PSNR increased by 2 dB and SSIM increased by 0. 018. The quality of reconstructed images is superior to the existing algorithms.

    参考文献
    相似文献
    引证文献
引用本文

李 梅,张旭东,孙 锐,范之国.结合深度线索和几何结构的稀疏光场密集重建[J].电子测量与仪器学报,2023,37(3):1-10

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2023-06-15
  • 出版日期:
文章二维码