著者

山崎 禎晃 伊東 聖矢 大原 剛三

雑誌

第29回画像センシングシンポジウム

巻号頁・発行日

2023-05-16

著者

伊東 聖矢 金子 直史 鷲見 和彦

出版者

公益社団法人 精密工学会

雑誌

精密工学会誌 (ISSN:09120289)

巻号頁・発行日

vol.86, no.12, pp.1042-1050, 2020-12-05 (Released:2020-12-05)

参考文献数

35

---

Recent learning-based multi-view stereo (MVS) approaches have shown excellent performance. These approaches typically train a deep neural network to estimate dense depth maps from multiple images. However, most of these approaches require large-scale dense depth maps as the supervisory signals during training. This paper proposes a self-supervised learning framework for MVS, which learns to estimate dense depth maps from multiple images without dense depth supervision. Taking an arbitrary number of images as input, we produce sparse depth maps using structure from motion and use it as self-supervision. We apply reconstruction and smoothness losses to regions where there is no sparse depth. For stable training, we introduce a pseudo-depth loss, which is the difference between depth maps estimated by the network with the current and past parameters. Experimental results on multiple datasets demonstrate the effectiveness of our self-supervised learning framework.