著者

鈴木 克洋 中村 文彦 大塚 慈雨 正井 克俊 伊藤 勇太 杉浦 裕太 杉本 麻樹

出版者

特定非営利活動法人 日本バーチャルリアリティ学会

雑誌

日本バーチャルリアリティ学会論文誌 (ISSN:1344011X)

巻号頁・発行日

vol.22, no.3, pp.379-389, 2017

---

<p>The head-mounted displays (HMD) allow people to enjoy immersive VR experience. A virtual avatar can be the representative of a user in the virtual environment. However, the expression of the virtual avatar with a HMD user is constrained. A major problem of wearing an HMD is that a large portion of one's face is occluded, making facial recognition difficult in an HMD-based virtual environment. To overcome this problem, we propose a facial expression mapping technology using retro-reflective photoelectric sensors. The sensors attached inside the HMD measures the distance between sensors and a face. The distance values of five basic facial expressions (Neutral, Happy, Angry, Surprised, and Sad) are used for training the neural network to estimate the facial expression of a user. Our system can also reproduce facial expression change in real-time through an existing avatar by using regression.</p>