- 著者
- 鈴木 克洋 中村 文彦 大塚 慈雨 正井 克俊 伊藤 勇太 杉浦 裕太 杉本 麻樹
- 出版者
- 特定非営利活動法人 日本バーチャルリアリティ学会
- 雑誌
- 日本バーチャルリアリティ学会論文誌 (ISSN:1344011X)
- 巻号頁・発行日
- vol.22, no.3, pp.379-389, 2017 (Released:2017-09-30)
- 参考文献数
- 17
The head-mounted displays (HMD) allow people to enjoy immersive VR experience. A virtual avatar can be the representative of a user in the virtual environment. However, the expression of the virtual avatar with a HMD user is constrained. A major problem of wearing an HMD is that a large portion of one's face is occluded, making facial recognition difficult in an HMD-based virtual environment. To overcome this problem, we propose a facial expression mapping technology using retro-reflective photoelectric sensors. The sensors attached inside the HMD measures the distance between sensors and a face. The distance values of five basic facial expressions (Neutral, Happy, Angry, Surprised, and Sad) are used for training the neural network to estimate the facial expression of a user. Our system can also reproduce facial expression change in real-time through an existing avatar by using regression.
- 著者
- 鈴木 克洋 中村 文彦 大塚 慈雨 正井 克俊 伊藤 勇太 杉浦 裕太 杉本 麻樹
- 出版者
- 特定非営利活動法人 日本バーチャルリアリティ学会
- 雑誌
- 日本バーチャルリアリティ学会論文誌 (ISSN:1344011X)
- 巻号頁・発行日
- vol.22, no.3, pp.379-389, 2017
<p>The head-mounted displays (HMD) allow people to enjoy immersive VR experience. A virtual avatar can be the representative of a user in the virtual environment. However, the expression of the virtual avatar with a HMD user is constrained. A major problem of wearing an HMD is that a large portion of one's face is occluded, making facial recognition difficult in an HMD-based virtual environment. To overcome this problem, we propose a facial expression mapping technology using retro-reflective photoelectric sensors. The sensors attached inside the HMD measures the distance between sensors and a face. The distance values of five basic facial expressions (Neutral, Happy, Angry, Surprised, and Sad) are used for training the neural network to estimate the facial expression of a user. Our system can also reproduce facial expression change in real-time through an existing avatar by using regression.</p>