著者

西掘 研人 竹内 義則 松本 哲也 工藤 博章 大西 昇

出版者

一般社団法人映像情報メディア学会

雑誌

映像情報メディア学会誌 : 映像情報メディア (ISSN:13426907)

巻号頁・発行日

vol.62, no.7, pp.1086-1097, 2008-07-01

被引用文献数

1 1

---

We propose a new method for determining the correspondence between audio and visual events based on the selective attention which is observed in a living organism. For auditory attention, our system recognizes a target sound in noisy environments using an auditory filter that focuses on a specific period corresponding to visual events. It was confirmed that the success rate of correspondence between audio and visual events increased from 78.6% without the auditory filter, to 95.2% with the auditory filter. This certifies the importance of visual information for auditory attention. We also realized a visual attention of localizing a sound source and adjusting the line of sight and the iris of a camera when the system perceived a sound, but could not obtain visual information. The success rate of experiments based on visual attention is 93.3%. These results show the effectiveness of the proposed method.