著者
Motaz SABRI
出版者
Japan Society of Kansei Engineering
雑誌
International Journal of Affective Engineering (ISSN:21875413)
巻号頁・発行日
pp.IJAE-D-22-00011, (Released:2022-12-13)
参考文献数
76

Recognizing facial expressions and estimating their corresponding action units’ intensities have achieved many milestones. However, such estimating is still challenging due to subtle action units’ variations during emotional arousal. The latest approaches are confined to the probabilistic models’ characteristics that model action units’ relationships. Considering ordinal relationships across an emotional transition sequence, we propose two metric learning approaches with self-attention-based triplet and Siamese networks to estimate emotional intensities. Our emotion expert branches use shifted-window SWIN-transformer which restricts self-attention computation to adjacent windows while also allowing for cross-window connection. This offers flexible modeling at various scales of action units with high performance. We evaluated our network’s spatial and time-based feature localization on CK+, KDEF-dyn, AFEW, SAMM, and CASME-II datasets. They outperform deep learning state-of-the-art methods in micro-expression detection on the latter two datasets with 2.4% and 2.6% UAR respectively. Ablation studies highlight the strength of our design with a thorough analysis.

言及状況

外部データベース (DOI)

Twitter (5 users, 5 posts, 2 favorites)

Ridge-iのリサーチエンジニアの論文がIJAEに採択されました。顔の表情の笑いや怒りを数値化する研究です。 The paper of Ridge-i's research engineer was accepted by IJAE. It's a study of facial expression intensity estimation like smile and anger. https://t.co/agrJR45cnk #Ridgei
弊社のリサーチエンジニアの論文がIJAEに採択されました Estimating #emotions intensity is key to #human-computer interaction. Our multipath #Transformer design exploited ordinal relationships across emotional arousal. #AI #ml #ridgei #innovative #tech https://t.co/RgDhN9kBmH

収集済み URL リスト