• Login
  • Register

Work for a Member company and need a Member Portal account? Register here with your company email address.

Publication

Personalized Automatic Estimation of Self-Reported Pain Intensity from Facial Expressions

Aug. 24, 2017

People
Groups

D. L. Martinez, O. Rudovic and R. Picard, "Personalized Automatic Estimation of Self-Reported Pain Intensity from Facial Expressions," 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA, 2017, pp. 2318-2327, doi: 10.1109/CVPRW.2017.286. keywords: {Pain;Estimation;Face;Recurrent neural networks;Hidden Markov models;Image sequences;Reliability},

Abstract

Pain is a personal, subjective experience that is commonly evaluated through visual analog scales (VAS). While this is often convenient and useful, automatic pain detection systems can reduce pain score acquisition efforts in large-scale studies by estimating it directly from the partictipants' facial expressions. In this paper, we propose a novel two-stage learning approach for VAS estimation: first, our algorithm employs Recurrent Neural Networks (RNNs) to automatically estimate Prkachin and Solomon Pain Intensity (PSPI) levels from face images. The estimated scores are then fed into the personalized Hidden Conditional Random Fields (HCRFs), used to estimate the VAS, provided by each person. Personalization of the model is performed using a newly introduced facial expressiveness score, unique for each person. To the best of our knowledge, this is the first approach to automatically estimate VAS from face images. We show the benefits of the proposed personalized over traditional non-personalized approach on a benchmark dataset for pain analysis from face images. 

via IEEE Explore
Related Content
Publication Research

Physiological and behavioral profiling for nociceptive pain estimation using personalized multitask learning

Lopez-Martinez, D., Rudovic, O., Picard, R. "Physiological and behavioral profiling for nociceptive pain estimation using personalized multitask learning," NIPS Workshop on Machine Learning for Healthcare, Long Beach, CA, December 2017.
Publication Research

GIFGIF+: Collecting emotional animated GIFs with clustered multi-task learning

Chen, Weixuan & Rudovic, Ognjen & Picard, Rosalind. (2017). GIFGIF+: Collecting emotional animated GIFs with clustered multi-task learning. 410-417. 10.1109/ACII.2017.8273647.
Publication Research

DeepFaceLIFT: Interpretable Personalized Models for Automatic Estimation of Self-Reported Pain

Liu, Dianbo & Peng, Fengjiao & Shea, Andrew & Ognjen, & Rudovic, Ognjen & Picard, Rosalind. (2017). DeepFaceLIFT: Interpretable Personalized Models for Automatic Estimation of Self-Reported Pain.
Publication Research

Deep Reinforcement Learning for Optimal Critical Care Pain Management with Morphine using Dueling Double-Deep Q Networks

Lopez-Martinez D, Eschenfeldt P, Ostvar S, Ingram M, Hur C, Picard R. Deep Reinforcement Learning for Optimal Critical Care Pain Management with Morphine using Dueling Double-Deep Q Networks. Annu Int Conf IEEE Eng Med Biol Soc. 2019 Jul;2019:3960-3963. doi: 10.1109/EMBC.2019.8857295. PMID: 31946739.