110. LOMO: LOCAL ORDINAL MODEL FOR FACIAL ANALYSIS IN VIDEOS

Department: Electrical & Computer Engineering
Research Institute Affiliation: California Institute for Telecommunications and Information Technology (Calit2)
Faculty Advisor(s): Truong Nguyen | Marian Bartlett

Primary Student
Name: Karan Sikka
Email: ksikka@ucsd.edu
Phone: 858-534-0000
Grad Year: 2018

Abstract
We study the problem of facial analysis in videos. We propose a novel weakly supervised learning method that models the video event (expression, pain etc.) as a sequence of automatically mined, discriminative sub-events (e.g. onset and offset phase for smile, brow lower and cheek raise for pain). The proposed model is inspired by the recent works on Multiple Instance Learning and latent SVM/HCRF- it extends such frameworks to model the ordinal or temporal aspect in the videos, approximately. We obtain consistent improvements over relevant competitive baselines on four challenging and publicly available video based facial analysis datasets for prediction of expression, clinical pain and intent in dyadic conversations. In combination with complimentary features, we report state-of-the-art results on these datasets.

« Back to Posters or Search Results


Contact:   researchexpo@soe.ucsd.edu   (858) 534-6068