Robust Representation and Recognition of Facial Emotions Using Extreme Sparse Learning

   December 11, 2017    Comments Off on Robust Representation and Recognition of Facial Emotions Using Extreme Sparse Learning    Posted in: IEEE 2017, MATLAB

Robust Representation and Recognition of Facial Emotions Using Extreme Sparse Learning

ABSTRACT:

Recognition of natural emotions from human faces is an interesting topic with a wide range of potential applications, such as human-computer interaction, automated tutoring systems, image and video retrieval, smart environments, and driver warning systems. Traditionally, facial emotion recognition systems have been evaluated on laboratory controlled data, which is not representative of the environment faced in real-world applications. To robustly recognize the facial emotions in real-world natural situations, this paper proposes an approach called extreme sparse learning, which has the ability to jointly learn a dictionary (set of basis) and a nonlinear classification model. The proposed approach combines the discriminative power of extreme learning machine with the reconstruction property of sparse representation to enable accurate classification when presented with noisy signals and imperfect data recorded in natural settings. In addition, this paper presents a new local spatio-temporal descriptor that is distinctive and pose-invariant. The proposed framework is able to achieve the state-of-the-art recognition accuracy on both acted and spontaneous facial emotion databases.

 

EXISTING SYSTEM:

  • Techniques that exploit the dynamics of facial emotion include hidden Markov models, dynamic Bayesian networks, geometrical displacement, and dynamic texture descriptors.
  • Recently, several methods have been developed to train a classification oriented dictionary.
  • These methods can be divided into three broad categories.
  • The first category of methods directly forces the dictionary atoms to be discriminative and uses the reconstruction error for the final classification.
  • The second approach makes the sparse coefficients discriminative by incorporating the classification error term into the dictionary learning and indirectly propagates the discrimination power to the overall dictionary.
  • The third category includes methods that apply the discriminative criterion for coefficients, but the classifier is not necessarily trained along with DL.

 

DISADVANTAGES OF EXISTING SYSTEM:

  • To the best of our knowledge, none of the existing methods can learn a non-linear classifier in the context of simultaneous sparse coding and classifier training. Learning such a non-linear classifier is not only an interesting research topic, but also very important in many real-world applications where the observations are not probably linearly separable.

PROPOSED SYSTEM:

  • The objective of the present work is to develop a facial emotion recognition system that is capable of handling variations in facial pose, illumination, and partial occlusion.
  • The proposed system robustly represents the facial emotions using a novel spatio-temporal descriptor based on Optical Flow (OF), which is distinctive and pose-invariant. Robustness to pose variations is achieved by extracting features that depend only on relative movements of different facial regions.
  • To recognize the emotions in the presence of self-occlusion and illumination variations, we combine the idea of sparse representation with Extreme Learning Machine (ELM) to learn a powerful classifier that can handle noisy and imperfect data.

 

ADVANTAGES OF PROPOSED SYSTEM:

  • To the best of our knowledge, this is the first attempt in the literature to simultaneously learn the sparse representation of the signal and train a non-linear classifier based on sparse codes.
  • A pose-invariant OF-based spatio-temporal descriptor, which is able to robustly represent facial emotions even when there are head movements while expressing an emotion. The proposed descriptor is capable of characterizing both the intensity and dynamics of facial emotions.
  • This paper is the first research work that explores how to simultaneously learn the sparse representation of the signal and train a non-linear classifier to be discriminative for sparse codes.
  • Our results clearly demonstrate the robustness of the proposed emotion recognition system, especially in challenging scenarios that involve illumination changes, occlusion, and pose variations

 

 

 

SYSTEM ARCHITECTURE:

SYSTEM REQUIREMENTS:

HARDWARE REQUIREMENTS:

 

  • System : Pentium IV 2.4 GHz.
  • Hard Disk : 40 GB.
  • Floppy Drive : 44 Mb.
  • Monitor :         15 VGA Colour.
  • Mouse :
  • Ram : 512 Mb.

 

SOFTWARE REQUIREMENTS:

 

  • Operating system : Windows XP/7.
  • Coding Language : MATLAB
  • Tool : MATLAB R2013A

 

REFERENCE:

Seyedehsamaneh Shojaeilangari, Wei-Yun Yau, Senior Member, IEEE, Karthik Nandakumar, Member, IEEE, Jun Li, and Eam Khwang Teoh, Member, IEEE, “Robust Representation and Recognition of Facial Emotions Using Extreme Sparse Learning”, IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 24, NO. 7, JULY 2015.

  

Comments are closed.