FG-2020 Workshop "Affect Recognition in-the-wild: Uni/Multi-Modal Analysis & VA-AU-Expression Challenges"


Latest News

The Workshop: Affect Recognition in-the-wild: Uni/Multi-Modal Analysis & VA-AU-Expression Challenges, will be held in conjunction with the IEEE International Conference on Automatic Face and Gesture Recognition (FG) 2020, in Buenos Aires, Argentina, 18-22 May 2020.


For any requests or enquiries, please contact: dimitrios.kollias15@imperial.ac.uk 




Stefanos Zafeiriou, Imperial College London, UK                                s.zafeiriou@imperial.ac.uk

Dimitrios Kollias, Imperial College London, UK                                   dimitrios.kollias15@imperial.ac.uk          

Attila Schulc,  Realeyes  - Emotional Intelligence                                attila.schulc@realeyesit.com   



This workshop aims at advancing the state-of-the-art in the problem of analysis of human affective behavior in-the-wild. Representing human emotions has been a basic topic of research. The most frequently used emotion representation is the categorical one, including the seven basic categories, i.e., Anger, Disgust, Fear, Happiness, Sadness, Surprise and Neutral. Discrete emotion representation can also be described in terms of the Facial Action Coding System model, in which all possible facial actions are described in terms of Action Units (AUs). Finally, the dimensional model of affect has been proposed as a means to distinguish between subtly different displays of affect and encode small changes in the intensity of each emotion on a continuous scale. The 2-D Valence and Arousal Space (VA-Space) is the most usual dimensional emotion representation; valence shows how positive or negative an emotional state is, whilst arousal shows how passive or active it is.

The workshop is composed of the following: At first, it contains three Challenges, which are based, for the first time, on the same database; these target (i) dimensional affect recognition (in terms of valence and arousal), (ii) categorical affect classification (in terms of the seven basic emotions) and (iii) facial action unit detection, in -the-wild. These Challenges will produce a significant step forward when compared to previous events. In particular, they use the Aff-Wild2, the first comprehensive benchmark for all three affect recognition tasks in-the-wild. In addition, the Workshop does not only focus on the three Challenges. It will solicit any original paper on databases, benchmarks and technical contributions related to affect recognition, using audio, visual or other modalities (e.g., EEG), in unconstrained conditions. Either uni-modal, or multi-modal approaches will be considered. It would be of particular interest to see methodologies that study detection of action units based on audio data.


Call for participation: 

In summary, the proposed Workshop on affect recognition:

  •  includes 3 Challenges on:
         i) Valence-Arousal estimation,
         ii) Action Unit detection and
         iii) 7 Basic Expression classification;
  • welcomes contributions in the following topics:
       (a) databases for spontaneous and naturalistic:
               i) facial expression or micro-expression analysis, or
               ii) facial action unit detection, or
              iii) valence-arousal estimation, ”in the-wild”.
       (b) methodologies for:
               i) facial expression or micro-expression analysis, or
               ii) facial action unit detection, or
              iii) valence-arousal estimation, ”in the wild”;
     The methodologies can use uni-modal or multi-modal information (e.g., visual, audio data, hand and body gestures, EEG, EDA)
       (c) methodologies for action unit prediction from audio (e.g., using Aff-Wild2, which is an audiovisual database)
       (d) domain-adaptation techniques for the above described behavior tasks (either using Aff-Wild2, or any other database, or combination of databases).


Accepted workshop papers will appear at IEEE FG 2020 proceedings.


Important Dates: 

  • Paper Submission Deadline:              
    17 February, 2020
  • Review decisions sent to authors; Notification of acceptance:
    26 February, 2020
  • Camera ready version:
    4 February, 2020




Sumbission Information


The paper format should adhere to the paper submission guidelines for FG2020. Please have a look at the: Instructions of paper submission for review

 The submission process will be handled through the CMT.


Keynote Speakers

Aleix M. Martinez

Aleix M. Martinez is a Professor in the Department of Electrical and Computer Engineering at The Ohio State University (OSU), where he is the founder and director of the the Computational Biology and Cognitive Science Lab. He is also affiliated with the Department of Biomedical Engineering and to the Center for Cognitive Science where he is a member of the executive committee. Prior to joining OSU, he was affiliated with the Electrical and Computer Engineering Department at Purdue University and with the Sony Computer Science Lab. He has served as an associate editor of IEEE Transactions on Pattern Analysis and Machine Intelligence, IEEE Transaction on Affective Computing, Computer Vision and Image Understanding, and Image and Vision Computing. He has been an area chair for many top conferences and was Program Chair for CVPR 2014 in his hometown, Columbus, OH. He is also a member of the Cognition and Perception study section at NIH and has served as reviewer for numerous NSF, NIH as well as other national and international funding agencies. Dr. Martinez is the recepient of numerous awards, including best paper awards at ECCV and CVPR, Lumely Research Award, and a Google Faculty Research Award. Dr. Martinez research has been covered by numerous national media outlets, including CNN, The Huffington Post, Time Magazine, CBS News and NPR, as well as intrernational outets, including The Guardian, Spiegel, El Pais and Le Monde. 



Pablo Barros

Pablo Barros is currently working as a research scientist at the Italian Institute of Technology in Genova,Italy. His main focus is on the development of deep and self-organizing neural networks for different aspects of emotional appraisal and display in social robots. Prior to that, he was a Post-Doctoral Research Associate in the TRR Crossmodal Learning Project at the Knowledge Technology research group at the University of Hamburg, Germany. He has also been a Vising Professor in the University of Pernambuco - UPE. He holds a Bachelor's degree in Information Systems from the Federal Rural University of Pernambuco - UFRPE and a Master's in Computer Engineering from the University of Pernambuco - UPE and a PhD in Computer Science from the University of Hamburg, Germany. He worked on projects involving computing and affective robotics, assistive computing, artificial neural networks and computational intelligence. He has organized many very successful workshops in top conferences, such as IEEE FG, IEEE/RSJ IROS,  IEEE WCCI, IEEE ICDL-EPIROB. Additionally he was a Chair in two Competitions held in conjunction with  IEEE FG and IEE WCCI/IJCNN 2018. He has organized special issues in journals, such as Frontiers in Neurorobotics, IEEE Transactions on Affective Computing and Elsevier Cognitive Systems Research.


The 'Affect Recognition in-the-wild: Uni/Multi-Modal Analysis & VA-AU-Expression Challenge' Workshop has been generously supported by: 
Imperial College London
Realeyes - Emotional Intelligence