Activities

Filters

Display:

Past activities:

Academic Positions

  • Chair Professor of Affective and Behavioral Computing at Imperial College London

  • Apr 2006

    Head of the i·bug group at Imperial College London

    Group website
  • Apr 2020

    AI Scientific Research Lead, FACEBOOK, London

Past Activities

  • Apr 2018 - May 2020

    Research Director, SAMSUNG AI Research Centre, Cambridge

    website
  • Apr 2007 - Apr 2018

    Coordinator of Imperial College London Distinguished Seminar Series in Computing

    Website
  • Nov 2006 - Oct 2017

    Part-time Professor of Affective and Behavioral Computing at the University of Twente

    Human-Media Interaction Group
  • Jun 2005 - Aug 2005

    Visiting Associate Professor Face Group, Robotics Institute, Carnegie Mellon University, USA

    Face Group
  • Jan 2005 - Apr 2006

    Associate Professor Human-Machine Interaction, EEMCS, Delft University of Technology, NL

  • Oct 2001 - Jan 2005

    Assistant Professor Human-Machine Interaction, EEMCS, Delft University of Technology, NL

Awards

  • Nov 2019

    Fellow of Royal Academy of Engineering for contribution to research and development in Human-Centric AI

    Royal Academy list of Fellows
  • Oct 2018

    10-year Technical Impact Award IEEE Int'l Conf Multimodal Interfaces 2018, for work with Z. Zeng, G. Roisman & T. Huang contributed to ICMI'07

    paper
  • Oct 2017

    Best Paper Award IEEE Trans. Affective Computing 2016-2017, for the work with Mohammad Soleymani and Yun Fu

    paper
  • Jul 2016

    IAPR Fellow for contribution to affective and behavioural computing

  • Jan 2012

    IEEE Fellow for contribution to automatic human behavior understanding and affective computing

    IEEE Fellows Class 2012
  • Nov 2011

    The BCS Roger Needham Award made annually to an UK based researcher for a distinguished research contribution in computer science within ten years of their PhD.

    BCS
  • Mar 2011

    Best Paper Award IEEE Int’l Conf. Automatic Face and Gesture 2011, for the work with Mihalis Nicolaou and Hatice Gunes

    Paper
  • Sep 2009

    Best Demo Award ACII 2009, for “A Demonstration of Audiovisual Sensitive Artificial Listeners”

    FP7 EC Semaine project more info
  • Jun 2008

    Best Student Paper Award IEEE Int’l Conf. Automatic Face and Gesture 2008, for the work with Sander Koelstra

    Paper, Sander Koelstra's website
  • Jan 2008

    ERC StG Fellowship awarded to 2% best junior scientists in any research field in Europe in 2007

    MAHNOB grant at ERC
  • Dec 2007

    SGAI Machine Intelligence Award 2007 for the best live demonstration of AI software, a demo of automatic facial emotion recognizer and an emotionally-biased automatic painting tool

    More information, Imperial College Press release
  • Jan 2007

    Best Paper Award Int’l Conf. Computer Vision 2007, Workshop on HCI, for the work with Michel Valstar

    Paper, Michel Valstar's website
  • Jan 2002

    Dutch Research Council Junior Fellowship (NWO-VENI) awarded annually 7 best young scientists in exact sciences in the Netherlands

    NWO VENI website

Projects

  • Feb 2016 - Jan 2020

    EU H2020 DE-ENIGMA HRI for expending social imagination in autistic kids

    Project website
  • Jan 2016 - Jan 2021

    EPSRC FACER2VM Face Matching for Identity Recognition (Program Grant)

    Project Website

Past Activities

  • Feb 2015 - Jul 2018

    EU H2020 SEWA Automatic Sentiment Analysis in the Wild

    Project website
  • Dec 2013 - Nov 2016

    EC FP7 TERESA Telepresence Reinforcement-learning Social Agent

    Project website
  • Mar 2013 - Feb 2017

    EPSRC 4D-FAB Automatic analysis of facial behaviour in 4D

    more info
  • Oct 2011 - Sep 2014

    EC FP7 FROG Fun Robotic Outdoor Guide

    Project website
  • May 2010 - Apr 2014

    EPSRC E-Pain Pain Rehabilitation: E/Motion-based automated coaching

    Project website
  • Feb 2009 - Jan 2014

    EC FP7 SSPNet Social Signal Processing Network of Excellence

    Project website
  • Sep 2008 - Aug 2013

    ERC Starting Grant MAHNOB Multimodal Analysis of Human Nonverbal Behaviour in Real-World Settings

    Project website
  • Jan 2008 - Dec 2010

    EC FP7 SEMAINE Sustained Emotionally coloured Machine-human Interaction using Nonverbal Expression

    Project website
  • Oct 2004 - Mar 2006

    Dutch BSIC MultimediaN - Project 2 Context-aware Multimodal Interaction

  • Feb 2003 - Jan 2006

    Dutch NWO VENI - FIFAI Facial Information For Advanced Interaction

Editorships

  • Associate Editor IEEE Transactions Pattern Analysis and Machine Intelligence

    Journal website
  • Associate Editor IEEE Transactions on Affective Computing

    Journal website

Past Activities

  • Jan 2006 - Jan 2019

    Editor-in-Chief Image and Vision Computing Journal

    Journal website
  • Aug 2012

    Guest Editor IEEE Transaction Systems, Man and Cybernetics - Part B, Special Issue on Facial Expression Recognition Challenge

    Journal website
  • May 2010

    Guest Editor Image and Vision Computing Journal, Special Issue on The Best of FG 2008

    Journal website
  • Dec 2009

    Guest Editor Image and Vision Computing Journal, Special Issue on Visual and multimodal analysis of human spontaneous behaviour

    Journal website, vol. 27, no. 12, 2009
  • Jan 2009

    Guest Editor IEEE Trans. Systems, Man, and Cybernetics – Part B, Special Issue on Human Computing

    Journal website, vol. 39, no. 1, 2009
  • Apr 2008

    Guest Editor Int’l Journal of Image and Video Processing, Special Issue on Anthropocentric Video Analysis: Tools and Applications (vol 2008–si.2)

    Journal website
  • Jul 2007

    Guest Editor Lecture Notes on Artificial Intelligence,Special Volume on AI for Human Computing

    Special volume, Journal website
  • Apr 2004 - Dec 2014

    Associate Editor IEEE Transactions Systems, Man, and Cybernetics – Part B

    Journal website
  • Jan 2011 - Dec 2011

    Associate Editor IEEE Transactions on Multimedia

    Journal website
  • Jan 2008 - Dec 2009

    Associate Editor Computer Journal

  • Jun 2006 - May 2009

    Associate Editor Image and Vision Computing Journal

    Journal website

Boards & Committees

  • IEEE Fellows Evaluation Committee IEEE Computer Society, 2012-2014, 2016, 2019-2020

    IEEE Fellows
  • Program Committee Member IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR)

  • Program Committee Member Int'l Conf. Computer Vision (ICCV)

  • Program Committee Member European Conf. Computer Vision (ECCV)

  • Program Committee Member ACM Int'l Conf. Multimedia (ACM MM)

Past Activities

Chairs & Conference Organisation

Past Activities

Talks & Seminars

Past Activities

  • Nov 2018

    Invited Speaker & Panelist Guardian Live Event -- The class of 2025: what's next for UK universities?

    Guardian article about the event
  • Oct 2018

    Invited Speaker & Panelist Royal Society of Biology event: Can Artificial Intelligence save the world?

    event website
  • Oct 2018

    Invited Speaker & Panelist New Scientist event - Instant Expert: Artificial Intelligence

    event website
  • Sep 2018

    Invited Speaker & Panelist The Economist Innovation Summit 2018, London UK

    event website
  • Sep 2018

    Keynote Speaker Financial Times Weekend Festival 2018, London, UK

    event webste
  • Jun 2018

    Keynote Speaker French Conference on Pattern Recognition and Artificial Intelligence (RFIAP'18)

    conference website
  • Jan 2018

    Invited Speaker & Panelist Imperial College event: Ethics of AI, London, UK

    event website, event recording (starts at about 10' in the recording)
  • Jan 2018

    Invited Speaker & Panelist Guardian Live Event: The Future of Work

    event website
  • Nov 2017

    Invited Speaker & Panelist London School of Economics event: AI, algorithms and ethics, London, UK

  • Nov 2017

    Invited Speaker & Panelist Guardian's panel @ Huddle 2017 : Loving Robots - Will AI kill off human relationships?, London, UK

    event website
  • Jul 2017

    Invited Speaker & Panelist Science Museum & Royal Society event: When will Robots Outsmart us, London, UK

    event website
  • Jul 2017

    Keynote Speaker Financial Times China & Chinese Government event: China Premier Artificial Intelligence Conference 2017, Shanghai, China

    event website
  • May 2017

    Keynote Speaker Int'l Conf. Pervasive Computing Technologies for Healthcare 2017, Barcelona, Spain

    conference website
  • Apr 2017

    Invited Speaker & Panelist AI & Machine Learning in Health: The Future

    event website
  • Apr 2017

    Invited Speaker & Panelist Collider Science -- Science Question Time: "Breaking Down The Walls: New Ideas For The Future"

    event website
  • Apr 2017

    Keynote Speaker Int'l Conf. Intelligent Systems and Computer Vision (ISCV'17), Fez, Morocco

    conference website
  • Mar 2017

    Invited Speaker & Panelist Guardian Live event: How will AI change our world?

    event website
  • Mar 2017

    Invited Speaker & Panelist British Academy Event: Does AI pose a threat to the society?

    event website
  • Dec 2016

    Keynote Speaker Int'l Conf. Image Processing Theory, Tools and Applications (IPTA'16), Oulu, Finland

    conference website
  • Nov 2016

    Invited Speaker Global Innovation Summit 2017, London, UK

    summit website
  • Nov 2016

    Keynote Speaker Science Festival: State of Emotion, Berlin, Germany

    event website,, talk
  • Sep 2016

    Keynote Speaker European Commission's Digital Assembly 2016, Bratislava, SK

    event website,, talk
  • Jul 2016

    Invited Speaker & Panelist Royal Society Event: Driverless Cars, London, UK

    event website
  • Jul 2016

    Invited Speaker Royal Society Summer Science Exhibition 2016, London, UK

    event website
  • Apr 2016

    Invited Speaker & Panelist Royal Society Event: Learning Machines & How Computers Got Smart, London, UK

    (talk: 26:20 to 37:20; discussion: 37:20 to 1:30:00)
  • Jan 2016

    Invited Speaker World Economic Forum, Annual Meeting 2016, Davos, Switzerland

    (Nature Magazine's Ideas Lab talk)
  • Nov 2015

    Keynote Speaker Asian Conf. Pattern Recognition (ACPR'15), Kuala Lumpur, Malaysia

    conference website (slides)
  • Oct 2015

    Invited Speaker RI Seminar Series, Carnegie Mellon University, Pittsburgh, USA

    event website
  • Oct 2015

    Keynote Speaker BMVA Event on The Computational Face, London, UK

    event website
  • Sep 2015

    Keynote Speaker Chinese Conf. Computer Vision (CCCV'15), Xi'an, China

    conference website (slides)
  • Sep 2015

    Keynote Speaker Int'l Conf. Affective Computing and Intelligent Interfaces 2015 (ACII'15), Xi'an, China

    Conference website
  • Sep 2015

    Keynote Speaker European Conf. Mobile Robotics (ECMR'15), Lincoln, UK

    Conference website
  • Jul 2015

    Keynote Speaker IEEE Int'l Conf. Multimedia & Expo 2015 (ICME'15), Turin, Italy

    Conference website
  • Mar 2015

    Invited Speaker & Panelist Royal Academy Spring Symposium 2015, London, UK

    Symposium website
  • Oct 2014

    Keynote Speaker Biometrics 2014, London, UK

    Conference website
  • Mar 2014

    Keynote Speaker ACM / IEEE Int'l Conf. Human-Robot Interaction 2014 (HRI'14), Bielefeld, Germany

    Conference website
  • Jul 2013

    Keynote Speaker Int'l Conf. Information Visualisation 2013 (iV'13), London, UK

    Conference website
  • Jun 2013

    Keynote Speaker Scandinavian Conference on Image Analysis 2013 (SCIA'13), Espoo, Finland

    Conference website
  • Sep 2012

    Keynote Speaker IEEE Int'l Conf. Biometrics 2012 (BTAS'12), Washington, USA

    Conference website
  • Sep 2012

    Keynote Speaker Int'l Conf. Knowledge-Based Intelligent Information & Systems 2012 (KES'12), San Sebastian, Spain

    Conference website
  • Aug 2012

    Keynote Speaker Int'l Conf Measuring Behaviour 2012 (MB'12), Utrecht, The Netherlands

    Conference website
  • May 2012

    Keynote Speaker Royal Society of Edinburgh: Celebrating 100 Years Since the Birth of Alan Turing, Edinburgh, UK

    T100 website, YouTube link to the recording of the talk
  • Nov 2011

    Roger Needham Award Lecture Royal Society, London, UK

    BCS
  • Apr 2009

    Invited Speaker Royal Society event on Computation of Emotions in Man and Machines, London, UK

    Event website
  • Sep 2008

    Keynote Speaker 5th Joint Workshop on Machine Learning and Multimodal Interaction 2008 (MLMI'08), Utrecht, Netherlands

    Workshop website
  • Jul 2008

    Keynote Speaker Int’l Conf. Articulated Motion & Deformable Objects 2008 (AMDO'08), Mallorca, Spain

    Conference website
  • Jun 2008

    Keynote Speaker Annual Symposium of the German Association for Pattern Recognition 2008 (DAGM'08), Munich, Germany

  • Jun 2006

    Keynote Speaker IFIP Conf. Artificial Intelligence Applications & Innovations 2006 (AIAI'06), Athens, Greece

    Conference website

Media Coverage

  • Oct 2019

    Article Evening Standard, 31 October 2019, “Meet the professor in charge of predicting the future of tech”

    article
  • Oct 2019

    Article Guardian, 5 October 2019, "We are hurtling towards a surveillance state: the rise of facial recognition technology"

    article
  • Oct 2019

    Article Evening Standard, 3 October 2019, “London's most influential people 2019 – Technology: Engineering”

    article
  • Sep 2019

    Article Evening Standard, 5 September 2019, “London scientists go to war with software that beat deepfake hoaxers”

    article
  • Aug 2019

    Article The Observer, 4 August 2019, "Facial recognition… coming to a supermarket near you"

    article
  • May 2019

    Article The Telegraph, 30 May 2019, "The British companies pioneering AI that reads your emotions"

    article
  • Dec 2018

    Financial Times podcast "What robots can teach humans"

    listen online
  • Dec 2018

    Article Wall Street Journal, 11 December 2018, "Biometrics, the Next Step in Authentication, Eases Into the Workplace"

    article

Past Activities

  • Nov 2018

    Wired podcast “Businesses need to understand AI before putting it to work”

    listen online
  • Nov 2018

    Article Guardian, 16 November 2018, "UK Government urged to halt academic brain drain to tech firms"

    article
  • Nov 2018

    Article Evening Standard, 2 November 2018, "Robot who mimics Donald teaches autistic children to express emotions"

    article
  • Apr 2018

    Radio Program BBC World "The Why Factor" -- 2 April 2018, interview on Machines and Morals

    Listen online
  • Jan 2018

    Radio Program BBC 4 "Woman's Hour", 17 January 2018 -- interview on robotics and gender gap in AI

    Listen online
  • Jan 2018

    Radio Program Voice To America, 7 January 2018 -- interview on Big Tech Companies and GDPR regulations in UK

    Listen online
  • Dec 2017

    Article The Times, 1 December 2017, "Facebook develops facial recognition cameras that feed shop staff their customers' profile details"

    article
  • Nov 2017

    Article Evening Standard, 30 November 2017, "Facebook to scan faces in shops to find out your mood and what to sell you"

    article
  • Nov 2017

    Article Guardian, 1 November 2017, "Big tech firms' AI hiring frenzy leads to brain drain at UK universities"

    article
  • Nov 2017

    Article Guardian, 1 November 2017, "We can't compete: why universities are losing their best AI scientists"

    article
  • Nov 2017

    Article Guardian, 1 November 2017, "Artificial intelligence risks GM-style public backlash, experts warn"

    article
  • Jul 2017

    TV Program Channel 4, "Old People's Home for 4 Years Olds", on automatic recognition of depression, July 2017

    Watch online
  • Jun 2017

    Article CityA.M., 21 June 2107, "Calling all women: London’s thriving tech sector needs you"

    article
  • Mar 2017

    TV Program Korean Arirang TV, 26 March 2017 -- interview on Face Technology and Future AI

    Footage-ling (relevant: 28'00" - 33'00")
  • Feb 2017

    TV Program ITV News, 17 February 2017 -- interview on our work on TERESA EU project

    Footage
  • Feb 2017

    TV Program ITV News, 16 February 2017 -- interview on our work on De-Enigma EU project

    Footage
  • Dec 2016

    TV Program ITV News, 21 December 2016 -- interview on AI@Home technology

    Footage
  • Nov 2016

    TV Program UNI Global Union TV, "The Future World of Work"

    Footage
  • Oct 2016

    TV Program CBS 60 minutes, "Artificial intelligence positioned to be a game-changer", 9 October 2016

    Footage-long (relevant: 17'10" - 19'30")
  • Jul 2016

    TV Program BBC World News, 1 July 2016 -- interview on driverless car technology

    Footage
  • Feb 2016

    TV program "Lessons from Davos", FRANCE24 "People & Profit" TV program, 1 February 2016

    Footage-long (relevant: 6'23" - 9'30")
  • Jan 2016

    TV program "Oko (Eye)", Serbian RTS (RTS Channel 1), 22 January 2016

    Footage-long (relevant: 5'20" -13'18")
  • May 2010

    Article Times Higher Education, 27 May 2010, p. 16, "Odds and Quads"

    article
  • Jun 2009

    Article New Scientist, Issue 2715, 4 July 2009, pp. 34-37, "Emotional robots: Will we love them or hate them?"

    article
  • May 2009

    TV Program "Hoe?Zo!", Netherlands Teleac/NOT TV Station (NL Channel 1), 30 jun 2009 and 25 August 2009

    Footage-short, Footage-long
  • Apr 2009

    Radio Program "Science in Action", Science Radio Show, BBC World Radio, 24 April 2009

    Listen online
  • May 2006

    Article Popular science magazine 'Informatie' (Dutch), "Hoe de Computer een glimlach kan waarnemen"

    Magazine website, Article abstract Full article
  • Mar 2006

    TV Program "Het Klokhuis", Netherlands Channel 3

    Footage