Dr. Mohammad Soleymani
Past Member
Ambizione Fellow, CISA, University of Geneva
Biography
I am now at University of Geneva. I am awarded the Swiss National Science Foundation Ambizione senior fellowship to be hosted at the University of Geneva.
Mohammad Soleymani received his PhD in computer science from the University of Geneva, Switzerland in 2011. In collaboration with Swiss Center of Affective Sciences, he spent 5 years working on assessing emotional reactions in response to videos, and emotional analysis of movie scenes. He was a Marie Curie Fellow at the intelligent Behaviour Understanding Group (iBUG) at Imperial College London, where he conducted research on sensor-based and implicit emotional tagging. His research interests include affective computing, multimedia information retrieval, and multimodal interactions. He is one of the founding organizers of the MediaEval benchmarking campaign. He is also one of the organizers of the International Workshop on Affective Analysis in Multimedia. He has served as an organizer for special sessions on multimedia tagging at ACM ICMR 2011 and IEEE SMC 2012 and as a program committee member and reviewer for multiple conferences and workshops including ACM MM, ACM ICMI, IEEE SMC, and IEEE Multimedia and Expo. He is a member of IEEE and the Humaine association.
Community service and recent activities
Editorship:
- Guest editor for the special Issue on Advances in Affective Analysis in Multimedia, IEEE Transaction on Affective Computing (TAC) (call for papers).
- Guest editor for the special issue on the best of ACII 2013 in Intractions, Journal on Multimodal User Interfaces, Springer.
Organization:
- MediaEval multimedia benchmarking since 2010
- Member of organization committee and the publication chair for ACII 2013.
- Co-organizer of International Workshop on Affective Analysis in Multimedia (AAM), ICME 2013, San Jose, US.
Occasional reviewer for: IEEE Trans. Multimedia, In.t Journal of Human-Computer Studies, Image and Vision Computing, IEEE Trans. Affective Computing, IEEE Trans. Systems, Man and Cybernetics–Part B, IEEE Trans. Human Machine Systems, ACM TOMCCAP, Neurocomputing, Artificial Intelligence in Medicine, Int'l Journal of Synthetic Emotions, User Modeling and User-Adapted Interaction, PLOS One, IEEE Trans. Selected topics in signal processing, EURASIP Journal on Image and Video Processing.
PC memberships: IEEE ICME 2014,CrowdRec'13, CowdWork Workshop, 2013, Workshop on Social Behaviour Analysis (SBA-2013), ACM MM'13, IEEE SMC 2012&13, Wokrshop on Emotions and Personality in Personalized Services, UMAP, 2013, IEEE ICME 2013, AMC MM Sys'13, Workshop on Social Media for Human Computation (SOHuman) , 2012 & 2013, Workshop on Personalized Access to Cultural Heritage (PATCH 2012), ACM MM'12,Workshop on Crowdsourcing for Multimedia, ACM MM'12, Workshop on Social Media for Human Computation,IEEE Social Com., 2012.
Emotional Databases
- Emotion in Music database
- MAHNOB HCI Implicit tagging database
- DEAP -- A database for emotion analysis using EEG, physiological signals and video
- Violent scenes in movies (Mediaeval 2011 and 2012)
Publications
Journal articles
A survey of multimodal sentiment analysis
M. Soleymani, D. Garcia, B. Jou, B. Schuller, S. Chang, M. Pantic. Image and Vision Computing. 2017.
author = {M. Soleymani and D. Garcia and B. Jou and B. Schuller and S. Chang and M. Pantic},
journal = {Image and Vision Computing},
title = {A survey of multimodal sentiment analysis},
url = {http://www.sciencedirect.com/science/article/pii/S0262885617301191},
year = {2017},
}
Analysis of EEG signals and facial expressions for continuous emotion detection
M. Soleymani, S. Asghari-esfeden, Y. Fu, M. Pantic. IEEE Transactions on Affective Computing. 7(1): pp. 17 - 28, 2016.
author = {M. Soleymani and S. Asghari-esfeden and Y. Fu and M. Pantic},
pages = {17--28},
journal = {IEEE Transactions on Affective Computing},
number = {1},
publisher = {IEEE},
title = {Analysis of EEG signals and facial expressions for continuous emotion detection},
volume = {7},
year = {2016},
}
The Community and the Crowd: Multimedia Benchmark Dataset Development
M. Larson, M. Soleymani, M. Eskevich , P. Serdyukov , R. Ordelman , G. Jones. IEEE Multimedia. 19(3): pp. 15 - 23, July 2012.
author = {M. Larson and M. Soleymani and M. Eskevich and P. Serdyukov and R. Ordelman and G. Jones},
pages = {15--23},
institution = {IEEE},
journal = {IEEE Multimedia},
month = {July},
number = {3},
organization = {IEEE},
publisher = {IEEE Press},
title = {The Community and the Crowd: Multimedia Benchmark Dataset Development},
url = {http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6203495&tag=1},
volume = {19},
year = {2012},
}
%T The Community and the Crowd: Multimedia Benchmark Dataset Development
%A Larson, M.
%A Soleymani, M.
%A Eskevich, M.
%A Serdyukov, P.
%A Ordelman, R.
%A Jones, G.
%J IEEE Multimedia
%D 2012
%8 July
%V 19
%N 3
%I IEEE Press
%F larson_IEEE_MM
%U http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6203495&tag=1
%P 15-23
A multimodal database for affect recognition and implicit tagging
M. Soleymani, J. Lichtenauer, T. Pun, M. Pantic. IEEE Transactions on Affective Computing. 3: pp. 42 - 55, Issue 1. April 2012.
author = {M. Soleymani and J. Lichtenauer and T. Pun and M. Pantic},
pages = {42--55},
journal = {IEEE Transactions on Affective Computing},
month = {April},
note = {Issue 1},
title = {A multimodal database for affect recognition and implicit tagging},
volume = {3},
year = {2012},
}
%T A multimodal database for affect recognition and implicit tagging
%A Soleymani, M.
%A Lichtenauer, J.
%A Pun, T.
%A Pantic, M.
%J IEEE Transactions on Affective Computing
%D 2012
%8 April
%V 3
%F soleymani2011multimodal
%O Issue 1
%P 42-55
Multimodal Emotion Recognition in Response to Videos
M. Soleymani, M. Pantic, T. Pun. IEEE Trans. on Affective Computing. 3(2): pp. 211 - 223, in press. November 2012.
author = {M. Soleymani and M. Pantic and T. Pun},
pages = {211--223},
booktitle = {Transactions on Affective Computing},
journal = {IEEE Trans. on Affective Computing},
month = {November},
note = {in press},
number = {2},
publisher = {IEEE Press},
title = {Multimodal Emotion Recognition in Response to Videos},
volume = {3},
year = {2012},
}
%T Multimodal Emotion Recognition in Response to Videos
%A Soleymani, M.
%A Pantic, M.
%A Pun, T.
%J IEEE Trans. on Affective Computing
%D 2012
%8 November
%V 3
%N 2
%I IEEE Press
%F soleymani2011multimodalvideo
%O in press
%P 211-223
Conference articles
Continuous Emotion Detection using EEG Signals and Facial Expressions
M. Soleymani, S. Asghari-esfeden, M. Pantic, Y. Fu. Proceedings of IEEE Int’l Conf. Multimedia and Expo (ICME’14). Chengdu, China, pp. 1 - 6, July 2014.
author = {M. Soleymani and S. Asghari-esfeden and M. Pantic and Y. Fu},
pages = {1--6},
address = {Chengdu, China},
booktitle = {Proceedings of IEEE Int’l Conf. Multimedia and Expo (ICME’14)},
month = {July},
title = {Continuous Emotion Detection using EEG Signals and Facial Expressions},
year = {2014},
}
%T Continuous Emotion Detection using EEG Signals and Facial Expressions
%A Soleymani, M.
%A Asghari-esfeden, S.
%A Pantic, M.
%A Fu, Y.
%B Proceedings of IEEE Int’l Conf. Multimedia and Expo (ICME’14)
%D 2014
%8 July
%C Chengdu, China
%F soleymani_icme_14
%P 1-6
1000 Songs for Emotional Analysis of Music
M. Soleymani, M. Caro, E. M. Schmidt, C. Sha, Y. Yang. Proceedings of the ACM multimedia 2013 workshop on Crowdsourcing for Multimedia. ACM, ACM, 2013.
author = {M. Soleymani and M. Caro and E. M. Schmidt and C. Sha and Y. Yang},
booktitle = {Proceedings of the ACM multimedia 2013 workshop on Crowdsourcing for Multimedia},
organization = {ACM},
publisher = {ACM},
series = {CrowdMM},
title = {1000 Songs for Emotional Analysis of Music},
year = {2013},
}
%T 1000 Songs for Emotional Analysis of Music
%A Soleymani, M.
%A Caro, M.
%A Schmidt, E. M.
%A Sha, C.
%A Yang, Y.
%B Proceedings of the ACM multimedia 2013 workshop on Crowdsourcing for Multimedia
%D 2013
%I ACM
%F crowdmm-soleymani
Human Behavior Sensing for Tag Relevance Assessment
M. Soleymani, S. Kaltwang, M. Pantic. Proceedings of the 21st ACM international conference on Multimedia. ACM, October 2013.
author = {M. Soleymani and S. Kaltwang and M. Pantic},
booktitle = {Proceedings of the 21st ACM international conference on Multimedia},
month = {October},
publisher = {ACM},
series = {MM},
title = {Human Behavior Sensing for Tag Relevance Assessment},
year = {2013},
}
%T Human Behavior Sensing for Tag Relevance Assessment
%A Soleymani, M.
%A Kaltwang, S.
%A Pantic, M.
%B Proceedings of the 21st ACM international conference on Multimedia
%D 2013
%8 October
%I ACM
%F soleymani-acmmm-implicit-tagging
Multimedia Implicit Tagging using EEG Signals
M. Soleymani, M. Pantic. Multimedia and Expo, 2013. ICME 2013. IEEE International Conference on,. IEEE, IEEE, July 2013.
author = {M. Soleymani and M. Pantic},
booktitle = {Multimedia and Expo, 2013. ICME 2013. IEEE International Conference on,},
month = {July},
organization = {IEEE},
publisher = {IEEE},
title = {Multimedia Implicit Tagging using EEG Signals},
year = {2013},
}
%T Multimedia Implicit Tagging using EEG Signals
%A Soleymani, M.
%A Pantic, M.
%B Multimedia and Expo, 2013. ICME 2013. IEEE International Conference on,
%D 2013
%8 July
%I IEEE
%F soleymani-icme13
Emotionally Aware TV
M. Soleymani, M. Pantic. Proceedings of TVUX-2013: Workshop on Exploring and Enhancing the User Experience for TV at ACM CHI 2013. Paris, France, April 2013.
author = {M. Soleymani and M. Pantic},
address = {Paris, France},
booktitle = {Proceedings of TVUX-2013: Workshop on Exploring and Enhancing the User Experience for TV at ACM CHI 2013},
month = {April},
title = {Emotionally Aware TV},
year = {2013},
}
%T Emotionally Aware TV
%A Soleymani, M.
%A Pantic, M.
%B Proceedings of TVUX-2013: Workshop on Exploring and Enhancing the User Experience for TV at ACM CHI 2013
%D 2013
%8 April
%C Paris, France
%F soleymani-position-tvux
Human-Centered Implicit Tagging: Overview and Perspectives
M. Soleymani, M. Pantic. IEEE International Conference on Systems, Man and Cybernetics, 2012. IEEE, IEEE Press, pp. 3304 - 3309, October 2012.
author = {M. Soleymani and M. Pantic},
pages = {3304--3309},
booktitle = { IEEE International Conference on Systems, Man and Cybernetics, 2012},
month = {October},
organization = {IEEE},
publisher = {IEEE Press},
title = {Human-Centered Implicit Tagging: Overview and Perspectives},
year = {2012},
}
%T Human-Centered Implicit Tagging: Overview and Perspectives
%A Soleymani, M.
%A Pantic, M.
%B IEEE International Conference on Systems, Man and Cybernetics, 2012
%D 2012
%8 October
%I IEEE Press
%F smc2012_implicit
%P 3304-3309
Expert Talk for Time Machine Session: Affective Multimedia Analysis: Introduction, Background and Perspectives
M. Soleymani. Multimedia and Expo (ICME), 2012 IEEE International Conference on. IEEE Press, pp. 424 - 424, July 2012.
author = {M. Soleymani},
pages = {424--424},
booktitle = {Multimedia and Expo (ICME), 2012 IEEE International Conference on},
institution = {IEEE},
month = {July},
publisher = {IEEE Press},
title = {Expert Talk for Time Machine Session: Affective Multimedia Analysis: Introduction, Background and Perspectives},
url = {http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6298436&isnumber=6298237},
year = {2012},
}
%T Expert Talk for Time Machine Session: Affective Multimedia Analysis: Introduction, Background and Perspectives
%A Soleymani, M.
%B Multimedia and Expo (ICME), 2012 IEEE International Conference on
%D 2012
%8 July
%I IEEE Press
%F icme_expert_talk
%U http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6298436&isnumber=6298237
%P 424-424
A benchmarking campaign for the multimodal detection of violent scenes in movies
C. Demarty, C. Penet, G. Gravier, M. Soleymani. The European Conference on Computer Vision, The European Conference on Computer Vision, Workshop on Information Fusion in Computer Vision for Concept Recognition. Springer, October 2012.
author = {C. Demarty and C. Penet and G. Gravier and M. Soleymani},
booktitle = {The European Conference on Computer Vision, The European Conference on Computer Vision, Workshop on Information Fusion in Computer Vision for Concept Recognition},
month = {October},
publisher = {Springer},
title = {A benchmarking campaign for the multimodal detection of violent scenes in movies},
year = {2012},
}
%T A benchmarking campaign for the multimodal detection of violent scenes in movies
%A Demarty, C.
%A Penet, C.
%A Gravier, G.
%A Soleymani, M.
%B The European Conference on Computer Vision, The European Conference on Computer Vision, Workshop on Information Fusion in Computer Vision for Concept Recognition
%D 2012
%8 October
%I Springer
%F ECCVw_Demarty_et_al
Other publications
Multimedia implicit tagging
M. Soleymani, M. Pantic. editors: A. Vinciarelli, J. Burgoon, N. Magnenat thalmann, M. Pantic. Social Signal Processing. Cambridge University Press, To appear. 2015.
booktitle = {Social Signal Processing},
note = {To appear},
publisher = {Cambridge University Press},
title = {Multimedia implicit tagging},
year = {2015},
}
%T Multimedia implicit tagging
%B Social Signal Processing
%D 2015
%I Cambridge University Press
%F soleymaniImplicitChapter
%O To appear