Jie Shen

Dr. Jie Shen

Position:

Research fellow

Email:

Biography

Jie Shen obtained his BEng degree in Information Engineering from Zhejiang University in 2005. He then worked as a research assistant in National Laboratory of Pattern Recognition, Institute of Automation, ChineseAcademy of Sciences until 2007. He received his MSc degree in Advanced Computing and his PhD degree from Department of Computing, Imperial College London in 2008 and 2014, respectively. During his postgraduate study, Jie Shen mainly worked on the software and hardware infrastructure for multi-modal human-computer/robot interaction (HCI/HRI) systems. His work, the HCI^2 Framework, has been used as the system integration framework in EU FP7 FROG and EU FP7 TERESA projects and he has built the data collection system for the MAHNOB-HCI-Tagging database and the SEWA database, Jie Shen’s current research focuses on affect-sensitive human-robot interaction and cloud-based affective computing systems.

Research Themes:

HCI:
Integration platform for development of human-centered interfaces, Affect-sensitive HCI

Publications

Journal articles

HCI^2 Framework: A Software Framework for Multimodal Human-Computer Interaction

J. Shen, M. Pantic. IEEE Transactions on Systems, Man, and Cybernetics–Part B. Special issue on Modern Control for Computer Games (Accepted for publication) 2013.

Bibtex reference [hide]
@article{SMCB-E-2012-04-0349-R3,
    author = {J. Shen and M. Pantic},
    journal = {IEEE Transactions on Systems, Man, and Cybernetics–Part B},
    month = {Special issue on Modern Control for Computer Games (Accepted for publication)},
    title = {HCI^2 Framework: A Software Framework for Multimodal Human-Computer Interaction},
    year = {2013},
}
Endnote reference [hide]
%0 Journal Article
%T HCI^2 Framework: A Software Framework for Multimodal Human-Computer Interaction
%A Shen, J.
%A Pantic, M.
%J IEEE Transactions on Systems, Man, and Cybernetics–Part B
%D 2013
%8 Special issue on Modern Control for Computer Games (Accepted for publication)
%F SMCB-E-2012-04-0349-R3

Cost-effective solution to synchronised audio-visual data capture using multiple sensors

J. Lichtenauer, J. Shen, M. F. Valstar, M. Pantic. Image and Vision Computing. 29: pp. 666 - 680, September 2011.

Bibtex reference [hide]
@article{Lichtenauer2011a,
    author = {J. Lichtenauer and J. Shen and M. F. Valstar and M. Pantic},
    pages = {666--680},
    journal = {Image and Vision Computing},
    month = {September},
    publisher = {Elsevier},
    title = {Cost-effective solution to synchronised audio-visual data capture using multiple sensors},
    url = {http://dx.doi.org/10.1016/j.imavis.2011.07.004},
    volume = {29},
    year = {2011},
}
Endnote reference [hide]
%0 Journal Article
%T Cost-effective solution to synchronised audio-visual data capture using multiple sensors
%A Lichtenauer, J.
%A Shen, J.
%A Valstar, M. F.
%A Pantic, M.
%J Image and Vision Computing
%D 2011
%8 September
%V 29
%I Elsevier
%F Lichtenauer2011a
%U http://dx.doi.org/10.1016/j.imavis.2011.07.004
%P 666-680

Conference articles

Semi-autonomous data enrichment based on cross-task labelling of missing targets for holistic speech analysis

Y. Zhang, Y. Zhou, J. Shen. 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, pp. 6090 - 6094, 2016.

Bibtex reference [hide]
@inproceedings{zhang2016semi,
    author = {Y. Zhang and Y. Zhou and J. Shen},
    pages = {6090--6094},
    booktitle = {2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)},
    organization = {IEEE},
    title = {Semi-autonomous data enrichment based on cross-task labelling of missing targets for holistic speech analysis},
    year = {2016},
}
Endnote reference [hide]

Tiresias: low-overhead sample based scheduling with task hopping

C. Hao, J. Shen, H. Zhang, Y. Wu, M. Li. Proceedings of the 2016 IEEE International Conference on Cluster Computing. IEEE, 2016.

Bibtex reference [hide]
@inproceedings{hao2016tiresias,
    author = {C. Hao and J. Shen and H. Zhang and Y. Wu and M. Li},
    booktitle = {Proceedings of the 2016 IEEE International Conference on Cluster Computing},
    organization = {IEEE},
    title = {Tiresias: low-overhead sample based scheduling with task hopping},
    year = {2016},
}
Endnote reference [hide]

The First Facial Landmark Tracking in-the-Wild Challenge: Benchmark and Results

J. Shen, S. Zafeiriou, G. Chrysos, J. Kossaifi, G. Tzimiropoulos, M. Pantic. Proceedings of IEEE International Conference on Computer Vision, 300 Videos in the Wild (300-VW): Facial Landmark Tracking in-the-Wild Challenge & Workshop (ICCVW'15). December 2015.

Bibtex reference [hide]
@inproceedings{300VW,
    author = {J. Shen and S. Zafeiriou and G. Chrysos and J. Kossaifi and G. Tzimiropoulos and M. Pantic},
    booktitle = {Proceedings of IEEE International Conference on Computer Vision, 300 Videos in the Wild (300-VW): Facial Landmark Tracking in-the-Wild Challenge & Workshop (ICCVW'15)},
    month = {December},
    title = {The First Facial Landmark Tracking in-the-Wild Challenge: Benchmark and Results},
    year = {2015},
}
Endnote reference [hide]

Sparkle: adaptive sample based scheduling for cluster computing

C. Hao, J. Shen, H. Zhang, X. Zhang, Y. Wu, M. Li. Proceedings of the 5th International Workshop on Cloud Data and Platforms. ACM, 2015.

Bibtex reference [hide]
@inproceedings{hao2015sparkle,
    author = {C. Hao and J. Shen and H. Zhang and X. Zhang and Y. Wu and M. Li},
    booktitle = {Proceedings of the 5th International Workshop on Cloud Data and Platforms},
    organization = {ACM},
    title = {Sparkle: adaptive sample based scheduling for cluster computing},
    year = {2015},
}
Endnote reference [hide]

Sentiment Apprehension in Human-Robot Interaction with NAO

J. Shen, O. Rudovic, S. Cheng, M. Pantic. 1st International Workshop on Automatic Sentiment Analysis in the Wild (WASA'15). Xi'an, China, September 2015.

Bibtex reference [hide]
@inproceedings{Shen2015,
    author = {J. Shen and O. Rudovic and S. Cheng and M. Pantic},
    address = {Xi'an, China},
    booktitle = {1st International Workshop on Automatic Sentiment Analysis in the Wild (WASA'15)},
    month = {September},
    title = {Sentiment Apprehension in Human-Robot Interaction with NAO},
    year = {2015},
}
Endnote reference [hide]

TERESA: A Socially Intelligent Semi-autonomous Telepresence System

K. Shiarlis, J. Messias, M. V. Someren, S. Whiteson, J. Kim, J. Vroon, G. Englebienne, K. Truong, V. Evers, N. Perez-higueras, I. Perez-hurtado, R. Ramon-vigo, F. Caballero, L. Merino, J. Shen, S. Petridis, M. Pantic, L. Hedman, M. Scherlund, R. Koster, H. Michel. ICRA 2015: Proceedings of the IEEE International Conference on Robotics and Automation, Workshop on Machine Learning for Social Robotics. May 2015.

Bibtex reference [hide]
@inproceedings{shiarlisicra15,
    author = {K. Shiarlis and J. Messias and M. V. Someren and S. Whiteson and J. Kim and J. Vroon and G. Englebienne and K. Truong and V. Evers and N. Perez-higueras and I. Perez-hurtado and R. Ramon-vigo and F. Caballero and L. Merino and J. Shen and S. Petridis and M. Pantic and L. Hedman and M. Scherlund and R. Koster and H. Michel},
    booktitle = {ICRA 2015: Proceedings of the IEEE International Conference on Robotics and Automation, Workshop on Machine Learning for Social Robotics},
    month = {May},
    title = {TERESA: A Socially Intelligent Semi-autonomous Telepresence System},
    year = {2015},
}
Endnote reference [hide]

Real-time generic face tracking in the wild with CUDA

S. Cheng, A. Asthana, S. Zafeiriou, J. Shen, M. Pantic. Proceedings of the 5th ACM Multimedia Systems Conference. ACM, Singapore, Singapore, pp. 148 - 151, 2014.

Bibtex reference [hide]
@inproceedings{Cheng2014,
    author = {S. Cheng and A. Asthana and S. Zafeiriou and J. Shen and M. Pantic},
    pages = {148--151},
    address = {Singapore, Singapore},
    booktitle = {Proceedings of the 5th ACM Multimedia Systems Conference},
    publisher = {ACM},
    title = {Real-time generic face tracking in the wild with CUDA},
    year = {2014},
}
Endnote reference [hide]
%0 Conference Proceedings
%T Real-time generic face tracking in the wild with CUDA
%A Cheng, S.
%A Asthana, A.
%A Zafeiriou, S.
%A Shen, J.
%A Pantic, M.
%B Proceedings of the 5th ACM Multimedia Systems Conference
%D 2014
%I ACM
%C Singapore, Singapore
%F Cheng2014
%P 148-151

CLM-WILD: Real-Time Generic Face Tracker

A. Asthana, S. Cheng, J. Shen, S. Zafeiriou, M. Pantic. Demo at IEEE International Conference on Computer Vision (ICCV 2013), Sydney, Australia. December 2013.

Bibtex reference [hide]
@inproceedings{iccv13_demo,
    author = {A. Asthana and S. Cheng and J. Shen and S. Zafeiriou and M. Pantic},
    booktitle = {Demo at IEEE International Conference on Computer Vision (ICCV 2013), Sydney, Australia},
    month = {December},
    title = {CLM-WILD: Real-Time Generic Face Tracker},
    year = {2013},
}
Endnote reference [hide]
%0 Conference Proceedings
%T CLM-WILD: Real-Time Generic Face Tracker
%A Asthana, A.
%A Cheng, S.
%A Shen, J.
%A Zafeiriou, S.
%A Pantic, M.
%B Demo at IEEE International Conference on Computer Vision (ICCV 2013), Sydney, Australia
%D 2013
%8 December
%F iccv13_demo

HCI^2 Workbench: A Development Tool for Multimodal Human-Computer Interaction Systems

J. Shen, W. Shi, M. Pantic. Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition (FG'11), ECAG'11- 2nd FG Workshop on Facial and Bodily Expressions for Control and Adaptation of Games . Santa Barbara, CA, USA, pp. 766 - 773, March 2011.

Bibtex reference [hide]
@inproceedings{shen2011hci,
    author = {J. Shen and W. Shi and M. Pantic},
    pages = {766--773},
    address = {Santa Barbara, CA, USA},
    booktitle = {Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition (FG'11), ECAG'11- 2nd FG Workshop on Facial and Bodily Expressions for Control and Adaptation of Games },
    month = {March},
    title = {HCI^2 Workbench: A Development Tool for Multimodal Human-Computer Interaction Systems},
    year = {2011},
}
Endnote reference [hide]
%0 Conference Proceedings
%T HCI^2 Workbench: A Development Tool for Multimodal Human-Computer Interaction Systems
%A Shen, J.
%A Shi, W.
%A Pantic, M.
%B Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition (FG?11), ECAG?11- 2nd FG Workshop on Facial and Bodily Expressions for Control and Adaptation of Games
%D 2011
%8 March
%C Santa Barbara, CA, USA
%F shen2011hci
%P 766-773

A Software Framework for Multimodal Human-Computer Interaction Systems

J. Shen, M. Pantic. Proceedings of IEEE Int'l Conf. Systems, Man, and Cybernetics (SMC'09). San Antonio, USA, pp. 2038 - 2045, October 2009.

Bibtex reference [hide]
@inproceedings{Shen2009asffm,
    author = {J. Shen and M. Pantic},
    pages = {2038--2045},
    address = {San Antonio, USA},
    booktitle = {Proceedings of IEEE Int'l Conf. Systems, Man, and Cybernetics (SMC'09)},
    month = {October},
    title = {A Software Framework for Multimodal Human-Computer Interaction Systems},
    year = {2009},
}
Endnote reference [hide]
%0 Conference Proceedings
%T A Software Framework for Multimodal Human-Computer Interaction Systems
%A Shen, J.
%A Pantic, M.
%B Proceedings of IEEE Int?l Conf. Systems, Man, and Cybernetics (SMC?09)
%D 2009
%8 October
%C San Antonio, USA
%F Shen2009asffm
%P 2038-2045

Cost-effective solution to synchronized audio-visual capture using multiple sensors

J. Lichtenauer, M. F. Valstar, J. Shen, M. Pantic. Proceedings of IEEE Int'l Conf. Advanced Video and Signal Based Surveillance (AVSS'09). Genoa, Italy, pp. 324 - 329, September 2009.

Bibtex reference [hide]
@inproceedings{Lichtenauer2009cstsa,
    author = {J. Lichtenauer and M. F. Valstar and J. Shen and M. Pantic},
    pages = {324--329},
    address = {Genoa, Italy},
    booktitle = {Proceedings of IEEE Int'l Conf. Advanced Video and Signal Based Surveillance (AVSS'09)},
    month = {September},
    title = {Cost-effective solution to synchronized audio-visual capture using multiple sensors},
    year = {2009},
}
Endnote reference [hide]
%0 Conference Proceedings
%T Cost-effective solution to synchronized audio-visual capture using multiple sensors
%A Lichtenauer, J.
%A Valstar, M. F.
%A Shen, J.
%A Pantic, M.
%B Proceedings of IEEE Int?l Conf. Advanced Video and Signal Based Surveillance (AVSS?09)
%D 2009
%8 September
%C Genoa, Italy
%F Lichtenauer2009cstsa
%P 324-329