Dr. Shiyang Cheng

Position:

Past Member

Email:

Biography

Shiyang Cheng received his bachelor's degree in Biomedical Engineering from Northeastern University (NEU), China in 2011 and M.Sc. degree in Computing Science from Imperial College London, U.K. in 2012. He is now a Research Associate in iBUG group, Imperial College London, UK.

His research interests lie in the areas of statistical machine learning for 2D/3D Computer Vision and Human-Computer Interaction (HCI).

Research Themes:

Face analysis:
Facial point tracking, Face registration, 3D facial expression modelling and recognition

Projects:

epsrc-facer2vm, 4D-FAB

Publications

Journal articles

Deep Neural Network Augmentation: Generating Faces for Affect Analysis

D. Kollias, S. Cheng, E. Ververas, I. Kotsia, S. Zafeiriou. International Journal of Computer Vision. 2020.

[pdf] [bibtex] [endnote]

@article{s11263-020-01304-3,
    author = {I. Kotsia and S. Zafeiriou and S. Cheng and E. Ververas and D. Kollias},
    journal = {International Journal of Computer Vision},
    title = {Deep Neural Network Augmentation: Generating Faces for Affect Analysis},
    year = {2020},
}

Side Information for Face Completion: a Robust PCA Approach

N. Xue, J. Deng, S. Cheng, Y. Panagakis, S. Zafeiriou. TPAMI. 2019.

[pdf] [bibtex] [endnote]

@article{xueniannan_TPAMI_RPCA,
    author = {N. Xue and J. Deng and S. Cheng and Y. Panagakis and S. Zafeiriou},
    journal = {TPAMI},
    title = {Side Information for Face Completion: a Robust PCA Approach},
    year = {2019},
}

An Adversarial Neuro-Tensorial Approach for Learning Disentangled Representations

M. Wang, Z. Shu, S. Cheng, Y. Panagakis, D. Samaras, S. Zafeiriou. International Journal of Computer Vision. Feb 2019.

[pdf] [bibtex] [endnote]

@article{Wang2019,
    author = {M. Wang and Z. Shu and S. Cheng and Y. Panagakis and D. Samaras and S. Zafeiriou},
    journal = {International Journal of Computer Vision},
    month = {Feb},
    title = {An Adversarial Neuro-Tensorial Approach for Learning Disentangled Representations},
    url = {https://doi.org/10.1007/s11263-019-01163-7},
    year = {2019},
}

Statistical non-rigid ICP algorithm and its application to 3D face alignment

S. Cheng, I. Marras, S. Zafeiriou, M. Pantic. Image and Vision Computing, Special Issue on best of FG'2015. 2017.

[pdf] [bibtex] [endnote]

@article{NICP2017,
    journal = {Image and Vision Computing, Special Issue on best of FG'2015},
    title = {Statistical non-rigid ICP algorithm and its application to 3D face alignment},
    year = {2017},
}

From Pixels to Response Maps: Discriminative Image Filtering for Face Alignment in the Wild

A. Asthana, S. Zafeiriou, G. Tzimiropoulos, S. Cheng, M. Pantic. IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI). In Press.. 2015.

[GFRM Code] [pdf] [bibtex] [endnote]

@article{pami_2015,
    author = {A. Asthana and S. Zafeiriou and G. Tzimiropoulos and S. Cheng and M. Pantic},
    journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI). In Press.},
    title = {From Pixels to Response Maps: Discriminative Image Filtering for Face Alignment in the Wild},
    year = {2015},
}

%0 Journal Article
%T From Pixels to Response Maps: Discriminative Image Filtering for Face Alignment in the Wild
%A Asthana, A.
%A Zafeiriou, S.
%A Tzimiropoulos, G.
%A Cheng, S.
%A Pantic, M.
%J IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI). In Press.
%D 2015
%F pami_2015

Conference articles

MimicME: A Large Scale Diverse 4D Database for Facial Expression Analysis

A. Papaioannou, B. Gecer, S. Cheng, G. Chrysos, J. Deng, E. Fotiadou, C. Kampouris, D. Kollias, S. Moschoglou, K. Songsri-in, S. Ploumpis, G. Trigeorgis, P. Tzirakis, E. Ververas, Y. Zhou, A. Ponniah, A. Roussos, S. Zafeiriou. ECCV. 2022.

[pdf] [bibtex] [endnote]

@inproceedings{ECCV2022MimicME,
    booktitle = {ECCV},
    title = {MimicME: A Large Scale Diverse 4D Database for Facial Expression Analysis},
    year = {2022},
}

Dynamic Face Video Segmentation via Reinforcement Learning

Y. Wang, M. Dong, J. Shen, Y. Wu, S. Cheng, M. Pantic. IEEE Conference on Computer Vision and Pattern Recognition (CVPR). pp. 6959 - 6969, 2020.

[pdf] [bibtex] [endnote]

@inproceedings{wang2020dynamic,
    author = {Y. Wang and M. Dong and J. Shen and Y. Wu and S. Cheng and M. Pantic},
    pages = {6959--6969},
    booktitle = {IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
    title = {Dynamic Face Video Segmentation via Reinforcement Learning},
    year = {2020},
}

Shape constrained network for eye segmentation in the wild

B. Luo, J. Shen, S. Cheng, Y. Wang, M. Pantic. The IEEE Winter Conference on Applications of Computer Vision (WACV). pp. 1952 - 1960, 2020.

[pdf] [bibtex] [endnote]

@inproceedings{luo2020shape,
    author = {B. Luo and J. Shen and S. Cheng and Y. Wang and M. Pantic},
    pages = {1952--1960},
    booktitle = {The IEEE Winter Conference on Applications of Computer Vision (WACV)},
    title = {Shape constrained network for eye segmentation in the wild},
    year = {2020},
}

FT-RCNN: Real-time Visual Face Tracking with Region-based Convolutional Neural Networks

Y. Lin, J. Shen, S. Cheng, M. Pantic. FG' 2020 (Oral). 2020.

[bibtex] [endnote]

@inproceedings{FT-RCNN,
    author = {Y. Lin and J. Shen and S. Cheng and M. Pantic},
    booktitle = {FG' 2020 (Oral)},
    title = {FT-RCNN: Real-time Visual Face Tracking with Region-based Convolutional Neural Networks},
    year = {2020},
}

MobiFace: A Novel Dataset for Mobile Face Tracking in the Wild

Y. Lin, S. Cheng, J. Shen, M. Pantic. FG'2019 (Oral). May 2019.

[pdf] [bibtex] [endnote]

@inproceedings{mobiface_fg2019,
    author = {Y. Lin and S. Cheng and J. Shen and M. Pantic},
    booktitle = {FG'2019 (Oral)},
    month = {May},
    title = {MobiFace: A Novel Dataset for Mobile Face Tracking in the Wild},
    year = {2019},
}

UV-GAN: Adversarial Facial UV Map Completion for Pose-invariant Face Recognition

J. Deng, S. Cheng, N. Xue, Y. Zhou, S. Zafeiriou. CVPR. 2018.

[pdf] [bibtex] [endnote]

@inproceedings{deng2017uv,
    author = {J. Deng and S. Cheng and N. Xue and Y. Zhou and S. Zafeiriou},
    booktitle = {CVPR},
    title = {UV-GAN: Adversarial Facial UV Map Completion for Pose-invariant Face Recognition},
    year = {2018},
}

4DFAB: A Large Scale 4D Database for Facial Expression Analysis and Biometric Applications

S. Cheng, I. Kotsia, M. Pantic, S. Zafeiriou. 2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018). Salt Lake City, Utah, US, June 2018.

[pdf] [bibtex] [endnote]

@inproceedings{ChengCVPR18,
    author = {S. Cheng and I. Kotsia and M. Pantic and S. Zafeiriou},
    address = {Salt Lake City, Utah, US},
    booktitle = {2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018)},
    month = {June},
    title = {4DFAB: A Large Scale 4D Database for Facial Expression Analysis and Biometric Applications},
    year = {2018},
}

Photorealistic Facial Synthesis in the Dimensional Affect Space

D. Kollias, S. Cheng, M. Pantic, S. Zafeiriou. European Conference on Computer Vision. Springer, pp. 475 - 491, 2018.

[pdf] [bibtex] [endnote]

@inproceedings{kollias2018photorealistic,
    author = {D. Kollias and S. Cheng and M. Pantic and S. Zafeiriou},
    pages = {475--491},
    booktitle = {European Conference on Computer Vision},
    organization = {Springer},
    title = {Photorealistic Facial Synthesis in the Dimensional Affect Space},
    year = {2018},
}

Sentiment Apprehension in Human-Robot Interaction with NAO

J. Shen, O. Rudovic, S. Cheng, M. Pantic. 1st International Workshop on Automatic Sentiment Analysis in the Wild (WASA'15). Xi'an, China, September 2015.

[pdf] [bibtex] [endnote]

@inproceedings{Shen2015,
    author = {J. Shen and O. Rudovic and S. Cheng and M. Pantic},
    address = {Xi'an, China},
    booktitle = {1st International Workshop on Automatic Sentiment Analysis in the Wild (WASA'15)},
    month = {September},
    title = {Sentiment Apprehension in Human-Robot Interaction with NAO},
    year = {2015},
}

Active Nonrigid ICP Algorithm

S. Cheng, I. Marras, S. Zafeiriou, M. Pantic. IEEE International Conference on Automatic Face and Gesture Recognition (FG'15). Ljubljana, Slovenia, Oral. May 2015.

[pdf] [bibtex] [endnote]

@inproceedings{shiyang_active_nicp,
    author = {S. Cheng and I. Marras and S. Zafeiriou and M. Pantic},
    address = {Ljubljana, Slovenia},
    booktitle = {IEEE International Conference on Automatic Face and Gesture Recognition (FG'15)},
    month = {May},
    note = {Oral},
    title = {Active Nonrigid ICP Algorithm},
    year = {2015},
}

3D Facial Geometric Features For Constrained Local Models

S. Cheng, S. Zafeiriou, A. Asthana, M. Pantic. IEEE International Conference on Image Processing (ICIP 2014). Paris, France, October 2014.

[bibtex] [endnote]

@inproceedings{cheng2014facial,
    author = {S. Cheng and S. Zafeiriou and A. Asthana and M. Pantic},
    address = {Paris, France},
    booktitle = {IEEE International Conference on Image Processing (ICIP 2014)},
    month = {October},
    title = {3D Facial Geometric Features For Constrained Local Models},
    year = {2014},
}

%0 Conference Proceedings
%T 3D Facial Geometric Features For Constrained Local Models
%A Cheng, S.
%A Zafeiriou, S.
%A Asthana, A.
%A Pantic, M.
%B IEEE International Conference on Image Processing (ICIP 2014)
%D 2014
%8 October
%C Paris, France
%F cheng2014facial

Real-time generic face tracking in the wild with CUDA

S. Cheng, A. Asthana, S. Zafeiriou, J. Shen, M. Pantic. Proceedings of the 5th ACM Multimedia Systems Conference. ACM, Singapore, Singapore, pp. 148 - 151, 2014.

[pdf] [bibtex] [endnote]

@inproceedings{Cheng2014,
    author = {S. Cheng and A. Asthana and S. Zafeiriou and J. Shen and M. Pantic},
    pages = {148--151},
    address = {Singapore, Singapore},
    booktitle = {Proceedings of the 5th ACM Multimedia Systems Conference},
    publisher = {ACM},
    title = {Real-time generic face tracking in the wild with CUDA},
    year = {2014},
}

%0 Conference Proceedings
%T Real-time generic face tracking in the wild with CUDA
%A Cheng, S.
%A Asthana, A.
%A Zafeiriou, S.
%A Shen, J.
%A Pantic, M.
%B Proceedings of the 5th ACM Multimedia Systems Conference
%D 2014
%I ACM
%C Singapore, Singapore
%F Cheng2014
%P 148-151

Incremental Face Alignment in the Wild

A. Asthana, S. Zafeiriou, S. Cheng, M. Pantic. In Proceedings of IEEE Int’l Conf. on Computer Vision & Pattern Recognition (CVPR 2014). 2014.

[YTCeleb Database Video Annotations] [pdf] [bibtex] [endnote]

@inproceedings{akshay_wild,
    author = {A. Asthana and S. Zafeiriou and S. Cheng and M. Pantic},
    booktitle = {In Proceedings of IEEE Int’l Conf. on Computer Vision & Pattern Recognition (CVPR 2014)},
    title = {Incremental Face Alignment in the Wild},
    year = {2014},
}

%0 Conference Proceedings
%T Incremental Face Alignment in the Wild
%A Asthana, A.
%A Zafeiriou, S.
%A Cheng, S.
%A Pantic, M.
%B In Proceedings of IEEE Int’l Conf. on Computer Vision & Pattern Recognition (CVPR 2014)
%D 2014
%F akshay_wild

CLM-WILD: Real-Time Generic Face Tracker

A. Asthana, S. Cheng, J. Shen, S. Zafeiriou, M. Pantic. Demo at IEEE International Conference on Computer Vision (ICCV 2013), Sydney, Australia. December 2013.

[bibtex] [endnote]

@inproceedings{iccv13_demo,
    author = {A. Asthana and S. Cheng and J. Shen and S. Zafeiriou and M. Pantic},
    booktitle = {Demo at IEEE International Conference on Computer Vision (ICCV 2013), Sydney, Australia},
    month = {December},
    title = {CLM-WILD: Real-Time Generic Face Tracker},
    year = {2013},
}

%0 Conference Proceedings
%T CLM-WILD: Real-Time Generic Face Tracker
%A Asthana, A.
%A Cheng, S.
%A Shen, J.
%A Zafeiriou, S.
%A Pantic, M.
%B Demo at IEEE International Conference on Computer Vision (ICCV 2013), Sydney, Australia
%D 2013
%8 December
%F iccv13_demo

Robust Discriminative Response Map Fitting with Constrained Local Models

A. Asthana, S. Zafeiriou, S. Cheng, M. Pantic. 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2013). Portland, Oregon, USA, June 2013.

[pdf] [bibtex] [endnote]

@inproceedings{akshay_CVPR_2013,
    author = {A. Asthana and S. Zafeiriou and S. Cheng and M. Pantic},
    address = {Portland, Oregon, USA},
    booktitle = {2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2013)},
    month = {June},
    title = {Robust Discriminative Response Map Fitting with Constrained Local Models },
    year = {2013},
}

%0 Conference Proceedings
%T Robust Discriminative Response Map Fitting with Constrained Local Models
%A Asthana, A.
%A Zafeiriou, S.
%A Cheng, S.
%A Pantic, M.
%B 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2013)
%D 2013
%8 June
%C Portland, Oregon, USA
%F akshay_CVPR_2013