Caifeng(Kevin) SHAN, Ph.D.

Philips Research
High Tech Campus 36
5656 AE Eindhoven
The Netherlands

Tel: +31 (0)40 27 41601
Fax: +31 (0)40 27 42630
Email: Caifeng dot Shan at gmail dot com


Short Bio

Caifeng Shan is currently a Senior Scientist with Philips Research , Eindhoven, The Netherlands. He received the B.Eng. degree from the University of Science and Technology of China (USTC) , the M.Eng degree from the Institute of Automation, Chinese Academy of Sciences , and the PhD degree in computer vision from Queen Mary , University of London . His research interests include computer vision, pattern recognition, image/video processing and analysis, multimedia, machine learning, and related applications. He has authored over 50 technical papers and 9 patent applications. He is the recipient of the 2007 Chinese Government Award for Outstanding Students Abroad. He is Associate Editor of IEEE Transactions on Circuits and Systems for Video Technology. He has edited three books and has been the Guest Editor of IEEE Transactions on Multimedia, IEEE Transactions on Circuits and Systems for Video Technology, and Signal Processing (Elsevier). He orgnized several international workshops at flagship conferences such as IEEE ICCV and ACM Multimedia. He has served as a Program Committee Member and Reviewer for numerous international conferences and journals.

Publications

Edited Books

  1. Ling Shao, Caifeng Shan, Jiebo Luo, and Minoru Etoh (Eds.), " Multimedia Interaction and Intelligent User Interfaces: Principles, Methods and Applications", ISBN: 978-1-84996-506-4, Springer, September 2010.
  2. Dan Schonfeld, Caifeng Shan, Dacheng Tao, and Liang Wang (Eds.), "Video Search and Mining", ISBN: 978-3-642-12899-8, Springer, May 2010.

Journal Papers and Book Chapters

  1. Luc P.J. Vosters, Caifeng Shan, and Tommaso Gritti, "Robust Background Subtraction under Rapidly Changing Illumination Conditions", submitted.
  2. Hatice Gunes, Caifeng Shan, Shizhi Chen, and Ying-Li Tian, "Bodily Expression for Automatic Affect Recognition", in A. Konar and A. Chakraborty (Eds.), Advances in Emotion Recognition, Wiley-Blackwell, 2012.
  3. Caifeng Shan, "Learning Local Binary Patterns for Gender Classification on Real-World Face Images", Pattern Recognition Letters , Vol. 33, No. 4, pp. 431 - 437, March 2012. [pdf]
  4. Caifeng Shan, "Smile Detection by Boosting Pixel Differences", IEEE Transactions on Image Processing, Vol. 21, No. 1, pp. 431 - 436, January 2012. [pdf]
  5. Caifeng Shan, "Learning Human Emotion from Body Gesture", in N. M. Seel(Eds.), Encyclopedia of the Sciences of Learning, Springer, 2011.
  6. Di Huang, Caifeng Shan, Mohsen Ardabilian, Yunhong Wang, and Liming Chen, "Local Binary Patterns and Its Applications on Facial Image Analysis: A Survey", IEEE Transactions on Systems, Man, and Cybernetics - Part C: Applications and Reviews, Vol. 41, No. 6, pp. 765 - 781, November 2011. [pdf]
  7. Rama Chellappa, Andrea Cavallaro, Ying Wu, Caifeng Shan, Yun Fu, and Kari Pulli, "Special Issue on Video Analysis on Resource-Limited Systems", IEEE Transactions on Circuits and Systems for Video Technology, Vol. 21, No. 10, pp. 1349 - 1352, October 2011. [pdf]
  8. Caifeng Shan, "Gesture Control for Consumer Electronics", in L. Shao, C. Shan, J. Luo, and M. Etoh(Eds.), Multimedia Interaction and Intelligent User Interfaces: Principles, Methods and Applications, Springer, 2010.
  9. Mirela C. Popa, Leon J.M. Rothkrantz, Dragos Datcu, Pascal Wiggers, Ralph Braspenning, and Caifeng Shan, "A Comparative Study of HMMs and DBNs Applied to Facial Action Units Recognition", Neural Network World, Vol. 20, No. 6, pp. 737-760, December 2010.
  10. Nicu Sebe, Hamid Aghajan, Thomas S. Huang, Nadia Magnenat-Thalmann, and Caifeng Shan, "Special Issue on Multimodal Affective Interaction", IEEE Transactions on Multimedia, Vol. 12, No. 6, pp. 477 - 480, October 2010. [pdf]
  11. Caifeng Shan, "Face Recognition and Retrieval in Video", in D. Schonfeld, C. Shan, D. Tao, and L. Wang(Eds.), Video Search and Mining, Springer, 2010. [pdf]
  12. Wei Chen, Caifeng Shan, and Gerard de Haan, "Optimal Regularization Parameter Estimation for Spectral Regression Discriminant Analysis", IEEE Transactions on Circuits and Systems for Video Technology, Vol. 19, No. 12, pp. 1921-1926, December 2009. [pdf]
  13. Caifeng Shan and Ralph Braspenning, "Recognizing Facial Expressions Automatically from Video", in H. Nakashima, J. Augusto and H. Aghajan (Eds.), Handbook of Ambient Intelligence and Smart Environments, Springer, 2009. [pdf]
  14. Caifeng Shan, Shaogang Gong, and Peter W. McOwan, "Facial Expression Recognition Based on Local Binary Patterns: A Comprehensive Study", Image and Vision Computing , Vol. 27, Issue 6, pp. 803-816, 2009. [pdf]
  15. Caifeng Shan, "Linear Subspace Learning for Facial Expression Analysis", in Machine Learning, I-Tech Education and Publishing, Vienna, Austria, 2008.
  16. Caifeng Shan, Shaogang Gong, and Peter W. McOwan, "Fusing Gait and Face Cues for Human Gender Recognition", Neurocomputing, Vol. 71, Issue 10-12, pp. 1931-1938, 2008. [pdf]
  17. Caifeng Shan, Shaogang Gong, and Peter W. McOwan, "Facial Expression Recognition Based on Statistical Local Features", in J. Luo and X. Tang (Eds.), USTC 50th Golden Anniversary Book: Computer Vision, USTC Press, 2008.
  18. Caifeng Shan, Tieniu Tan, and Yucheng Wei, "Real-Time Hand Tracking Using A Mean Shift Embedded Particle Filter", Pattern Recognition, Vol. 40, No. 7, pp. 1958-1970, 2007. [pdf]
  19. Caifeng Shan, Shaogang Gong, and Peter W. McOwan, "Appearance Manifold of Facial Expression", in N. Sebe, M. S. Lew and T. S. Huang (Eds.), Computer Vision in Human-Computer Interaction, Lecture Notes in Computer Science, Vol. 3766, pp. 221-230, Springer, October 2005. [pdf]

Conference Papers

  1. Jiebo Luo, Caifeng Shan, Ling Shao, and Minoru Etoh, "ACM International Workshop on Interactive Multimedia on Mobile and Portable Devices (IMMPD'11)", ACM International Conference on Multimedia, 623-624, Scottsdale, Arizona, USA, 2011.
  2. Mirela Popa, Leon Rothkrantz, Caifeng Shan, Pascal Wiggers, and Alper Kemal-Koc, "Kinect Sensing of Shopping related Actions", International Workshop on Interactive Human Behavior Analysis in Open or Public Spaces, Amsterdam, The Netherlands, 2011.
  3. Mirela Popa, Tommaso Gritti, Leon Rothkrantz, Caifeng Shan, and Pascal Wiggers, "Detecting Customers' Buying Behavior on a Real-life Database", International Conference on Computer Analysis of Images and Patterns (CAIP'11), Seville, Spain, 2011.
  4. Caifeng Shan, "Towards Demographic Classification in Unconstrained Environments", International Workshop on Computer Vision Applications, Eindhoven, The Netherlands, 2011.
  5. Mirela Popa, Leon Rothkrantz, Caifeng Shan, Tommaso Gritti, and Pascal Wiggers, "Automatic Assessment of Customers' Buying Behavior", International Workshop on Computer Vision Applications, Eindhoven, The Netherlands, 2011.
  6. Caifeng Shan, "An Efficient Approach to Smile Detection", International Workshop on Facial and Bodily Expressions for Control and Adaptation of Games , Santa Barbara, California, 2011.
  7. Mirela Popa, Leon Rothkrantz, Alper Kemal Koc, Pascal Wiggers, Caifeng Shan, and Ralph Braspenning, "Automatic Assessment of Car Driver Behavior", Driver Car Interaction & Interface, Prague, Czech Republic, 2010.
  8. Caifeng Shan, "Gender Classification on Real-Life Faces", Advanced Concepts for Intelligent Vision Systems, Sydney, Australia, 2010.
  9. Mirela Popa, Leon Rothkrantz, Pascal Wiggers, Ralph Braspenning, and Caifeng Shan, "Toward Automatic Shopping Behavior Assessment", D-CIS Human Factors Event 2010, Delft, the Netherlands, 2010.
  10. Caifeng Shan, "Learning Local Features for Age Estimation on Real-life Faces", ACM International Workshop on Multimodal Pervasive Video Analysis, Florence, Italy, 2010.
  11. Luc P.J. Vosters, Caifeng Shan, and Tommaso Gritti, "Background Subtraction under Sudden Illumination Changes", IEEE International Conference on Advanced Video and Signal-Based Surveillance (AVSS'10), Boston, USA, 2010.
  12. Mirela Popa, Leon Rothkrantz, Zhenke Yang, Pascal Wiggers, Ralph Braspenning, and Caifeng Shan, "Analysis of Shopping Behavior based on Surveillance System", IEEE International Conference on Systems, Man, and Cybernetics (SMC'10), Istanbul, Turkey, 2010.
  13. Marten Pijl, Steven van de Par, Caifeng Shan, "An Event-based Approach to Multi-modal Activity Modeling and Recognition", IEEE International Conference on Pervasive Computing and Communications (PerCom'10), Mannheim, Germany, 2010.
  14. Ling Shao, Caifeng Shan, Jiebo Luo, and Minoru Etoh, "1st ACM international workshop on interactive multimedia for consumer electronics (IMCE'09)". ACM International Conference on Multimedia, 1149-1150, Beijing, China, October 2009.
  15. Yanlin Geng, Caifeng Shan and Pengwei Hao, "Square Loss based Regularized LDA for Face Recognition Using Image Sets", IEEE Computer Society Workshop on Biometrics, in conjunction with CVPR'2009, Miami, USA, June 2009.
  16. Jun Rong, Tommaso Gritti, and Caifeng Shan, "Upscaling Faces for Recognition Systems Using Trained Filters", ACM International Workshop on Interactive Multimedia for Consumer Electronics, in conjunction with ACM Multimedia 2009, Beijing, China, October 2009.
  17. Caifeng Shan and Wei Chen, "Head Pose Estimation Using Spectral Regression Discriminant Analysis", IEEE International Workshop on CVPR for Human Communicative Behavior Analysis, in conjunction with CVPR'2009, Miami, USA, June 2009.
  18. Caifeng Shan and Tommaso Gritti, "Learning Discriminative LBP-Histogram Bins for Facial Expression Recognition", Proc. British Machine Vision Conference (BMVC'08) , Leeds, UK, September 2008.
  19. Anteneh Abbo, Abhiram Ganesh, Vincent Jeanne, Caifeng Shan, Ralph Braspenning, Martin Ouwerkerk, and Henk Corporaal, "Mapping Facial Expression Recognition Algorithms on a Low-Power Smart Camera", Proc. Second ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC'08), Stanford University, California, USA, September 2008. (Oral)
  20. Tommaso Gritti, Caifeng Shan, Vincent Jeanne, and Ralph Braspenning, "Local Features based Facial Expression Recognition with Face Registration Errors", Proc. IEEE International Conference on Automatic Face and Gesture Recognition (FG'08), Amsterdam, Netherlands, September 2008.
  21. Shaogang Gong, Caifeng Shan, and Tao Xiang, "Visual inference of human emotion and behaviour", Proc. ACM International Conference on Multimodal Interfaces (ICMI'07) , 22-29, Nagoya, Japan, November 2007.(Invited Paper)
  22. Caifeng Shan, Shaogang Gong, and Peter W. McOwan, "Capturing Correlations Among Facial Parts for Facial Expression Analysis", Proc. British Machine Vision Conference (BMVC'07) , Warwick, UK, September 2007. (Oral).
  23. Caifeng Shan, Shaogang Gong, and Peter W. McOwan, "Learning Gender from Human Gaits and Faces", Proc. IEEE International Conference on Advanced Video and Signal-Based Surveillance (AVSS'07), pp. 505-510, London, UK, September, 2007.
  24. Caifeng Shan, Shaogang Gong, and Peter W. McOwan, "Beyond Facial Expressions: Learning Human Emotion from Body Gestures", Proc. British Machine Vision Conference (BMVC'07), Warwick, UK, September, 2007.
  25. Caifeng Shan, Shaogang Gong, and Peter W. McOwan, "Dynamic Facial Expression Recognition Using A Bayesian Temporal Manifold Model", Proc. British Machine Vision Conference (BMVC'06) , Vol. 1, pp. 297-306, Edinburgh, UK, September, 2006.
  26. Caifeng Shan, Shaogang Gong, and Peter W. McOwan, "A Comprehensive Empirical Study on Linear Subspace Methods for Facial Expression Analysis", Proc. IEEE International Workshop on Vision for Human-Computer Interaction, in conjunction with CVPR'2006, New York, USA, June 2006.
  27. Caifeng Shan, Shaogang Gong, and Peter W. McOwan, "Conditional Mutual Information Based Boosting for Facial Expression Recognition", Proc. British Machine Vision Conference (BMVC'05), Oxford, UK, September 2005. (Oral)
  28. Caifeng Shan, Shaogang Gong, and Peter W. McOwan, "Recognizing Facial Expressions at Low Resolution", Proc. IEEE International Conference on Advanced Video and Signal-Based Surveillance (AVSS'05), pp. 330-335, Como, Italy, September 2005. (Oral)
  29. Caifeng Shan, Shaogang Gong, and Peter W. McOwan, "Robust Facial Expression Recognition Using Local Binary Patterns", Proc. IEEE International Conference on Image Processing (ICIP'05), Genova, Italy, September 2005. [pdf]
  30. Caifeng Shan, Yucheng Wei, Xianchao Qiu and Tieniu Tan, "Gesture Recognition Using Temporal Template Based Trajectories", Proc. International Conference on Pattern Recognition (ICPR'04), Vol. 3, pp. 954-957, Cambridge, UK, August, 2004.
  31. Caifeng Shan, Yucheng Wei, Tieniu Tan and Fr¨¦d¨¦ric Ojardias, "Real Time Hand Tracking By Combining Particle Filtering and Mean Shift", Proc. IEEE International Conference on Automatic Face and Gesture Recognition (FG'04), 669-674, Seoul, South Korea, May 2004.

Theses

  • Inferring Facial and Body Language
    PhD Thesis, Queen Mary, University of London, 2007
    Supervisor: Prof. Shaogang Gong and Prof. Peter W. McOwan
  • Vision-based Hand Gesture Recognition for Human-Computer Interaction
    Master Thesis, Institute of Automation Chinese Academy of Sciences, 2004
    Supervisor: Prof. Tieniu Tan

back to top

Projects

  • ViCoMo (Visual Context Modelling), ITEA 2, 2009-2012
    • Demo Leader
  • MORPHEUS (Motion analysis with contactless camera sensing for professional polysomnography and baby sleep-watching at home), Point-One project, 2010-2013

Services and Activities

  • Associate Editor
    • IEEE Transactions on Circuits and Systems for Video Technology, 2011 -
  • Guest Editor
    • Signal Processing (Elsevier), Special Issue on Indexing of Large-Scale Multimedia Signals, 2012
    • IEEE Transactions on Circuits and Systems for Video Technology, Special Issue on Video Analysis on Resource-Limited Systems, 2011
    • IEEE Transactions on Multimedia, Special Issue on Multimodal Affective Interaction, 2010
  • Chair
  • Technical Program Committee
    • IEEE Virtual Reality (VR) Conference, 2012
    • IEEE International Workshop on Large Scale Visual Analytics, 2011
    • International Workshop on Interactive Human Behavior Analysis in Open or Public Spaces, 2011
    • Chinese Conference on Intelligent Visual Surveillance, 2011
    • British Machine Vision Conference (BMVC), 2011
    • IEEE International Conference on Automatic Face and Gesture Recognition (FG), 2011
    • IEEE International Workshop on Mobile Vision, 2010, 2011
    • International Workshop on IPTV Technologies and Multidisciplinary Applications, 2010, 2011
    • International Congress on Image and Signal Processing (CISP), 2010
    • IEEE International Conference on Multimedia Information Networking and Security, 2010
    • International Conference on Pattern Recognition (ICPR), 2010
    • IEEE International Workshop on Multimedia Computing and Communications, 2009, 2010
    • International Symposium on Neural Networks, 2010
    • IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2009, 2010
    • IEEE International Conference on Computer Vision (ICCV), 2009
  • Journal Reviewer (Selected)
    • IEEE Transactions on Pattern Analysis and Machine Intelligence
    • IEEE Transactions on Image Processing
    • International Journal of Computer Vision
    • IEEE Transactions on Circuits and Systems for Video Technology
    • IEEE Transactions on Systems, Man, and Cybernetics - Part B
    • IEEE Transactions on Systems, Man, and Cybernetics - Part C
    • IEEE Transactions on Signal Processing
    • IEEE Transactions on Information Forensics & Security
    • IEEE Transactions on Automation Science & Engineering
    • Data Mining and Knowledge Discovery
    • Pattern Recognition
    • Computer Vision and Image Understanding
    • Image and Vision Computing
    • Pattern Recognition Letter
    • Machine Vision and Applicatioins
    • Pattern Analysis and Applications
    • Journal of Electronic Imaging
    • Neurocomputing
    • Applied Optics
    • Signal Processing
    • Journal of Multimedia
    • International Journal of Image and Graphics
    • Journal of Mathematical Imaging and Vision
    • EURASIP Journal on Image and Video Processing
  • MSc Graduation Panel
    • Delft University of Technology, The Netherlands
    • University of Amsterdam, The Netherlands
    • Eindhoven University of Technology, The Netherlands
  • Student Supervisor,
    • Mirela Popa (PhD), Delft University of Technology, The Netherlands
    • Dian Liu (MSc), Technical University Darmstadt, Germany
    • Fares Alnajar (MSc), University of Amsterdam, The Netherlands
    • Luc Vosters (MSc), Eindhoven University of Technology, The Netherlands
    • Ziyang Yan (MSc), Eindhoven University of Technology, The Netherlands
    • Wei Chen (MSc), Eindhoven University of Technology, The Netherlands
    • Yanlin Geng (MSc), Peking University, China
    • Pierrick Gerenton (MSc), ISTASE Saint Etienne, France
  • Member,
    • British Machine Vision Association (BMVA), 2006-present
    • Institute of Electrical and Electronic Engineers (IEEE), 2005-present

Honors and Awards

  • Chinese Government Award for Outstanding Self-financed Students Abroad, 2007
  • Full Research Studentship, Queen Mary, University of London, 2004-2007
  • British Machine Vision Conference (BMVC2007) Student Bursary, 2007
  • International Travel Grant, the Royal Academy of Engineering, 2005
  • British Machine Vision Conference (BMVC2005) Student Bursary, 2005
  • Excellent Graduate Scholarship, Institute of Automation, Chinese Academy of Sciences, 2003
  • Excellent Graduate Scholarship, the Graduate School, Chinese Academy of Sciences, 2002
  • Admitted to the graduate program with the Entrance Examination waived, USTC, 2001
  • Honor for Most Outstanding Graduate, Anhui Province, 2001
  • Honor for Most Outstanding Graduate, USTC, 2001
  • Award for Outstanding Student Leader, Dept. of Computer Science, USTC, 2001
  • First-Class Scholarship for Outstanding Students, USTC, 2000
  • The Chinese Academy of Sciences (CAS) Scholarship, USTC, 1999
  • The Chen Hsong Industrial Scholarship, USTC, 1998

back to top

Last updated on 1 July 2011.