Institute of Information Science Academia Sinica
Topic: Learning from multimodal signals for human-centered sensing and interpretation
Speaker: Prof. Chi-Chun (Jeremy) Lee (Department of Electrical Engineering, National Tsing Hua University)
Date: 2019-10-01 (Tue) 10:00 – 12:00
Location: Auditorium106 at IIS new Building
Host: Keh-Yih Su


In this talk, we will present our group's on-going human-centered research, specifically showcasing technical endeavor in tackling challenging human states and traits recognition, learning to represent meaningful multimodal informatics, and integrating heterogeneous data sources. These effort are developed tightly with the domain experts of behavior science, health and medicine, and media industry to ensure its ubiquitous impact. Our goal is to provide scalable, objective, and insight-driven analytics that sense and interpret us humans in advancing decision intelligence.


Chi-Chun Lee (Jeremy) is an Associate Professor at the Department of Electrical Engineering Department of the National Tsing Hua University (NTHU), Taiwan. He received his B.S. degree and Ph.D. degree both in Electrical Engineering under supervision of Prof Shri Narayanan from the University of Southern California, USA in 2007 and 2012. He was a data scientist at id:a lab at ID Analytics in 2013. His research interests are in the behavior computing, affective multimedia, and health analytics. He is an associate editor for IEEE Transcation on Multimedia (2019-2020), and a TPC committee for IVM APSIPA. He serves as an area chair for Interspeech 2016,2018,2019, senior program committee for ACII 2017,2019, ACM ICMI 2018, publicity chair for ACM ICMI 2018, sponsorship chair for ISCSLP 2018, special session chair for ISCSLP 2020, and a guest editor in Journal of Computer Speech and Language on special issue of Speech and Language Processing for Behavioral and Mental Health. He lead a team to the 1st place in Emotion Challenge in Interspeech 2009, and with his students won the 1st place in Styrian Dialect and Baby Sound subchallenge in Interspeech 2019. He is a coauthor on the best paper award in Interspeech 2008 (top 12), Interspeech 2010 (top 3), IEEE EMBC 2018 (top 15), Interspeech 2018 (top 12), IEEE EMBC 2019 (Asia Pacific) and the most cited paper published in 2013 in Journal of Speech Communication on automatic modeling of couples' behaviors during therapeutic sessions. He received the MOST 2018 and 2019 Futuretek Breakthrough Award, MediaTek Geniusforhome Special Prize Award (top 10 team), and the USC Annenberg Fellowship. His team is selected as one of the 40 Taiwan Tech Star to exhibit in 2019 CES Eureka Park. He is a member of Tau Beta Pi, Phi Kappa Phi and Eta Kappa Nu. He is also a member of IEEE and ISCA. He is currently involved in multiple granted interdisciplinary research projects with a focus on modeling human multimodal information using signal processing and machine learning.