Tutorials

The following tutorials have been accepted for presentation at ACM Multimedia Asia 2019:

Monday 16 December 2019
Morning:
Human-centric Visual Understanding (Part I)
Afternoon:
Human-centric Visual Understanding (Part II)
Tutorial on Multimedia Attractiveness Computing


Human-centric Visual Understanding

Time: 2019/12/16 All Day, Location: 301AB

Human-centric visual understanding is one of the fundamental problems of computer vision and multimedia understanding. With the development of deep learning and multi-modalities analysis techniques, researchers have strived to push the limits of human-centric visual understanding in a wide variety of applications, such as intelligent surveillance, retailing, fashion design, and services. This tutorial will present recent advances under the umbrella of human-centric visual understanding, which range from the fundamental problems of face detection and recognition, human face and body pattern analysis, person re- identification, finally to multimedia event analysis and understanding in complex scenarios and industrial applications. We will discuss the key problems, common formulations, existing methodologies, real industrial applications, and future directions in the five topics. Our tutorial views not only come from the research filed, but also combine the real-world requirements and experiences in the industrial community. Therefore, this tutorial will inspire the audiences from the research and industrial community, and facilitate research in computer vision and multimedia for human behavior analysis and human-centric analysis modeling.

Bio: 

Dr. Wu Liu is a Senior Researcher in JD AI Research, China. His current research interests include human behavior analysis and intelligent video surveillance. Prior to joining JD AI Research, he was a lecturer in Beijing University of Posts and Telecommunications from 2015 to 2018. He received his Ph.D. degree from the Institute of Computing Technology, Chinese Academy of Science in 2015. He has published more than 60 papers in prestigious conferences and journals in computer vision and multimedia. He received IEEE T-MM 2019 Prize Paper Award, IEEE Multimedia 2018 Best Paper Award, IEEE ICME 2016 Best Student Paper Award, and Chinese Academy of Sciences Outstanding Ph.D. Thesis Award in 2016, etc. Dr. Liu is the founding member of ACM FCA, and the committee member of IEEE CASS-MSA. He has also served as the guest editor of MTAP and MVA, and the Area Chairs of ACM MM 2019, ICME 2019, ICIP 2017, etc.

Dr. Hailin Shi receives his PhD from Institute of Automation, Chinese Academy of Sciences, under the supervision of Prof. Stan Z. Li. He is currently senior researcher at JD AI, with research interest in the area of face recognition, object detection, semi-supervised learning etc. He makes several works published and provides review services in conferences and journals (CVPR, ICCV, ECCV, AAAI, IJCV) of computer vision and pattern recognition. His team has gained the first place in WIDERFACE challenge 2019, and has applied 18 face-recognition-related patents which are used in JD on-&off-line retailing and campus products.

Dr. Ning Xu is currently an assistant professor with the School of Electrical and Information Engineering, Tianjin University, China. He was a visiting scholar with the SeSaMe Centre of National University of Singapore from 2016 to 2017. His current research interests include visual captioning and visual relationship detection. Various parts of his work have been published in first-tier venues including TIP, TCYB, TCSVT, TMM, IJCAI. Dr. Xu has served as the (leading) guest editors for Information Processing & Management.

Dr. Yinglu Liu is currently an algorithm researcher in Vision and Multimedia Lab at JD AI, Beijing, China. Her research interest includes machine learning and computer vision, with a focus on face alignment, face reconstruction, face parsing, etc. Before coming to JD, she was a senior algorithm engineer in Samsung Research China-Beijing. She received the Ph.D. degree from the Institute of Automation, Chinese Academic of Sciences.

Dr. Lingxiao He is a research scientist in JD AI Research. He received the B.E degree in information Engineer from the Chengdu University of Technology (CDUT), the Ph.D. degree in Computer Sciences from Institute of automation, Chinese Academy of Sciences (CASIA) in 2014, 2019, respectively. He visits Learning and Vision Lab, National University of Singapore (NUS) from September 2018 to May 2019. Since August 2019, Dr. He has joined the JD AI Research as a faculty member. Dr. He’s research areas include biometric, pattern recognition and computer vision, and he has authored/co-authored over 10 technical papers, including TIP, CVPR, ICCV etc..

Prof. An-An Liu is currently a professor in the School of Electronical Information Engineering, Tianjin University, China. He used to be the visiting professor in the Robotics Institute, Carnegie Mellon University and the School of Computing, National University of Singapore. His research interests include computer vision and machine learning. Various parts of his work have been published in first-tier venues including TPAMI, TIP, TCYB, TCSVT, TMI, CVPR, ACM MM, IJCAI. Dr. Liu has served as the (leading) guest editors for IEEE Transactions on Big Data, Journal of Visual Communication and Image Representation, Multimedia Tools and Applications and the reviewers for a rich set of forums, e.g., TIP, TCYB, TMM, TCSVT, TMI. Dr. Liu also serve as the area chair of ACM MM 2019, the chair of CVPR 2017 workshop on Open Domain Action Recognition Challenge and CVPR 2016 workshop on Computer Vision for Microscopy Image Analysis.


Tutorial on Multimedia Attractiveness Computing

Time: 2019/12/16 Afternoon Location: 302AB

This tutorial will focus on attractiveness computing for various types of media contents, such as images/videos, texts/tags, or social attributes. The tutorial will cover the methodology advancement and novel applications on topics including attractiveness prediction and enhancement, social affective/aesthetic analysis, and connections to industry such as creative multimedia advertising in order to inspire participants.

Bio: 

Wen-Huang Cheng (http://aimmlab.nctu.edu.tw/whcheng/index.html): is a Professor with the Institute of Electronics, National Chiao Tung University (NCTU), Hsinchu, Taiwan, where he is the Founding Director with the Artificial Intelligence and Multimedia Laboratory (AIMMLab). Before joining NCTU, he led the Multimedia Computing Research Group at the Research Center for Information Technology Innovation (CITI), Academia Sinica, Taipei, Taiwan, from 2010 to 2018. His current research interests include multimedia, artificial intelligence, computer vision, machine learning, social media, and financial technology. He has actively participated in international events and played important leading roles in prestigious journals and conferences and professional organizations, like Associate Editor for IEEE Multimedia, General co-chair for ACM ICMR (2021), TPC co-chair for ICME (2020), Chair-Elect for IEEE MSA-TC, governing board member for IAPR. He has received numerous research and service awards, including the 2018 MSRA Collaborative Research Award, the 2017 Ta-Yu Wu Memorial Award from Taiwan’s Ministry of Science and Technology (the highest national research honor for young Taiwanese researchers under age 42), the Top 10% Paper Award from the 2015 IEEE MMSP, the K. T. Li Young Researcher Award from the ACM Taipei/Taiwan Chapter in 2014, the 2017 Significant Research Achievements of Academia Sinica, the 2016 Y. Z. Hsu Scientific Paper Award, the Outstanding Youth Electrical Engineer Award from the Chinese Institute of Electrical Engineering in 2015, and the Outstanding Reviewer Award of 2018 IEEE ICME. He is APSIPA Distinguished Lecturer.

Bo Wu (http://bobbywu.com): is currently a research scientist in the Columbia University. He received the Ph.D. degree in Computer Science from Chinese Academy of Science (Institute of Computing Technology) in 2017. He was visiting PhD at Microsoft Research Asia and Academia Sinica during 2015-2017. He has received the ACM Turing 50th Celebration Student Scholarship, Schlumberger PhD Award. His research interests focus on time series forecasting, social multimedia, computer vision and machine learning.

Toshihiko Yamasaki (https://www.hal.t.u-tokyo.ac.jp/~yamasaki ): is currently an Associate Professor at Department of Information and Communication Engineering, The University of Tokyo. He received the Ph.D. degree from The University of Tokyo. He was a JSPS Fellow for Research Abroad and a visiting scientist at Cornell University from Feb. 2011 to Feb. 2013. His current research interests include attractiveness computing based on multimedia big data analysis, pattern recognition, machine learning, etc. Related experience: General Chair, International Workshop on Attractiveness Computing in Multimedia (ACM), 2016, 2017, 2019; Area Chair, ACMMM 2017, 2018.

Xueting Wang ( https://xueting-wang.github.io ): is currently a postdoctoral researcher in the Department of Information and Communication Engineering, the University of Tokyo. She received the M.S. degree and Ph.D. degree in Information Science from Nagoya University, in 2015 and 2018, respectively. She has received the best paper award at ISM2014. Her research interests focus on multimedia processing, video editing and summarization, social media analysis, and recommendation.

Jia Jia (https://hcsi.cs.tsinghua.edu.cn): is a tenured associate professor in Department of Computer Science and Technology, Tsinghua University. She got bachelor degree at Tsinghua University in 2003, and received her Ph.D. degree from Tsinghua University in 2008. Her main research interest is social affective computing and human computer speech interaction. She is serving as the secretary-general of Professional Committee of Speech in Chinese Information Processing Society, the secretary-general of Professional Committee of Speech Processing in China Computer Federation. She has been awarded ACM SIGMM Emerging Leaders (2018), IJCAI Early Career Spotlight (2018), ACM Multimedia Grand Challenge Prize (2012), ACM Multimedia Best Demo Award (2018) and Scientific Progress Prizes from the National Ministry of Education twice (2009, 2016). She has authored about 70 papers in leading conferences and journals including IEEE Transactions on Audio, Speech and Language Processing, IEEE Transaction on Multimedia, IEEE Transactions on Affective Computing, IEEE Transactions on Knowledge & Data Engineering, ACM Multimedia, AAAI, IJCAI, ICASSP, WWW, etc. She also has wide research collaborations with Alibaba, Siemens, MSRA, Huawei, Bosch, Sogou and Tencent, etc.

Kota Yamaguchi (https://sites.google.com/view/kyamagu ): is a research scientist at CyberAgent, Inc. He is currently working on computer vision and machine learning for digital advertisement. He was previously an assistant professor at Tohoku University from 2014 to 2017. He received a Ph.D. degree in Computer Science from Stony Brook University in 2014. He received an MS in 2008 and a BE in 2006, both from University of Tokyo.