CGI Keynote 2 – Thursday, July 4
Prof. Bin SHENG – Professor at Department of Computer Science and Engineering, Shanghai Jiao Tong University
Title: REVERIE: An ensemble-based VR sports system employing deep reinforcement learning to combat adolescent obesity
Abstract: Adolescents who are overweight can enhance not just their physical condition but also their mental well-being by engaging in physical activity. Nevertheless, they often encounter numerous obstacles, such as a lack of motivation and skill, low self-esteem, and negative peer pressure. In our investigation, we have developed a cutting-edge virtual reality (VR) sports system tailored for adolescents, known as REVERIE. This system incorporates deep reinforcement learning and is focused on guidance, providing a virtual sports experience. REVERIE comprises three key components: a VR sports environment, VR sports guidance, and VR sports visualization. To ensure a safe VR sports environment, we employ an iterative human-in-the-loop optimization process. We introduce a two-stage, template-and-feedback-based deep reinforcement learning method. In the template stage, the artificial virtual agent acquires fine-grained sports techniques, while in the feedback stage, it is personalized for each participant. To enrich the VR sports visualization, we integrate a sports-oriented immersion enhancement module into REVERIE. Quantitative results demonstrate that REVERIE surpasses current methods, offering superior safety and user experience. This research underscores the potential of VR sports as an innovative sports management approach that benefits overweight adolescents.
Bio : Bin SHENG received his Ph.D. degree in Computer Science and Engineering from The Chinese University of Hong Kong in 2011, and currently is a full Professor at Department of Computer Science and Engineering, Shanghai Jiao Tong University. His research interests include virtual reality，machine learning and medical data analysis. His papers appear in Nature Medicine, Nature Communications, Cell Reports Medicine, Patterns, IEEE TPAMI, TMI, TVCG，TIP and IJCV. He serves as the Managing Editor of The Visual Computer, and serves on the Editorial Board of IEEE TSCVT，The Visual Computer, IET Image Processing and J. of Virtual Reality and Intelligent Hardware. In addition, he served as Program Co-Chair of Computer Graphics International (2020-2022), and Conference Co-Chair of Computer Graphics International (2023-2024) and CASA 2024. He also served as the AI Challenge Co-Chair of DeepDRiD (ISBI2020), DRAC(MICCAI2022) and MMAC(MICCAI2023). He received the Outstanding Contribution Award by Computer Graphics Society in 2023.