Multimodal Pretraining and Generation for Recommendation: A Tutorial 

In conjunction with The Web Conference 2024

Time: May 13, 2024 (1:30 PM - 4:30 PM)

Location: Resorts World Sentosa Convention Centre, Singapore

WWW 2024 Tutorial on "Multimodal Pretraining and Generation for Recommendation"

 

Personalized recommendation stands as a ubiquitous channel for users to explore information or items aligned with their interests. Nevertheless, prevailing recommendation models predominantly rely on unique IDs and categorical features for user-item matching. While this ID-centric approach has witnessed considerable success, it falls short in comprehensively grasping the essence of raw item contents across diverse modalities, such as text, image, audio, and video. This underutilization of multimodal data poses a limitation to recommender systems, particularly in the realm of multimedia services like news, music, and short-video platforms. The recent surge in pretraining and generation techniques presents both opportunities and challenges in the development of multimodal recommender systems.


This tutorial seeks to provide a thorough exploration of the latest advancements and future trajectories in multimodal pretraining and generation techniques within the realm of recommender systems. The tutorial comprises three parts: multimodal pretraining, multimodal generation, and industrial applications and open challenges in the field of recommendation. Our target audience encompasses scholars, practitioners, and other parties interested in this domain. By providing a succinct overview of the field, we aspire to facilitate a swift understanding of multimodal recommendation and foster meaningful discussions on the future development of this evolving landscape.


We welcome researchers, practitioners, and students interested in multimodal recommendation to join us and engage in this exciting tutorial.

Program (UTC+8, Singapore Time)

The program schedule is as follows:

Time Event Speaker
1:30 PM - 1:40 PM Opening Remarks Zhenhua Dong
1:40 PM - 2:00 PM Ten Challenges in Industrial Recommender Systems [slides] Zhenhua Dong
2:00 PM - 2:45 PM Multimodal Pretraining for Recommendation [slides] Jieming Zhu
2:45 PM - 3:00 PM Coffee Break
3:00 PM - 3:45 PM Multimodal Generation for Recommendation [slides] Rui Zhang
3:45 PM - 4:30 PM Industrial Applications and Open Challenges in Multimodal Recommendation [slides] Chuhan Wu

Check out the tutorial videos on Youtube.

Tutorial Speakers

 

Contact

Please contact Jieming Zhu for general inquiries.