Object-Oriented Learning (OOL): Perception, Representation, and Reasoning

International Conference on Machine Learning (ICML)

Friday July 17, 2020, Virtual Workshop

Access the virtual workshop page

Generating Stochastic Object Dynamics in Scenes

Zhixuan Lin, Yi-Fu Wu, Skand Skand, Bofeng Fu, Jindong Jiang, and Sungjin Ahn
PDF · Join Meeting Room · See ICML Portal for password

We introduce Generative Structured World Models (G-SWM), a novel object-centric generative model for videos. G-SWM not only unifies the key properties of previous models in a principled framework but also achieves two crucial new abilities, multimodal uncertainty, and situated behavior. By investigating the generation ability in comparison to previous models, we demonstrate that G-SWM achieves the best or comparable performance for all experiment settings including a few complex settings that have not been tested before. Our project website can be found at https://sites.google.com/view/gswm.