Object-Oriented Learning (OOL): Perception, Representation, and Reasoning
International Conference on Machine Learning (ICML)
Friday July 17, 2020, Virtual Workshop
Access the virtual workshop page
Better Set Representations For Relational Reasoning
- Qian Huang, Horace He, Abhay Singh, Yan Zhang, Ser-Nam Lim, and Austin R Benson
- PDF · Join Meeting Room · See ICML Portal for password
Recently, there has been a growing interest in incorporating relational reasoning into neural networks. However, existing approaches typically extract objects from inputs through an arbitrary partitioning of the latent space. We demonstrate that these methods do not respect set invariance and thus have fundamental representational limitations. We propose a novel and general network module that resolves this limitation and demonstrate how it naturally induces object decomposition without explicit supervision. As part of this, we insert our module into existing relational reasoning models and see significant performance gains by respecting set invariance.