FAST, EXPRESSIVE SE(n) EQUIVARIANT NETWORKS THROUGH WEIGHT-SHARING IN POSITION-ORIENTATION SPACE

Erik J. Bekkers, Sharvaree Vadgama, Rob D. Hesselink, Putri A. van der Linden, David W. Romero

Research output: Contribution to ConferencePaperAcademic

Abstract

Based on the theory of homogeneous spaces we derive geometrically optimal edge attributes to be used within the flexible message-passing framework. We formalize the notion of weight sharing in convolutional networks as the sharing of message functions over point-pairs that should be treated equally. We define equivalence classes of point-pairs that are identical up to a transformation in the group and derive attributes that uniquely identify these classes. Weight sharing is then obtained by conditioning message functions on these attributes. As an application of the theory, we develop an efficient equivariant group convolutional network for processing 3D point clouds. The theory of homogeneous spaces tells us how to do group convolutions with feature maps over the homogeneous space of positions R3, position and orientations R3×S2, and the group SE(3) itself. Among these, R3×S2 is an optimal choice due to the ability to represent directional information, which R3 methods cannot, and it significantly enhances computational efficiency compared to indexing features on the full SE(3) group. We support this claim with state-of-the-art results -in accuracy and speed- on five different benchmarks in 2D and 3D, including interatomic potential energy prediction, trajectory forecasting in N-body systems, and generating molecules via equivariant diffusion models.

Original languageEnglish
Number of pages25
DOIs
Publication statusPublished - 2024
Event12th International Conference on Learning Representations, ICLR 2024 - Hybrid, Vienna, Austria
Duration: 7 May 202411 May 2024

Conference

Conference12th International Conference on Learning Representations, ICLR 2024
Country/TerritoryAustria
CityHybrid, Vienna
Period7/05/2411/05/24

Bibliographical note

Publisher Copyright:
© 2024 12th International Conference on Learning Representations, ICLR 2024. All rights reserved.

Fingerprint

Dive into the research topics of 'FAST, EXPRESSIVE SE(n) EQUIVARIANT NETWORKS THROUGH WEIGHT-SHARING IN POSITION-ORIENTATION SPACE'. Together they form a unique fingerprint.

Cite this