References
Abramson, Josh, Jonas Adler, Jack Dunger, Richard Evans, Tim Green, Alexander
Pritzel, Olaf Ronneberger, Lindsay Willmore, Andrew J Ballard, Joshua Bambrick, et
al. 2024. “Accurate structure prediction of biomolecular interactions with AlphaFold
3.” Nature 630 (8016): 493–500.
Adelson-Velskii, Georgii Maksimovich, Boris Yu Weisfeiler, AA Leman, and Igor
Aleksandrovich Faradzhev. 1969. “An example of a graph which has no transitive group
of automorphisms.” In Doklady Akademii Nauk, 185:975–976. 5.
Ainsworth, Samuel K, Jonathan Hayase, and Siddhartha Srinivasa. 2022. “Git
Re-Basin: Merging Models modulo Permutation Symmetries,” arXiv: 2209.04836
[cs.LG].
Alet, Ferran, Dylan Doblar, Allan Zhou, Josh Tenenbaum, Kenji Kawaguchi, and
Chelsea Finn. 2021. “Noether networks: meta-learning useful conserved quantities.”
Advances in Neural Information Processing Systems 34:16384–16397.
Alon, Uri, and Eran Yahav. 2020. “On the bottleneck of graph neural networks and its
practical implications.” arXiv:2006.05205.
Amari, Sl. 1978. “Feature spaces which admit and detect invariant signal transforma-
tions.” In Joint Conference on Pattern Recognition.
Anderson, Philip W. 1972. “More is different.” Science 177 (4047): 393–396.
Anil, Cem, Yuhuai Wu, Anders Andreassen, Aitor Lewkowycz, Vedant Misra, Vinay
Ramasesh, Ambrose Slone, Guy Gur-Ari, Ethan Dyer, and Behnam Neyshabur. 2022.
“Exploring length generalization in large language models.” Advances in Neural
Information Processing Systems 35:38546–38556.
Arnold, Vladimir I. 1957. “On functions of three variables.” Dokl. Akad. Nauk SSSR.
Aroyo, Mois I. 2017. International Tables for Crystallography, Space-group Symmetry.
Wiley.
Azabou, Mehdi, Venkataramana Ganesh, Shantanu Thakoor, Chi-Heng Lin, Lakshmi
Sathidevi, Ran Liu, Michal Valko, Petar Veli
ˇ
ckovi
´
c, and Eva L Dyer. 2023. “Half-hop:
A graph upsampling approach for slowing down message passing.” In International
Conference on Machine Learning, 1341–1360. PMLR.
292 References
Azulay, Aharon, and Yair Weiss. 2019. “Why do deep convolutional networks gener-
alize so poorly to small image transformations?” J. Mach. Learn. Res. 20 (184): 1–
25.
Ba, Jimmy Lei, Jamie Ryan Kiros, and Geoffrey E Hinton. 2016. “Layer normaliza-
tion.” arXiv:1607.06450.
Babai, László. 2016. “Graph isomorphism in quasipolynomial time.” In Proceedings of
the forty-eighth annual ACM symposium on Theory of Computing, 684–697.
Bach, Francis. 2017a. “Breaking the curse of dimensionality with convex neural
networks.” JMLR 18 (1): 629–681.
Bach, Francis. 2017b. “On the equivalence between kernel quadrature rules and random
feature expansions.” Journal of machine learning research 18 (21): 1–38.
Bach, Francis. 2024. Learning theory from first principles. MIT press.
Baek, Minkyung, Frank DiMaio, Ivan Anishchenko, Justas Dauparas, Sergey Ovchin-
nikov, Gyu Rie Lee, Jue Wang, Qian Cong, Lisa N Kinch, R Dustin Schaeffer, et al.
2021. “Accurate prediction of protein structures and interactions using a three-track
neural network.” Science 373 (6557): 871–876.
Ball, Philip. 2011. “In retrospect: On the six-cornered snowflake.” Nature 480 (7378):
455–455.
Bamberger, Jacob, Federico Barbero, Xiaowen Dong, and Michael M Bronstein.
2024. “Bundle Neural Networks for message diffusion on graphs.” arXiv preprint
arXiv:2405.15540.
Bamieh, Bassam. 2018. “Discovering Transforms: A Tutorial on Circulant Matrices,
Circular Convolution, and the Discrete Fourier Transform.” arXiv:1805.05533.
Banach, Stefan. 1922. “Sur les opérations dans les ensembles abstraits et leur applica-
tion aux équations intégrales.” Fundamenta Mathematicae 3 (1): 133–181.
Barbero, Federico, Alvaro Arroyo, Xiangming Gu, Christos Perivolaropoulos, Petar
Veli
ˇ
ckovi
´
c, Razvan Pascanu, and Michael M. Bronstein. 2025. “Why do LLMs attend
to the first token?” In Second Conference on Language Modeling. https://openreview
.net/forum?id=tu4dFUsW5z.
Barbero, Federico, Andrea Banino, Steven Kapturowski, Dharshan Kumaran, João
Madeira Araújo, Oleksandr Vitvitskyi, Razvan Pascanu, and Petar Veli
ˇ
ckovi
´
c. 2024.
“Transformers need glasses! information over-squashing in language tasks.” Advances
in Neural Information Processing Systems 37:98111–98142.
Barron, Andrew R. 1993. “Universal approximation bounds for superpositions of a
sigmoidal function.” IEEE Transactions on Information theory 39 (3): 930–945.
Bartók, Albert P, Risi Kondor, and Gábor Csányi. 2013. “On representing chemical
environments.” Physical Review B—Condensed Matter and Materials Physics 87 (18):
184115.
Bartunov, Sergey, Fabian B Fuchs, and Timothy P Lillicrap. 2022. “Equilibrium aggre-
gation: Encoding sets via optimization.” In Uncertainty in Artificial Intelligence, 139–
149. PMLR.
References 293
Baskin, Igor I, Vladimir A Palyulin, and Nikolai S Zefirov. 1997. “A neural device
for searching direct correlations between structures and properties of chemical com-
pounds.” J. Chemical Information and Computer Sciences 37 (4): 715–721.
Battaglia, Peter, Razvan Pascanu, Matthew Lai, Danilo Jimenez Rezende, et al. 2016.
“Interaction networks for learning about objects, relations and physics.” Advances in
neural information processing systems 29.
Battaglia, Peter W, Jessica B Hamrick, Victor Bapst, Alvaro Sanchez-Gonzalez, Vini-
cius Zambaldi, Mateusz Malinowski, Andrea Tacchetti, David Raposo, Adam Santoro,
Ryan Faulkner, et al. 2018. “Relational inductive biases, deep learning, and graph
networks.” arXiv:1806.01261.
Baum, Eric, and David Haussler. 1988. “What size net gives valid generalization?”
Advances in neural information processing systems 1.
Beaini, Dominique, Saro Passaro, Vincent Létourneau, Will Hamilton, Gabriele Corso,
and Pietro Liò. 2021. “Directional graph networks.” In International Conference on
Machine Learning, 748–758. PMLR.
Behboodi, Arash, Gabriele Cesa, and Taco Cohen. 2022. “A PAC-Bayesian Generaliza-
tion Bound for Equivariant Networks.” In Advances in Neural Information Processing
Systems.
Belkin, Mikhail, Daniel Hsu, Siyuan Ma, and Soumik Mandal. 2019. “Reconciling
modern machine-learning practice and the classical bias–variance trade-off.” Proceed-
ings of the National Academy of Sciences 116 (32): 15849–15854.
Bellman, Richard. 1957. Dynamic Programming. Princeton University Press.
Bellman, Richard. 1958. “On a routing problem.” Quarterly of applied mathematics 16
(1): 87–90.
Bengio, Yoshua, Patrice Simard, and Paolo Frasconi. 1994. “Learning long-term depen-
dencies with gradient descent is difficult.” IEEE Trans. Neural Networks 5 (2): 157–
166.
Benton, Gregory, Marc Finzi, Pavel Izmailov, and Andrew G Wilson. 2020. “Learning
invariances in neural networks from training data.” Advances in neural information
processing systems 33:17605–17616.
Berger, Marcel. 2012. A panoramic view of Riemannian geometry. Springer.
Bevilacqua, Beatrice, Fabrizio Frasca, Derek Lim, Balasubramaniam Srinivasan, Chen
Cai, Gopinath Balamurugan, Michael M Bronstein, and Haggai Maron. 2021. “Equiv-
ariant subgraph aggregation networks.” arXiv preprint arXiv:2110.02910.
Bietti, Alberto, Luca Venturi, and Joan Bruna. 2021. “On the sample complexity of
learning under geometric stability.” Advances in neural information processing systems
34:18673–18684.
Bishop, Christopher M, and H Bishop. 2024. Deep Learning: Foundations and
Concepts. Springer.
294 References
Blanc, Guy, Neha Gupta, Gregory Valiant, and Paul Valiant. 2020. “Implicit regu-
larization for deep neural networks driven by an ornstein-uhlenbeck like process.” In
COLT.
Block, HD. 1970. “A review of “perceptrons: An introduction to computational
geometry”.” Information and Control 17 (5): 501–522.
Bodnar, Cristian, Francesco Di Giovanni, Benjamin Chamberlain, Pietro Lio, and
Michael Bronstein. 2022. “Neural sheaf diffusion: A topological perspective on het-
erophily and oversmoothing in gnns.” Advances in Neural Information Processing
Systems 35:18527–18541.
Bodnar, Cristian, Fabrizio Frasca, Nina Otter, Yuguang Wang, Pietro Lio, Guido
F Montufar, and Michael Bronstein. 2021. “Weisfeiler and lehman go cellular: Cw
networks.” Advances in neural information processing systems 34:2625–2640.
Bodnar, Cristian, Fabrizio Frasca, Yuguang Wang, Nina Otter, Guido F Montufar, Pietro
Lio, and Michael Bronstein. 2021. “Weisfeiler and lehman go topological: Message
passing simplicial networks.” In International conference on machine learning, 1026–
1037. PMLR.
Bojchevski, Aleksandar, Johannes Gasteiger, Bryan Perozzi, Amol Kapoor, Martin
Blais, Benedek Rózemberczki, Michal Lukasik, and Stephan Günnemann. 2020. “Scal-
ing graph neural networks with approximate pagerank.” In Proceedings of the 26th
ACM SIGKDD international conference on knowledge discovery & data mining, 2464–
2473.
Bollobás, Béla. 1998. Modern graph theory. Vol. 184. Springer Science & Business
Media.
Borde, Haitz Sáez de Ocáriz, and Michael Bronstein. 2025. “Mathematical Foundations
of Geometric Deep Learning.” arXiv preprint arXiv:2508.02723.
Borisyuk, Fedor, Shihai He, Yunbo Ouyang, Morteza Ramezani, Peng Du, Xiaochen
Hou, Chengming Jiang, Nitin Pasumarthy, Priya Bannur, Birjodh Tiwana, et al. 2024.
“Lignn: Graph neural networks at linkedin.” In Proceedings of the 30th ACM SIGKDD
Conference on Knowledge Discovery and Data Mining, 4793–4803.
Borsuk, Karol. 1933. “Drei Sätze über die n-dimensionale euklidische Sphäre.” Funda-
menta Mathematicae 20 (1): 177–190.
Boscaini, Davide, Jonathan Masci, Emanuele Rodolà, and Michael Bronstein. 2016.
“Learning shape correspondence with anisotropic convolutional neural networks.” In
NIPS.
Boscaini, Davide, Jonathan Masci, Emanuele Rodolà, Michael M Bronstein, and Daniel
Cremers. 2016. “Anisotropic diffusion descriptors.” Computer Graphics Forum 35 (2):
431–441.
Bottman, Nathaniel, Yinhong Liu, and Kyle Richardson. 2026. “Operadic consis-
tency: a label-free signal for compositional reasoning failures in LLMs.” arXiv preprint
arXiv:2606.13649.
Bottou, Léon, and Olivier Bousquet. 2007. “The tradeoffs of large scale learning.”
Advances in neural information processing systems 20.
References 295
Bougleux, Sébastien, Luc Brun, Vincenzo Carletti, Pasquale Foggia, Benoit Gaüzere,
and Mario Vento. 2015. “A quadratic assignment formulation of the graph edit
distance.” arXiv:1512.07494.
Bouritsas, Giorgos, Fabrizio Frasca, Stefanos Zafeiriou, and Michael M Bronstein.
2022. “Improving graph neural network expressivity via subgraph isomorphism count-
ing.” IEEE Transactions on Pattern Analysis and Machine Intelligence 45 (1): 657–
668.
Brannan, David A, Matthew F Esplen, and Jeremy J Gray. 2011. Geometry. Cambridge
university press.
Brehmer, Johann, Sönke Behrends, Pim De Haan, and Taco Cohen. 2025. “Does
equivariance matter at scale?” Transactions on Machine Learning Research, ISSN:
2835-8856. https://openreview.net/forum?id=wilNute8Tn.
Brody, Shaked, Uri Alon, and Eran Yahav. 2022. “How Attentive are Graph Attention
Networks?” In International Conference on Learning Representations. https://openrev
iew.net/forum?id=F72ximsx7C1.
Bronstein, Michael M, Joan Bruna, Yann LeCun, Arthur Szlam, and Pierre Van-
dergheynst. 2017. “Geometric deep learning: going beyond euclidean data.” IEEE
Signal Processing Magazine 34 (4): 18–42.
Bronstein, Michael M., Joan Bruna, Taco Cohen, and Petar Veli
ˇ
ckovi
´
c. 2021. “Geo-
metric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges.” arXiv preprint
arXiv:2104.13478.
Bruckner, Andrew M, Judith B Bruckner, and Brian S Thomson. 2008. Real analysis.
Classical Real Analysis.
Bruna, Joan, Wojciech Zaremba, Arthur Szlam, and Yann LeCun. 2013. “Spectral
networks and locally connected networks on graphs.” In ICLR.
Carroll and Dickinson. 1989. “Construction of neural nets using the Radon transform.”
In International 1989 joint conference on neural networks, 607–611. IEEE.
Carter, Nathan. 2021. Visual group theory. Vol. 32. American Mathematical Soc.
Cesa, Gabriele, Leon Lang, and Maurice Weiler. 2022. “A Program to Build E(N)-
Equivariant Steerable CNNs.” In International Conference on Learning Representa-
tions. https://openreview.net/forum?id=WE4qe9xlnQw.
Chanussot, Lowik, Abhishek Das, Siddharth Goyal, Thibaut Lavril, Muhammed
Shuaibi, Morgane Riviere, Kevin Tran, Javier Heras-Domingo, Caleb Ho, Weihua Hu,
et al. 2021. “Open catalyst 2020 (OC20) dataset and community challenges.” Acs
Catalysis 11 (10): 6059–6072.
Chen, Caroline, Sayna Ebrahimi, Fedor Kitashov, Ming-Hsuan Yang, Leonidas Guibas,
Viorica P
˘
atr
˘
aucean, and Maks Ovsjanikov. 2026. “SeeSE3: Emergence of 3D Space in
Vision Features.” arXiv preprint arXiv:2607.14228.
Chen, Ricky TQ, Yulia Rubanova, Jesse Bettencourt, and David Duvenaud. 2018.
“Neural ordinary differential equations.” arXiv:1806.07366.
296 References
Chen, Ting, Simon Kornblith, Mohammad Norouzi, and Geoffrey Hinton. 2020. “A
simple framework for contrastive learning of visual representations.” In ICML.
Chiang, Wei-Lin, Xuanqing Liu, Si Si, Yang Li, Samy Bengio, and Cho-Jui Hsieh.
2019. “Cluster-gcn: An efficient algorithm for training deep and large graph convolu-
tional networks.” In Proceedings of the 25th ACM SIGKDD international conference
on knowledge discovery & data mining, 257–266.
Chizat, Lenaic, Edouard Oyallon, and Francis Bach. 2019. “On lazy training in
differentiable programming.” Advances in neural information processing systems 32.
Cho, Kyunghyun, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi
Bougares, Holger Schwenk, and Yoshua Bengio. 2014. “Learning phrase representa-
tions using RNN encoder-decoder for statistical machine translation.” arXiv:1406.1078.
Cho, Youngmin, and Lawrence Saul. 2009. “Kernel methods for deep learning.”
Advances in neural information processing systems 22.
Chung, Fan RK, and Fan Chung Graham. 1997. Spectral graph theory. Vol. 92.
American Mathematical Society.
Chung, Junyoung, Caglar Gulcehre, Kyunghyun Cho, and Yoshua Bengio. 2014.
“Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling”
(December). arXiv: 1412.3555 [cs.NE].
Ciresan, Dan C, Ueli Meier, Jonathan Masci, and Jürgen Schmidhuber. 2012. “Multi-
column deep neural network for traffic sign classification.” Neural Networks 32 (1):
333–338.
Cire¸san, Dan Claudiu, Ueli Meier, Luca Maria Gambardella, and Jürgen Schmidhu-
ber. 2010. “Deep, big, simple neural nets for handwritten digit recognition.” Neural
Computation 22 (12): 3207–3220.
Cohen, Taco, Maurice Weiler, Berkay Kicanaoglu, and Max Welling. 2019. “Gauge
equivariant convolutional networks and the icosahedral CNN.” In ICML.
Cohen, Taco, and Max Welling. 2016. “Group Equivariant Convolutional Networks.”
In Proceedings of The 33rd International Conference on Machine Learning, edited
by Maria Florina Balcan and Kilian Q. Weinberger, 48:2990–2999. Proceedings of
Machine Learning Research. New York, New York, USA: PMLR. https://proceedings
.mlr.press/v48/cohenc16.html.
Cohen, Taco S, Mario Geiger, Jonas Köhler, and Max Welling. 2018. “Spherical cnns.”
arXiv:1801.10130.
Cohen, Taco S, Mario Geiger, and Maurice Weiler. 2019. “A General Theory of Equiv-
ariant CNNs on Homogeneous Spaces.” In Advances in Neural Information Processing
Systems, edited by H. Wallach, H. Larochelle, A. Beygelzimer, F. d’Alché-Buc, E. Fox,
and R. Garnett, vol. 32. Curran Associates, Inc. https://proceedings.neurips.cc/paper
_files/paper/2019/file/b9cfe8b6042cf759dc4c0cccb27a6737-Paper.pdf.
Cohen, Taco S., and Max Welling. 2017. “Steerable CNNs.” In International Confer-
ence on Learning Representations. https://openreview.net/forum?id=rJQKYt5ll.
Cooijmans, Tim, Nicolas Ballas, César Laurent, Ça
˘
glar Gülçehre, and Aaron Courville.
2016. “Recurrent batch normalization.” arXiv:1603.09025.
References 297
Corso, Gabriele, Luca Cavalleri, Dominique Beaini, Pietro Liò, and Petar Veli
ˇ
ckovi
´
c.
2020. “Principal neighbourhood aggregation for graph nets.” Advances in neural
information processing systems 33:13260–13271.
Cybenko, George. 1989. “Approximation by superpositions of a sigmoidal function.”
Mathematics of Control, Signals and Systems 2 (4): 303–314.
Dai, Hanjun, Bo Dai, and Le Song. 2016. “Discriminative embeddings of latent variable
models for structured data.” In International conference on machine learning, 2702–
2711. PMLR.
Dauparas, Justas, Ivan Anishchenko, Nathaniel Bennett, Hua Bai, Robert J Ragotte,
Lukas F Milles, Basile IM Wicky, Alexis Courbet, Rob J de Haas, Neville Bethel, et
al. 2022. “Robust deep learning–based protein sequence design using ProteinMPNN.”
Science 378 (6615): 49–56.
de Haan, Pim, Taco Cohen, and Max Welling. 2020. “Natural graph networks.”
Advances in neural information processing systems 33:3636–3646.
de Haan, Pim, Maurice Weiler, Taco Cohen, and Max Welling. 2020. “Gauge Equivari-
ant Mesh CNNs: Anisotropic convolutions on geometric graphs.” In NeurIPS.
De Nadai, Marco, Francesco Fabbri, Paul Gigioli, Alice Wang, Ang Li, Fabrizio Sil-
vestri, Laura Kim, Shawn Lin, Vladan Radosavljevic, Sandeep Ghael, et al. 2024.
“Personalized audiobook recommendations at spotify through graph neural networks.”
In Companion Proceedings of the ACM Web Conference 2024, 403–412.
Deac, Andreea, Marc Lackenby, and Petar Veli
ˇ
ckovi
´
c. 2022. “Expander Graph Propa-
gation.” In Proceedings of the First Learning on Graphs Conference, edited by Bastian
Rieck and Razvan Pascanu, vol. 198, 38:1–38:18. Proceedings of Machine Learning
Research. PMLR, September. https://proceedings.mlr.press/v198/deac22a.html.
Defferrard, Michaël, Xavier Bresson, and Pierre Vandergheynst. 2016. “Convolutional
neural networks on graphs with fast localized spectral filtering.” NIPS.
Derksen, Harm, and Gregor Kemper. 2002. Computational Invariant Theory. Springer
Berlin Heidelberg.
Derrow-Pinion, Austin, Jennifer She, David Wong, Oliver Lange, Todd Hester, Luis
Perez, Marc Nunkesser, Seongjae Lee, Xueying Guo, Brett Wiltshire, et al. 2021. “Eta
prediction with graph neural networks in google maps.” In Proceedings of the 30th ACM
International Conference on Information & Knowledge Management, 3767–3776.
Desargues, Girard. 1643. Pratique du trait a preuves.
Devlin, Jacob, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. “Bert: Pre-
training of deep bidirectional transformers for language understanding.” In Proceedings
of the 2019 conference of the North American chapter of the association for computa-
tional linguistics: human language technologies, volume 1 (long and short papers),
4171–4186.
Di Giovanni, Francesco, T. Konstantin Rusch, Michael Bronstein, Andreea Deac, Marc
Lackenby, Siddhartha Mishra, and Petar Veli
ˇ
ckovi
´
c. 2024. “How does over-squashing
affect the power of GNNs?” Transactions on Machine Learning Research, ISSN: 2835-
8856. https://openreview.net/forum?id=KJRoQvRWNs.
298 References
Dieleman, Sander, Jeffrey De Fauw, and Koray Kavukcuoglu. 2016. “Exploiting Cyclic
Symmetry in Convolutional Neural Networks.” In Proceedings of The 33rd Interna-
tional Conference on Machine Learning, edited by Maria Florina Balcan and Kilian
Q. Weinberger, 48:1889–1898. Proceedings of Machine Learning Research. New York,
New York, USA: PMLR. https://proceedings.mlr.press/v48/dieleman16.html.
Do Carmo, Manfredo P. 2016. Differential geometry of curves and surfaces: revised
and updated second edition. Courier Dover Publications.
Dudzik, Andrew Joseph, Tamara von Glehn, Razvan Pascanu, and Petar Veli
ˇ
ckovi
´
c.
2024. “Asynchronous algorithmic alignment with cocycles.” In Learning on Graphs
Conference, 3–1. PMLR.
Dupont, Emilien, Miguel Bautista Martin, Alex Colburn, Aditya Sankar, Josh Susskind,
and Qi Shan. 2020. “Equivariant neural rendering.” In International Conference on
Machine Learning, 2761–2770. PMLR.
Duval, Alexandre, Simon V Mathis, Chaitanya K Joshi, Victor Schmidt, Santiago Miret,
Fragkiskos D Malliaros, Taco Cohen, Pietro Lio, Yoshua Bengio, and Michael Bron-
stein. 2023. “A hitchhiker’s guide to geometric gnns for 3d atomic systems.” arXiv
preprint arXiv:2312.07511.
Duvenaud, David K, Dougal Maclaurin, Jorge Iparraguirre, Rafael Bombarell, Timothy
Hirzel, Alán Aspuru-Guzik, and Ryan P Adams. 2015. “Convolutional networks on
graphs for learning molecular fingerprints.” NIPS.
Dwivedi, Vijay Prakash, and Xavier Bresson. 2020. “A Generalization of Transformer
Networks to Graphs.” arXiv:2012.09699.
Dwivedi, Vijay Prakash, Anh Tuan Luu, Thomas Laurent, Yoshua Bengio, and Xavier
Bresson. 2021. “Graph neural networks with learnable structural and positional repre-
sentations.” arXiv preprint arXiv:2110.07875.
Dym, Nadav, and Haggai Maron. 2021. “On the Universality of Rotation Equivariant
Point Cloud Networks.” In International Conference on Learning Representations. htt
ps://openreview.net/forum?id=6NFBvWlRXaG.
Eilenberg, Samuel, and Saunders MacLane. 1945. “General theory of natural equiva-
lences.” Transactions of the american mathematical society 58 (2): 231–294.
Elesedy, Bryn, and Sheheryar Zaidi. 2021. “Provably Strict Generalisation Benefit
for Equivariant Models.” In Proceedings of the International Conference on Machine
Learning.
Elhag, Ahmed A. A., T. Konstantin Rusch, Francesco Di Giovanni, and Michael
M. Bronstein. 2025. “Relaxed Equivariance via Multitask Learning.” In The Fourth
Learning on Graphs Conference. https://openreview.net/forum?id=xrzYdsIv3f.
Elhage, Nelson, Neel Nanda, Catherine Olsson, Tom Henighan, Nicholas Joseph,
Ben Mann, Amanda Askell, Yuntao Bai, Anna Chen, Tom Conerly, et al. 2021. “A
mathematical framework for transformer circuits.” Transformer Circuits Thread 1 (1):
12.
Elman, Jeffrey L. 1990. “Finding structure in time.” Cognitive Science 14 (2): 179–211.
References 299
Erd
˝
os, Paul, and Alfréd Rényi. 1963. “Asymmetric graphs.” Acta Math. Acad. Sci.
Hungar 14 (295-315): 3.
Etingof, Pavel, Oleg Golberg, Sebastian Hensel, Tiankai Liu, and Alex Schwendner.
2011. Introduction to Representation Theory. Providence, R.I: American Mathematical
Society.
Faber, Lukas, and Roger Wattenhofer. 2024. “Gwac: Gnns with asynchronous commu-
nication.” In Learning on Graphs Conference, 8–1. PMLR.
Faber, Richard L. 1983. Foundations of Euclidean and non-Euclidean geometry.
Dekker.
Falorsi, Luca, Pim De Haan, Tim R Davidson, Nicola De Cao, Maurice Weiler,
Patrick Forré, and Taco S Cohen. 2018. “Explorations in homeomorphic variational
auto-encoding.” arXiv preprint arXiv:1807.04689.
Ferludin, Oleksandr, Arno Eigenwillig, Martin Blais, Dustin Zelle, Jan Pfeifer, Alvaro
Sanchez-Gonzalez, Wai Lok Sibon Li, Sami Abu-El-Haija, Peter Battaglia, Neslihan
Bulut, et al. 2022. “Tf-gnn: Graph neural networks in tensorflow.” arXiv preprint
arXiv:2207.03522.
Finkelshtein, Ben, Xingyue Huang, Michael M. Bronstein, and Ismail Ilkan Cey-
lan. 2024. “Cooperative Graph Neural Networks.” In Proceedings of the 41st Inter-
national Conference on Machine Learning, edited by Ruslan Salakhutdinov, Zico
Kolter, Katherine Heller, Adrian Weller, Nuria Oliver, Jonathan Scarlett, and Felix
Berkenkamp, 235:13633–13659. Proceedings of Machine Learning Research. PMLR.
https://proceedings.mlr.press/v235/finkelshtein24a.html.
Finzi, Marc, Gregory Benton, and Andrew G Wilson. 2021. “Residual pathway priors
for soft equivariance constraints.” Advances in Neural Information Processing Systems
34:30037–30049.
Finzi, Marc, Samuel Stanton, Pavel Izmailov, and Andrew Gordon Wilson. 2020. “Gen-
eralizing Convolutional Neural Networks for Equivariance to Lie Groups on Arbitrary
Continuous Data.” In Proceedings of the 37th International Conference on Machine
Learning, edited by Hal Daumé III and Aarti Singh, 119:3165–3176. Proceedings of
Machine Learning Research. PMLR. https://proceedings.mlr.press/v119/finzi20a.html.
Folland, Gerald B. 1989. Harmonic analysis in phase space. 122. Princeton university
press.
Fong, Brendan, and David I. Spivak. 2019. An Invitation to Applied Category The-
ory: Seven Sketches in Compositionality. Cambridge University Press. ISBN: 978-
1108482295. https://www.cambridge.org/core/books/an-invitation-to-applied-category
-theory/D4C5E5C2B019B2F9B8CE9A4E9E84D6BC.
Frasconi, Paolo, Marco Gori, and Alessandro Sperduti. 1998. “A general framework for
adaptive processing of data structures.” IEEE Trans. Neural Networks 9 (5): 768–786.
Fuchs, Fabian B, Daniel E Worrall, Volker Fischer, and Max Welling. 2020. “SE(3)-
transformers: 3D roto-translation equivariant attention networks.” arXiv:2006.10503.
Fuchs, Fabian Bernd, and Petar Veli
ˇ
ckovi
´
c. 2023. “Universality of neural networks on
sets and graphs.” In The Second Blogpost Track at ICLR 2023.
300 References
Fukushima, Kunihiko. 1969. “Visual feature extraction by a multilayered network of
analog threshold elements.” IEEE Transactions on Systems Science and Cybernetics 5
(4): 322–333.
Fukushima, Kunihiko. 1975. “Cognitron: a self-organizing multilayered neural net-
work.” Biological Cybernetics volume 20:121–136.
Fukushima, Kunihiko. 1980. “Neocognitron: A self-organizing neural network model
for a mechanism of pattern recognition unaffected by shift in position.” Biological
Cybernetics volume 36:196–202.
Funahashi, Ken-Ichi. 1989. “On the approximate realization of continuous mappings
by neural networks.” Neural networks 2 (3): 183–192.
Galkin, Mikhail, Xinyu Yuan, Hesham Mostafa, Jian Tang, and Zhaocheng Zhu.
2024. “Towards foundation models for knowledge graph reasoning.” In International
Conference on Learning Representations, 2024:31598–31619.
Gama, Fernando, Alejandro Ribeiro, and Joan Bruna. 2019. “Diffusion Scattering
Transforms on Graphs.” In ICLR.
Gasteiger, Johannes, Janek Groß, and Stephan Günnemann. 2020. “Directional mes-
sage passing for molecular graphs.” arXiv preprint arXiv:2003.03123.
Gasteiger, Johannes, Stefan Weißenberger, and Stephan Günnemann. 2019. “Diffusion
improves graph learning.” arXiv preprint arXiv:1911.05485.
Gaubert, Stéphane, and Yiannis Vlassopoulos. 2024. “Directed Metric Structures
arising in Large Language Models.” arXiv preprint arXiv:2405.12264.
Gavranovi
´
c, Bruno. 2024. “Fundamental components of deep learning: A category-
theoretic approach.” arXiv preprint arXiv:2403.13001.
Gavranovi
´
c, Bruno, Paul Lessard, Andrew Joseph Dudzik, Tamara von Glehn, João
Guilherme Madeira Araújo, and Petar Veli
ˇ
ckovi
´
c. 2024. “Position: Categorical Deep
Learning is an Algebraic Theory of All Architectures.” In Forty-first International
Conference on Machine Learning. https://openreview.net/forum?id=EIcxV7T0Sy.
Geiger, Mario, and Tess Smidt. 2022a. e3nn: Euclidean Neural Networks. https://doi
.org/10.48550/ARXIV.2207.09453. https://arxiv.org/abs/2207.09453.
Geiger, Mario, and Tess Smidt. 2022b. “e3nn: Euclidean neural networks.” arXiv
preprint arXiv:2207.09453.
Geiger, Mario, Tess Smidt, Alby M., Benjamin Kurt Miller, Wouter Boomsma, Bradley
Dice, Kostiantyn Lapchevskyi, et al. 2022. Euclidean neural networks: e3nn. V. 0.5.0,
April. https://doi.org/10.5281/zenodo.6459381. https://doi.org/10.5281/zenodo.64593
81.
Geman, Stuart, and Donald Geman. 1984. “Stochastic Relaxation, Gibbs Distributions,
and the Bayesian Restoration of Images.” IEEE Transactions on Pattern Analysis and
Machine Intelligence PAMI-6 (6): 721–741. https://doi.org/10.1109/TPAMI.1984.476
7596.
References 301
Gers, Felix A, and E Schmidhuber. 2001. “LSTM recurrent networks learn simple
context-free and context-sensitive languages.” IEEE Trans. Neural Networks 12 (6):
1333–1340.
Gers, Felix A, and Jürgen Schmidhuber. 2000. “Recurrent nets that time and count.” In
IJCNN.
Gilmer, Justin, Samuel S Schoenholz, Patrick F Riley, Oriol Vinyals, and George E
Dahl. 2017. “Neural message passing for quantum chemistry.” arXiv:1704.01212.
Goller, Christoph, and Andreas Kuchler. 1996. “Learning task-dependent distributed
representations by backpropagation through structure.” In ICNN.
Goodman, Roe, and Nolan R Wallach. 2009. Symmetry, Representations, and Invari-
ants. Vol. 255. Graduate Texts in Mathematics. New York, NY: Springer New
York.
Gordon, M, CE Kendall, and WHT Davison. 1948. Chemical Ciphering: a Universal
Code as an Aid to Chemical Systematics. The Royal Institute of Chemistry.
Gori, Marco, Gabriele Monfardini, and Franco Scarselli. 2005. “A new model for
learning in graph domains.” In IJCNN.
Graham, Ian. 2024. How to Win the Premier League: The Sunday Times Bestselling
Inside Story of Football’s Data Revolution. Random House.
Graves, Alex. 2013. “Generating sequences with recurrent neural networks.”
arXiv:1308.0850.
Graves, Alex, Douglas Eck, Nicole Beringer, and Juergen Schmidhuber. 2004. “Biolog-
ically plausible speech recognition with LSTM neural nets.” In International Workshop
on Biologically Inspired Approaches to Advanced Information Technology, 127–136.
Grill, Jean-Bastien, Florian Strub, Florent Altché, Corentin Tallec, Pierre H Richemond,
Elena Buchatskaya, Carl Doersch, Bernardo Avila Pires, Zhaohan Daniel Guo, Moham-
mad Gheshlaghi Azar, et al. 2020. “Bootstrap your own latent: A new approach to
self-supervised learning.” arXiv:2006.07733.
Gromov, Mikhael. 1981. Structures métriques pour les variétés riemanniennes. Cedic.
Gross, Charles G. 2002. “Genealogy of the “grandmother cell”.” The Neuroscientist 8
(5): 512–518.
Gunasekar, Suriya, Blake E Woodworth, Srinadh Bhojanapalli, Behnam Neyshabur,
and Nati Srebro. 2017. “Implicit regularization in matrix factorization.” In NIPS.
Ha, David, Andrew M. Dai, and Quoc V. Le. 2017. “HyperNetworks.” In International
Conference on Learning Representations. https://openreview.net/forum?id=rkpACe1lx
.
Hamilton, Will, Zhitao Ying, and Jure Leskovec. 2017. “Inductive representation
learning on large graphs.” Advances in neural information processing systems 30.
Hamilton, William L. 2020. Graph representation learning. Morgan & Claypool
Publishers.
302 References
Hao, Junheng, Tong Zhao, Jin Li, Xin Luna Dong, Christos Faloutsos, Yizhou Sun,
and Wei Wang. 2020. “P-companion: A principled framework for diversified com-
plementary product recommendation.” In Proceedings of the 29th ACM International
Conference on Information & Knowledge Management, 2517–2524.
Hardt, Moritz, and Tengyu Ma. 2016. “Identity matters in deep learning.”
arXiv:1611.04231.
Hartley, R. I., and A. Zisserman. 2004. Multiple View Geometry in Computer Vision.
Second. Cambridge University Press, ISBN: 0521540518.
Hashemi, Baran, Kurt Pasque, Chris Teska, and Ruriko Yoshida. 2025. “Tropical
Attention: Neural Algorithmic Reasoning for Combinatorial Algorithms.” In Advances
in Neural Information Processing Systems, edited by D. Belgrave, C. Zhang, H.
Lin, R. Pascanu, P. Koniusz, M. Ghassemi, and N. Chen, vol. 38, Main Confer-
ence, 98631–98656. Curran Associates, Inc. https : //doi.org/10.52202/085713-3295.
https : //proceedings.neurips.cc/paper_files/paper/2025/file/8e0be7875ffe7dcfea07e35c
79e1a923-Paper-Conference.pdf.
He, Kaiming, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. “Deep residual
learning for image recognition.” In CVPR.
Hecht-Nielsen, Robert. 1987. “Kolmogorov’s mapping neural network existence the-
orem.” In Proceedings of the international conference on Neural Networks, 3:11–14.
IEEE press New York, NY, USA.
Helvétius, Claude Adrien. 1759. De l’esprit. Durand.
Hilbert, David. 1890. “Ueber die Theorie der algebraischen Formen.” Math. Ann. 36
(4): 473–534.
Hochreiter, Sepp. 1991. “Untersuchungen zu dynamischen neuronalen Netzen.” PhD
diss., Technische Universität München.
Hochreiter, Sepp, and Jürgen Schmidhuber. 1997. “Long short-term memory.” Neural
Computation 9 (8): 1735–1780.
Hooker, Sara. 2021. “The hardware lottery.” Communications of the ACM 64 (12): 58–
65.
Hopf, Heinz, and Willi Rinow. 1931. “Ueber den Begriff der vollständigen differential-
geometrischen Fläche.” Commentarii Mathematici Helvetici 3 (1): 209–225.
Hornik, Kurt. 1991. “Approximation capabilities of multilayer feedforward networks.”
Neural Networks 4 (2): 251–257.
Hornik, Kurt, Maxwell Stinchcombe, and Halbert White. 1989. “Multilayer feedfor-
ward networks are universal approximators.” Neural networks 2 (5): 359–366.
Hu, Jie, Li Shen, Samuel Albanie, Gang Sun, and Enhua Wu. 2020. “Squeeze-and-
Excitation Networks” [in en]. IEEE Trans. Pattern Anal. Mach. Intell. 42, no. 8
(August): 2011–2023.
Hubel, David H, and Torsten N Wiesel. 1959. “Receptive fields of single neurones in
the cat’s striate cortex.” J. Physiology 148 (3): 574–591.
References 303
Hubel, David H, and Torsten N Wiesel. 1962. “Receptive fields, binocular interaction
and functional architecture in the cat’s visual cortex.” The Journal of Physiology 160
(1): 106.
Ioffe, Sergey, and Christian Szegedy. 2015. “Batch normalization: Accelerating deep
network training by reducing internal covariate shift.” In ICML.
Iqbal, Haris. 2018. “HarisIqbal88/PlotNeuralNet v1.0.0” (December). https ://doi.org
/10.5281/zenodo.2526396. https://doi.org/10.5281/zenodo.2526396.
Ivakhnenko, Aleksey, and Valentin Lapa. 1966. “Cybernetic predicting devices.”
Ivakhnenko, Alexey. 1971. “Polynomial theory of complex systems.” IEEE Transac-
tions on Systems, Man, and Cybernetics, no. 4, 364–378.
Jacot, Arthur, Franck Gabriel, and Clément Hongler. 2018. “Neural tangent kernel:
Convergence and generalization in neural networks.” Advances in neural information
processing systems 31.
Jing, Bowen, Stephan Eismann, Patricia Suriana, Raphael John Lamarre Townshend,
and Ron Dror. 2021. “Learning from Protein Structure with Geometric Vector Percep-
trons.” In International Conference on Learning Representations. https://openreview
.net/forum?id=1YLJDvSx6J4.
Jordan, Michael I. 1986. Serial order: a parallel distributed processing approach.
Technical report. UCSD Institute for Cognitive Science.
Jordan, Michael I. 1997. “Serial order: A parallel distributed processing approach.” In
Advances in Psychology, 121:471–495.
Joshi, Chaitanya. 2020. “Transformers are graph neural networks.” The Gradient.
Joshi, Chaitanya K., Cristian Bodnar, Simon V Mathis, Taco Cohen, and Pietro Lio.
2023. “On the Expressive Power of Geometric Graph Neural Networks.” In Proceed-
ings of the 40th International Conference on Machine Learning, edited by Andreas
Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and
Jonathan Scarlett, 202:15330–15355. Proceedings of Machine Learning Research.
PMLR, 23–29 Jul. https://proceedings.mlr.press/v202/joshi23a.html.
Jozefowicz, Rafal, Wojciech Zaremba, and Ilya Sutskever. 2015. “An empirical
exploration of recurrent network architectures.” In ICML.
Jumper, John, Richard Evans, Alexander Pritzel, Tim Green, Michael Figurnov,
Olaf Ronneberger, Kathryn Tunyasuvunakool, Russ Bates, Augustin Žídek, Anna
Potapenko, et al. 2021. “Highly accurate protein structure prediction with AlphaFold.”
Nature 596 (7873): 583–589.
Kaba, Sékou-Oumar, Arnab Kumar Mondal, Yan Zhang, Yoshua Bengio, and Sia-
mak Ravanbakhsh. 2023. “Equivariance with learned canonicalization functions.” In
International Conference on Machine Learning, 15546–15566. PMLR.
Kaba, Sékou-Oumar, and Siamak Ravanbakhsh. 2022. “Equivariant networks for
crystal structures.” Advances in Neural Information Processing Systems 35:4150–4164.
304 References
Kalchbrenner, Nal, Lasse Espeholt, Karen Simonyan, Aaron van den Oord, Alex
Graves, and Koray Kavukcuoglu. 2016. “Neural machine translation in linear time.”
arXiv:1610.10099.
Karaev, Nikita, Yuri Makarov, Jianyuan Wang, Natalia Neverova, Andrea Vedaldi, and
Christian Rupprecht. 2025. “CoTracker3: Simpler and Better Point Tracking by Pseudo-
Labeling Real Videos.” In 2025 IEEE/CVF International Conference on Computer
Vision (ICCV), 1–10. IEEE.
Karni, Zachi, and Craig Gotsman. 2000. “Spectral compression of mesh geometry.” In
Proc. Computer Graphics and Interactive Techniques.
Karras, Tero, Miika Aittala, Samuli Laine, Erik Härkönen, Janne Hellsten, Jaakko
Lehtinen, and Timo Aila. 2021. “Alias-free generative adversarial networks.” In 35th
Conference on Neural Information Processing Systems.
Kelley, Henry J. 1960. “Gradient theory of optimal flight paths.” Ars Journal 30 (10):
947–954.
Kepler, Johannes. 1611. Strena, Seu De Nive Sexangula.
Kimmel, Ron, and James A Sethian. 1998. “Computing geodesic paths on manifolds.”
PNAS 95 (15): 8431–8435.
Kipf, Thomas N, and Max Welling. 2016. “Semi-supervised classification with graph
convolutional networks.” arXiv:1609.02907.
Kireev, Dmitry B. 1995. “ChemNet: a novel neural network based method for
graph/property mapping.” J. Chemical Information and Computer Sciences 35 (2): 175–
180.
Klein, Felix. 1872. “Vergleichende Betrachtungen über neuere geometrische Forschun-
gen.”
Klein, Felix. 1873. “Über die sogenannte nicht-Euklidische Geometrie.” Mathematis-
che Annalen 6 (2): 112–145.
Knyazev, Boris, Michal Drozdzal, Graham W Taylor, and Adriana Romero Sori-
ano. 2021. “Parameter prediction for unseen deep architectures.” Advances in Neural
Information Processing Systems 34:29433–29448.
Kokkinos, Iasonas, Michael M Bronstein, Roee Litman, and Alex M Bronstein. 2012.
“Intrinsic shape context descriptors for deformable shapes.” In CVPR.
Kolmogorov, A. 1956. “On the representation of continuous functions of several vari-
ables by superpositions of continuous functions of lesser variable count.” In Dokl. Akad.
Nauk SSSR, vol. 108. 2.
Kondor, Risi. 2018. “N-body networks: a covariant hierarchical neural network archi-
tecture for learning atomic potentials.” arXiv preprint arXiv:1803.01588.
Kondor, Risi, Zhen Lin, and Shubhendu Trivedi. 2018. “Clebsch–Gordan Nets: a
Fully Fourier Space Spherical Convolutional Neural Network.” In Neural Information
Processing Systems (NeurIPS).
Konorski, Jerzy. 1967. “Integrative activity of the brain; an interdisciplinary approach.”
References 305
Krizhevsky, Alex, Ilya Sutskever, and Geoffrey E Hinton. 2012. “Imagenet classifica-
tion with deep convolutional neural networks.” In NIPS.
Krüger, Jens, and Rüdiger Westermann. 2005. “Linear algebra operators for GPU
implementation of numerical algorithms.” In ACM SIGGRAPH Courses.
Kunin, Daniel, Javier Sagastuy-Brena, Surya Ganguli, Daniel L K Yamins, and Hide-
nori Tanaka. 2021. “Neural Mechanics: Symmetry and Broken Conservation Laws in
Deep Learning Dynamics.” In International Conference on Learning Representations.
Kurle, Richard, Ralf Herbrich, Tim Januschowski, Yuyang Wang, and Jan Gasthaus.
2022. “On the detrimental effect of invariances in the likelihood for variational
inference” (September). arXiv: 2209.07157 [cs.LG].
Kussul, E, T Baidyk, L Kasatkina, and V Lukovich. 2001. “Rosenblatt perceptrons for
handwritten digit recognition.” In IJCNN.
Lam, Remi, Alvaro Sanchez-Gonzalez, Matthew Willson, Peter Wirnsberger, Meire
Fortunato, Ferran Alet, Suman Ravuri, et al. 2023. “Learning skillful medium-range
global weather forecasting.” Science 382 (6677): 1416–1421. https://doi.org/10.1126
/science.adi2336. eprint: https://www.science.org/doi/pdf/10.1126/science.adi2336. htt
ps://www.science.org/doi/abs/10.1126/science.adi2336.
LeCun, Yann, Bernhard Boser, John S Denker, Donnie Henderson, Richard E Howard,
Wayne Hubbard, and Lawrence D Jackel. 1989. “Backpropagation applied to handwrit-
ten zip code recognition.” Neural computation 1 (4): 541–551.
LeCun, Yann, Léon Bottou, Yoshua Bengio, and Patrick Haffner. 1998. “Gradient-
based learning applied to document recognition.” Proc. IEEE 86 (11): 2278–2324.
Leman, AA. 1970. “On automorphisms of certain classes of graphs.” Avtomatika i
Telemehanika 2:75–82.
Lenc, Karel, and Andrea Vedaldi. 2016. “Learning Covariant Feature Detectors.” In
Computer Vision – ECCV 2016 Workshops, 100–117. Springer International Publish-
ing.
Leshno, Moshe, Vladimir Ya Lin, Allan Pinkus, and Shimon Schocken. 1993. “Multi-
layer feedforward networks with a nonpolynomial activation function can approximate
any function.” Neural networks 6 (6): 861–867.
Levie, Ron, Federico Monti, Xavier Bresson, and Michael M Bronstein. 2018. “Cay-
leynets: Graph convolutional neural networks with complex rational spectral filters.”
IEEE Trans. Signal Processing 67 (1): 97–109.
Lévy, Bruno. 2006. “Laplace-Beltrami eigenfunctions towards an algorithm that
“understands” geometry.” In Proc. Shape Modeling and Applications.
Lewis, Owen, Neil Ghani, Andrew Joseph Dudzik, Christos Perivolaropoulos, Raz-
van Pascanu, and Petar Veli
ˇ
ckovi
´
c. 2025. “Filter Equivariant Functions: A symmet-
ric account of length-general extrapolation on lists.” In Workshop on Differentiable
Learning of Combinatorial Algorithms. https://openreview.net/forum?id=jBzcBqcRhq.
Li, Yujia, Daniel Tarlow, Marc Brockschmidt, and Richard Zemel. 2015. “Gated graph
sequence neural networks.” arXiv:1511.05493.
306 References
Lighthill, James. 1973. “Artificial intelligence: A general survey.” In Artificial Intelli-
gence: a paper symposium, 1–21. Science Research Council London.
Lim, Derek, Haggai Maron, Marc T. Law, Jonathan Lorraine, and James Lucas. 2024.
“Graph Metanetworks for Processing Diverse Neural Architectures.” In The Twelfth
International Conference on Learning Representations. https://openreview.net/forum
?id=ijK5hyxs0n.
Linnainmaa, Seppo. 1970. “ALGORITMIN KUMULATIIVINEN PYÖRISTYSVIRHE.
YKSITTÄISTEN PYÖRISTYSVIRHEIDEN TAYLOR-KEHITELMÄNÄ.” PhD diss.,
University of Helsinki.
Liu, Zhuang, Hanzi Mao, Chao-Yuan Wu, Christoph Feichtenhofer, Trevor Darrell, and
Saining Xie. 2022. “A ConvNet for the 2020s.” arXiv preprint arXiv:2201.03545.
Lobachevsky, Nikolai Ivanovich. 1829. “On the principles of geometry.” Kazansky
Vestnik 25 (23): 178–187.
Lowe, David G. 1999. “Object recognition from local scale-invariant features.” In
ICCV.
Luxburg, Ulrike von, and Olivier Bousquet. 2004. “Distance-Based Classification with
Lipschitz Functions.” JMLR 5:669–695.
Lyle, Clare, Mark van der Wilk, Marta Kwiatkowska, Yarin Gal, and Benjamin
Bloem-Reddy. 2019. “On the Benefits of Invariance in Neural Networks.” In NeurIPS
Workshop on Machine Learning with Guarantees.
Lyu, Siwei, and Eero P Simoncelli. 2008. “Nonlinear image representation using
divisive normalization.” In CVPR.
Ma, Chao, Lei Wu, et al. 2022. “The Barron space and the flow-induced function spaces
for neural network models.” Constructive Approximation 55 (1): 369–406.
Maiorov, Vitaly E. 1999. “On best approximation by ridge functions.” Journal of
Approximation Theory 99 (1): 68–94.
Mallat, Stéphane. 1999. A wavelet tour of signal processing. Elsevier.
Mallat, Stéphane. 2012. “Group Invariant Scattering.” Communications on Pure and
Applied Mathematics 65 (10): 1331–1398.
Maron, Haggai, Heli Ben-Hamu, Hadar Serviansky, and Yaron Lipman. 2019. “Prov-
ably powerful graph networks.” Advances in neural information processing systems
32.
Maron, Haggai, Heli Ben-Hamu, Nadav Shamir, and Yaron Lipman. 2018. “Invariant
and equivariant graph networks.” arXiv:1812.09902.
Maron, Haggai, Or Litany, Gal Chechik, and Ethan Fetaya. 2020. “On learning sets
of symmetric elements.” In International conference on machine learning, 6734–6744.
PMLR.
Marquis, Jean-Pierre. 2009. “Category Theory and Klein’s Erlangen Program.” In From
a Geometrical Point of View, 9–40. Springer.
References 307
Masci, Jonathan, Davide Boscaini, Michael Bronstein, and Pierre Vandergheynst.
2015. “Geodesic convolutional neural networks on Riemannian manifolds.” In CVPR
Workshops.
Maxwell, James Clerk. 1865. “A dynamical theory of the electromagnetic field.”
Philosophical Transactions of the Royal Society of London, no. 155, 459–512.
McCulloch, Warren S, and Walter Pitts. 1943. “A logical calculus of the ideas immanent
in nervous activity.” The Bulletin of Mathematical Biophysics 5 (4): 115–133.
Mei, Song, Theodor Misiakiewicz, and Andrea Montanari. 2021. “Learning with
invariances in random features and kernel models.” arXiv:2102.13219.
Meir, Ron, and Vitaly E Maiorov. 2000. “On the optimality of neural-network approx-
imation using incremental algorithms.” IEEE Transactions on neural networks 11 (2):
323–337.
Merkwirth, Christian, and Thomas Lengauer. 2005. “Automatic generation of com-
plementary descriptors with molecular graph networks.” J. Chemical Information and
Modeling 45 (5): 1159–1168.
Micheli, Alessio. 2009. “Neural network for graphs: A contextual constructive
approach.” IEEE Trans. Neural Networks 20 (3): 498–511.
Milewski, Bartosz. 2019. Category theory for programmers. Bartosz Milewski.
Minsky, Marvin. 1967. Computation: Finite and Infinite Machines. Prentice-Hall.
Minsky, Marvin, and Seymour A Papert. 1969. Perceptrons: An introduction to
computational geometry. MIT Press.
Misiakiewicz, Theodor, and Andrea Montanari. 2023. “Six lectures on linearized neural
networks.” arXiv preprint arXiv:2308.13431.
Mitrovic, Jovana, Brian McWilliams, Jacob Walker, Lars Buesing, and Charles
Blundell. 2020. “Representation Learning via Invariant Causal Mechanisms.”
arXiv:2010.07922.
Möbius, August Ferdinand. 1827. Der barycentrische Calcul.
Monti, Federico, Davide Boscaini, Jonathan Masci, Emanuele Rodola, Jan Svoboda,
and Michael M Bronstein. 2017. “Geometric deep learning on graphs and manifolds
using mixture model cnns.” In CVPR.
Monti, Federico, Fabrizio Frasca, Davide Eynard, Damon Mannion, and Michael M
Bronstein. 2019. “Fake news detection on social media using geometric deep learning.”
arXiv preprint arXiv:1902.06673.
Morgan, Harry L. 1965. “The generation of a unique machine description for chemical
structures-a technique developed at Chemical Abstracts Service.” Journal of Chemical
Documentation 5 (2): 107–113.
Morris, Christopher, Gaurav Rattan, and Petra Mutzel. 2020. “Weisfeiler and leman
go sparse: Towards scalable higher-order graph embeddings.” Advances in Neural
Information Processing Systems 33:21824–21840.
308 References
Morris, Christopher, Martin Ritzert, Matthias Fey, William L Hamilton, Jan Eric
Lenssen, Gaurav Rattan, and Martin Grohe. 2019. “Weisfeiler and leman go neural:
Higher-order graph neural networks.” In AAAI.
Mozer, Michael C. 1989. “A focused back-propagation algorithm for temporal pattern
recognition.” Complex Systems 3 (4): 349–381.
Müller, Luis, Mikhail Galkin, Christopher Morris, and Ladislav Rampášek. 2023.
“Attending to graph transformers.” arXiv preprint arXiv:2302.04181.
Murphy, Kevin P. 2022. Probabilistic Machine Learning: An introduction. MIT Press.
probml.ai.
Murphy, Ryan, Balasubramaniam Srinivasan, Vinayak Rao, and Bruno Ribeiro. 2019.
“Relational pooling for graph representations.” In International Conference on Machine
Learning, 4663–4673. PMLR.
Murphy, Ryan L, Balasubramaniam Srinivasan, Vinayak Rao, and Bruno Ribeiro. 2018.
“Janossy pooling: Learning deep permutation-invariant functions for variable-size
inputs.” arXiv:1811.01900.
Navon, Aviv, Aviv Shamsian, Idan Achituve, Ethan Fetaya, Gal Chechik, and Hag-
gai Maron. 2023. “Equivariant Architectures for Learning in Deep Weight Spaces.”
In Proceedings of the 40th International Conference on Machine Learning, edited by
Andreas Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato,
and Jonathan Scarlett, 202:25790–25816. Proceedings of Machine Learning Research.
PMLR, 23–29 Jul. https://proceedings.mlr.press/v202/navon23a.html.
Neal, Radford M. 1996. Bayesian learning for neural networks. Vol. 118. Springer
Science & Business Media.
Neyshabur, Behnam, Ryota Tomioka, and Nathan Srebro. 2015. “Norm-based capacity
control in neural networks.” In COLT.
Noether, Emmy. 1918. “Invariante Variationsprobleme.” In König Gesellsch. d. Wiss.
zu Göttingen, Math-Phys. Klassc, 235–257.
Oh, Kyoung-Su, and Keechul Jung. 2004. “GPU implementation of neural networks.”
Pattern Recognition 37 (6): 1311–1314.
Ong, Euan, and Petar Veli
ˇ
ckovi
´
c. 2022. “Learnable commutative monoids for graph
neural networks.” In Learning on Graphs Conference, 43–1. PMLR.
Oord, Aaron van den, Nal Kalchbrenner, and Koray Kavukcuoglu. 2016. “Pixel
recurrent neural networks.” In ICML.
Opler, Ascher, and Ted R Norton. 1956. A manual for programming computers for use
with a mechanized system for searching organic compounds. Dow Chemical Company.
Oquab, Maxime, Timothée Darcet, Théo Moutakanni, Huy V. Vo, Marc Szafraniec,
Vasil Khalidov, Pierre Fernandez, et al. 2024. “DINOv2: Learning Robust Visual Fea-
tures without Supervision.” Featured Certification, Transactions on Machine Learning
Research, ISSN: 2835-8856. https://openreview.net/forum?id=a68SUt6zFt.
References 309
Pakes, Patrick W, Thomas C Rounds, and Herbert L Strauss. 1981. “Conformations of
cyclooctane and some related oxocanes.” The Journal of Physical Chemistry 85 (17):
2469–2475.
Pal, Aditya, Chantat Eksombatchai, Yitong Zhou, Bo Zhao, Charles Rosenberg, and
Jure Leskovec. 2020. “Pinnersage: Multi-modal user embedding framework for rec-
ommendations at pinterest.” In Proceedings of the 26th ACM SIGKDD International
Conference on Knowledge Discovery & Data Mining, 2311–2320.
Papamarkou, Theodore, Tolga Birdal, Michael Bronstein, Gunnar Carlsson, Justin
Curry, Yue Gao, Mustafa Hajij, Roland Kwitt, Pietro Lio, Paolo Di Lorenzo, et al.
2024. “Position: Topological deep learning is the new frontier for relational learning.”
arXiv preprint arXiv:2402.08871.
Pascanu, Razvan, Tomas Mikolov, and Yoshua Bengio. 2013. “On the difficulty of
training recurrent neural networks.” In ICML.
Pellegrini, Giovanni, Alessandro Tibo, Paolo Frasconi, Andrea Passerini, and Manfred
Jaeger. 2020. “Learning aggregation functions.” arXiv preprint arXiv:2012.08482.
Penrose, Roger. 2005. The road to reality: A complete guide to the laws of the universe.
Random House.
Petersen, K B, and M S Pedersen. 2012. “The matrix cookbook.” Version 20121115,
http://www2.compute.dtu.dk/pubdb/pubs/3274-full.html.
Petrache, Mircea, and Shubhendu Trivedi. 2023. “Approximation-generalization trade-
offs under (approximate) group equivariance.” Advances in Neural Information Pro-
cessing Systems 36:61936–61959.
Pinkus, Allan. 1999. “Approximation theory of the MLP model in neural networks.”
Acta Numerica 8:143–195.
Poncelet, Jean Victor. 1822. Traité des propriétés projectives des figures.
Poulenard, Adrien, and Maks Ovsjanikov. 2018. “Multi-directional geodesic neural net-
works via equivariant convolution.” ACM Transactions on Graphics (TOG) 37 (6): 1–
14.
Pozdnyakov, Sergey N, and Michele Ceriotti. 2022. “Incompleteness of graph neu-
ral networks for points clouds in three dimensions.” Machine Learning: Science and
Technology 3 (4): 045020.
Puny, Omri, Matan Atzmon, Edward J. Smith, Ishan Misra, Aditya Grover, Heli Ben-
Hamu, and Yaron Lipman. 2022. “Frame Averaging for Invariant and Equivariant
Network Design.” In International Conference on Learning Representations. https : /
/openreview.net/forum?id=zIUyj55nXR.
Qi, Charles R, Hao Su, Kaichun Mo, and Leonidas J Guibas. 2017. “Pointnet: Deep
learning on point sets for 3d classification and segmentation.” In CVPR.
Quigg, Chris. 2019. “Colloquium: A Century of Noether’s Theorem.” arXiv:1902.01989.
Radford, Alec, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever. 2018. “Improv-
ing language understanding by generative pre-training.”
310 References
Rahimi, Ali, and Benjamin Recht. 2007. “Random features for large-scale kernel
machines.” Advances in neural information processing systems 20.
Ravanbakhsh, Siamak, Jeff Schneider, and Barnabas Poczos. 2017. “Equivariance
Through Parameter-Sharing.” In International Conference on Machine Learning.
Ray, Louis C, and Russell A Kirsch. 1957. “Finding chemical records by digital
computers.” Science 126 (3278): 814–819.
Razin, Noam, and Nadav Cohen. 2020. “Implicit regularization in deep learning may
not be explainable by norms.” arXiv:2005.06398.
Reid, Constance. 1976. Courant in Göttingen and New York: The Story of an Improba-
ble Mathematician. Springer.
Riemann, Bernhard. 1854. Über die Hypothesen, welche der Geometrie zu Grunde
liegen.
Robinson, AJ, and Frank Fallside. 1987. The utility driven dynamic error propagation
network. University of Cambridge.
Ronneberger, Olaf, Philipp Fischer, and Thomas Brox. 2015. “U-net: Convolutional
networks for biomedical image segmentation.” In MICCAI.
Rosenblatt, Frank. 1957. The perceptron, a perceiving and recognizing automaton.
Cornell Aeronautical Laboratory.
Rosenblatt, Frank. 1958. “The perceptron: a probabilistic model for information storage
and organization in the brain.” Psychological Review 65 (6): 386.
Rossi, Emanuele, Ben Chamberlain, Fabrizio Frasca, Davide Eynard, Federico Monti,
and Michael Bronstein. 2020. “Temporal graph networks for deep learning on dynamic
graphs.” arXiv:2006.10637.
Rossi, Emanuele, Fabrizio Frasca, Ben Chamberlain, Davide Eynard, Michael Bron-
stein, and Federico Monti. 2020. “Sign: Scalable inception graph neural networks.”
arXiv preprint arXiv:2004.11198 7:15.
Rumelhart, David E, Geoffrey E Hinton, and Ronald J Williams. 1985. Learning
internal representations by error propagation. Technical report. UCSD Institute for
Cognitive Science.
Rumelhart, David E, Geoffrey E Hinton, and Ronald J Williams. 1986. “Learning
representations by back-propagating errors.” Nature 323 (6088): 533–536.
Rusch, T Konstantin, Michael M Bronstein, and Siddhartha Mishra. 2023. “A survey
on oversmoothing in graph neural networks.” arXiv preprint arXiv:2303.10993.
Saccheri, Girolamo. 1733. Euclides ab omni nævo vindicatus; sive conatus Geometri-
cus quo stabiliuntur geometriæ principia.
Salimans, Tim, and Diederik P Kingma. 2016. “Weight normalization: A simple
reparameterization to accelerate training of deep neural networks.” arXiv:1602.07868.
Sandryhaila, Aliaksei, and José MF Moura. 2013. “Discrete signal processing on
graphs.” IEEE Trans. Signal Processing 61 (7): 1644–1656.
References 311
Sannai, Akiyoshi, Masaaki Imaizumi, and Makoto Kawano. 2021. “Improved Gen-
eralization Bounds of Group Invariant / Equivariant Deep Networks via Quotient
Feature Spaces.” In Proceedings of the 37th Conference on Uncertainty in Artificial
Intelligence.
Santoro, Adam, David Raposo, David G Barrett, Mateusz Malinowski, Razvan Pas-
canu, Peter Battaglia, and Timothy Lillicrap. 2017. “A simple neural network module
for relational reasoning.” In NIPS.
Santurkar, Shibani, Dimitris Tsipras, Andrew Ilyas, and Aleksander Madry. 2018.
“How does batch normalization help optimization?” arXiv:1805.11604.
Sato, Ryoma, Makoto Yamada, and Hisashi Kashima. 2021. “Random features
strengthen graph neural networks.” In Proceedings of the 2021 SIAM international
conference on data mining (SDM), 333–341. SIAM.
Satorras, Víctor Garcia, Emiel Hoogeboom, and Max Welling. 2021. “E(n) Equivari-
ant Graph Neural Networks.” In Proceedings of the 38th International Conference on
Machine Learning, edited by Marina Meila and Tong Zhang, 139:9323–9332. Proceed-
ings of Machine Learning Research. PMLR, 18–24 Jul. https://proceedings.mlr.press
/v139/satorras21a.html.
Scarselli, Franco, Marco Gori, Ah Chung Tsoi, Markus Hagenbuchner, and Gabriele
Monfardini. 2008. “The graph neural network model.” IEEE Trans. Neural Networks
20 (1): 61–80.
Schattschneider, Doris. 1978. “The Plane Symmetry Groups: Their Recognition and
Notation.” American Mathematical Monthly 85 (6): 439–450.
Schmidhuber, Jürgen. 2015. “Deep learning in neural networks: An overview.” Neural
Networks 61:85–117.
Schütt, Kristof, Oliver Unke, and Michael Gastegger. 2021. “Equivariant message pass-
ing for the prediction of tensorial properties and molecular spectra.” In Proceedings
of the 38th International Conference on Machine Learning, edited by Marina Meila
and Tong Zhang, 139:9377–9388. Proceedings of Machine Learning Research. PMLR,
18–24 Jul. https://proceedings.mlr.press/v139/schutt21a.html.
Schütt, Kristof T, Huziel E Sauceda, P-J Kindermans, Alexandre Tkatchenko, and K-R
Müller. 2018. “Schnet–a deep learning architecture for molecules and materials.” The
Journal of chemical physics 148 (24).
Schwichtenberg, Jakob. 2015. Physics from symmetry. Springer.
Sejnowski, Terrence J, Paul K Kienker, and Geoffrey E Hinton. 1986. “Learning
symmetry groups with hidden units: Beyond the perceptron.” Physica D: Nonlinear
Phenomena 22 (1-3): 260–275.
Senior, Andrew W, Richard Evans, John Jumper, James Kirkpatrick, Laurent Sifre,
Tim Green, Chongli Qin, Augustin Žídek, Alexander WR Nelson, Alex Bridgland, et
al. 2020. “Improved protein structure prediction using potentials from deep learning.”
Nature 577 (7792): 706–710.
Serre, Jean-Pierre. 1977. Linear Representations of Finite Groups. Springer.
312 References
Shamir, Ohad, and Gal Vardi. 2020. “Implicit Regularization in ReLU Networks with
the Square Loss.” arXiv:2012.05156.
Shang, Wenling, Kihyuk Sohn, Diogo Almeida, and Honglak Lee. 2016. “Understand-
ing and Improving Convolutional Neural Networks via Concatenated Rectified Linear
Units.” In International Conference on Machine Learning (ICML).
Sharpe, Richard W. 2000. Differential geometry: Cartan’s generalization of Klein’s
Erlangen program. Vol. 166. Springer.
Shawe-Taylor, John. 1989. “Building symmetries into feedforward networks.” In
ICANN.
Shawe-Taylor, John. 1993. “Symmetries and discriminability in feedforward network
architectures.” IEEE Trans. Neural Networks 4 (5): 816–826.
Sherrington, Charles. 1906. The integrative action of the nervous system. Yale Univer-
sity PRess.
Shirzad, Hamed, Ameya Velingker, Balaji Venkatachalam, Danica J Sutherland, and
Ali Kemal Sinop. 2023. “Exphormer: Sparse transformers for graphs.” In International
Conference on Machine Learning, 31613–31632. PMLR.
Shrikhande, Shartchandra S. 1959. “The Uniqueness of the L_2 Association Scheme.”
The Annals of Mathematical Statistics, 781–798.
Shuman, David I, Sunil K Narang, Pascal Frossard, Antonio Ortega, and Pierre Van-
dergheynst. 2013. “The emerging field of signal processing on graphs: Extending
high-dimensional data analysis to networks and other irregular domains.” IEEE Signal
Processing Magazine 30 (3): 83–98.
Siegelmann, Hava T, and Eduardo D Sontag. 1995. “On the computational power of
neural nets.” Journal of Computer and System Sciences 50 (1): 132–150.
Silver, David, Aja Huang, Chris J Maddison, Arthur Guez, Laurent Sifre, George Van
Den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc
Lanctot, et al. 2016. “Mastering the game of Go with deep neural networks and tree
search.” Nature 529 (7587): 484–489.
Silver, David, Julian Schrittwieser, Karen Simonyan, Ioannis Antonoglou, Aja Huang,
Arthur Guez, Thomas Hubert, Lucas Baker, Matthew Lai, Adrian Bolton, et al. 2017.
“Mastering the game of go without human knowledge.” Nature 550 (7676): 354–359.
Simion, Ioana, Mohammadreza Salehi, Shashanka Venkataramanan, Cees G. M. Snoek,
and Yuki M Asano. 2026. “3DPoV: Improving 3D understanding via Patch Ordering on
Videos.” In Forty-third International Conference on Machine Learning. https://openre
view.net/forum?id=CxcHPeXYWB.
Sivic, Josef, and Andrew Zisserman. 2003. “Video Google: A text retrieval approach to
object matching in videos.” In ICCV.
Sperduti, Alessandro. 1994. “Encoding labeled graphs by labeling RAAM.” In NIPS.
Sperduti, Alessandro, and Antonina Starita. 1997. “Supervised neural networks for the
classification of structures.” IEEE Trans. Neural Networks 8 (3): 714–735.
References 313
Springenberg, Jost Tobias, Alexey Dosovitskiy, Thomas Brox, and Martin Riedmiller.
2014. “Striving for simplicity: The all convolutional net.” arXiv:1412.6806.
Srivastava, Rupesh Kumar, Klaus Greff, and Jürgen Schmidhuber. 2015. “Highway
networks.” arXiv:1505.00387.
Stokes, Jonathan M, Kevin Yang, Kyle Swanson, Wengong Jin, Andres Cubillos-Ruiz,
Nina M Donghia, Craig R MacNair, Shawn French, Lindsey A Carfrae, Zohar Bloom-
Ackerman, et al. 2020. “A deep learning approach to antibiotic discovery.” Cell 180
(4): 688–702.
Straumann, Norbert. 1996. “Early history of gauge theories and weak interactions.”
hep-ph/9609230.
Su, Jianlin, Murtadha Ahmed, Yu Lu, Shengfeng Pan, Wen Bo, and Yunfeng Liu. 2024.
“Roformer: Enhanced transformer with rotary position embedding.” Neurocomputing
568:127063.
Sylvester, John Joseph. 1878. “Chemistry and algebra.” Nature 17 (432): 284.
Tallec, Corentin, and Yann Ollivier. 2018. “Can recurrent neural networks warp time?”
arXiv:1804.11188.
Tang, Hao, Zhiao Huang, Jiayuan Gu, Bao-Liang Lu, and Hao Su. 2020.
“Towards Scale-Invariant Graph-related Problem Solving by Iterative Homogeneous
GNNs.” In Advances in Neural Information Processing Systems, edited by H.
Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan, and H. Lin, 33:15811–15822.
Curran Associates, Inc. https : //proceedings.neurips.cc/paper_files/paper/2020/file
/b64a70760bb75e3ecfd1ad86d8f10c88-Paper.pdf.
Taubin, Gabriel, Tong Zhang, and Gene Golub. 1996. “Optimal surface smoothing as
filter design.” In ECCV.
Thomas, Nathaniel, Tess Smidt, Steven Kearnes, Lusann Yang, Li Li, Kai Kohlhoff,
and Patrick Riley. 2018. “Tensor field networks: Rotation-and translation-equivariant
neural networks for 3D point clouds.” arXiv:1802.08219.
Tobies, Renate. 2019. “Felix Klein—-Mathematician, Academic Organizer, Educa-
tional Reformer.” In The Legacy of Felix Klein, 5–21. Springer.
Tönshoff, Jan, Martin Ritzert, Hinrikus Wolf, and Martin Grohe. 2021. “Walking out
of the weisfeiler leman hierarchy: Graph learning beyond message passing.” arXiv
preprint arXiv:2102.08786.
Topping, Jake, Francesco Di Giovanni, Benjamin Paul Chamberlain, Xiaowen Dong,
and Michael M Bronstein. 2021. “Understanding over-squashing and bottlenecks on
graphs via curvature.” arXiv preprint arXiv:2111.14522.
Trockman, Asher, and J Zico Kolter. 2022. “Patches Are All You Need?” arXiv preprint
arXiv:2201.09792.
Tsybakov, Alexandre B. 2008. Introduction to nonparametric estimation. Springer.
Tunyasuvunakool, Kathryn, Jonas Adler, Zachary Wu, Tim Green, Michal Zielinski,
Augustin Žídek, Alex Bridgland, Andrew Cowie, Clemens Meyer, Agata Laydon, et al.
314 References
2021. “Highly accurate protein structure prediction for the human proteome.” Nature
596 (7873): 590–596.
Ulyanov, Dmitry, Andrea Vedaldi, and Victor Lempitsky. 2016. “Instance normaliza-
tion: The missing ingredient for fast stylization.” arXiv:1607.08022.
van der Schaaf, A., and J.H. van Hateren. 1996. “Modelling the Power Spectra of Nat-
ural Images: Statistics and Information.” Vision Research 36 (17): 2759–2770. ISSN:
0042-6989. https : //doi.org/https : //doi.org/10.1016/0042-6989(96 ) 00002-8. https : /
/www.sciencedirect.com/science/article/pii/0042698996000028.
Vasconcelos, Cristina, Hugo Larochelle, Vincent Dumoulin, Rob Romijnders, Nicolas
Le Roux, and Ross Goroshin. 2021. “Impact of Aliasing on Generalization in Deep
Convolutional Networks.” In International Conference on Computer Vision.
Vaswani, Ashish, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N
Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. “Attention is all you need.” In NIPS.
Veli
ˇ
ckovi
´
c, Petar. 2022. “Message passing all the way up.” In ICLR 2022 Workshop on
Geometrical and Topological Representation Learning. https://openreview.net/forum
?id=Bc8GiEZkTe5.
Veli
ˇ
ckovi
´
c, Petar, and Charles Blundell. 2021. “Neural algorithmic reasoning.” Patterns
2 (7).
Veli
ˇ
ckovi
´
c, Petar, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò,
and Yoshua Bengio. 2018. “Graph Attention Networks.” In International Conference
on Learning Representations. https://openreview.net/forum?id=rJXMpikCZ.
Veli
ˇ
ckovi
´
c, Petar, Christos Perivolaropoulos, Federico Barbero, and Razvan Pascanu.
2025. “Softmax is not Enough (for Sharp Size Generalisation).” In Proceedings of
the 42nd International Conference on Machine Learning, edited by Aarti Singh,
Maryam Fazel, Daniel Hsu, Simon Lacoste-Julien, Felix Berkenkamp, Tegan Maharaj,
Kiri Wagstaff, and Jerry Zhu, 267:61190–61211. Proceedings of Machine Learning
Research. PMLR, 13–19 Jul. https://proceedings.mlr.press/v267/velickovic25a.html.
Veli
ˇ
ckovi
´
c, Petar, Rex Ying, Matilde Padovano, Raia Hadsell, and Charles Blun-
dell. 2020. “Neural Execution of Graph Algorithms.” In International Conference on
Learning Representations. https://openreview.net/forum?id=SkgKO0EtvS.
Vilenkin, N Ja, and A U Klimyk. 1991. “Representation of Lie Groups and Spe-
cial Functions - volume 1: Simplest Lie Groups, Special Functions and Integral
Transforms.”
Villar, Soledad, David W Hogg, Kate Storey-Fisher, Weichi Yao, and Ben Blum-Smith.
2021. “Scalars are universal: Equivariant machine learning, structured like classical
physics.” In Advances in Neural Information Processing Systems 34, 28848–28863.
Vitvitskyi, Alex, João Guilherme Madeira Araújo, Marc Lackenby, and Petar
Veli
ˇ
ckovi
´
c. 2025. “What Makes a Good Feedforward Computational Graph?” In
Proceedings of the 42nd International Conference on Machine Learning, edited by
Aarti Singh, Maryam Fazel, Daniel Hsu, Simon Lacoste-Julien, Felix Berkenkamp,
Tegan Maharaj, Kiri Wagstaff, and Jerry Zhu, 267:61635–61651. Proceedings of
Machine Learning Research. PMLR, 13–19 Jul. https : //proceedings.mlr.press/v267
/vitvitskyi25a.html.
References 315
Vleduts, GE. 1963. “Concerning one system of classification and codification of organic
reactions.” Information Storage and Retrieval 1 (2-3): 117–146.
Vléduts, G É, Vasilii Vasil’evich Nalimov, and NI Styazhkin. 1959. “Scientific and
technical information as one of the problems of cybernetics.” Soviet Physics Uspekhi 2
(5): 637.
Wagstaff, Edward, Fabian Fuchs, Martin Engelcke, Ingmar Posner, and Michael A
Osborne. 2019. “On the limitations of representing functions on sets.” In International
Conference on Machine Learning, 6487–6494. PMLR.
Wang, Rui, Robin Walters, and Rose Yu. 2022. “Approximately equivariant net-
works for imperfectly symmetric dynamics.” In International Conference on Machine
Learning, 23078–23091. PMLR.
Wang, Yue, Yongbin Sun, Ziwei Liu, Sanjay E Sarma, Michael M Bronstein, and
Justin M Solomon. 2019. “Dynamic graph cnn for learning on point clouds.” Acm
Transactions On Graphics (tog) 38 (5): 1–12.
Wang, Zhe, Petar Veli
ˇ
ckovi
´
c, Daniel Hennes, Nenad Tomašev, Laurel Prince, Michael
Kaisers, Yoram Bachrach, Romuald Elie, Li Kevin Wenliang, Federico Piccinini, et al.
2024. “TacticAI: an AI assistant for football tactics.” Nature communications 15 (1):
1906.
Wei, Susan, and Edmund Lau. 2023. “Variational Bayesian Neural Networks via
Resolution of Singularities” (February). arXiv: 2302.06035 [stat.ML].
Wei, Susan, Daniel Murfet, Mingming Gong, Hui Li, Jesse Gell-Redman, and Thomas
Quella. 2022. “Deep Learning Is Singular, and That’s Good” [in en]. IEEE Trans Neural
Netw Learn Syst PP (June).
Weierstrass, Karl. 1872. “Über continuirliche Functionen eines reellen Arguments,
die fur keinen Werth des letzteren einen bestimmten Differentailqutienten besitzen.”
Königlich Preussische Akademie der Wissenschaften.
Weiler, Maurice, and Gabriele Cesa. 2019. “General E(2)-Equivariant Steerable
CNNs.” In Advances in Neural Information Processing Systems, edited by H. Wal-
lach, H. Larochelle, A. Beygelzimer, F. d’Alché-Buc, E. Fox, and R. Garnett,
vol. 32. Curran Associates, Inc. https://proceedings.neurips.cc/paper_files/paper/2019
/file/45d6637b718d0f24a237069fe41b0db4-Paper.pdf.
Weiler, Maurice, Patrick Forré, Erik Verlinde, and Max Welling. 2023. Equivariant
and Coordinate Independent Convolutional Networks: A Gauge Field Theory of Neural
Networks. https ://maurice-weiler.gitlab.io/cnn_book/EquivariantAndCoordinateIndep
endentCNNs.pdf.
Weiler, Maurice, Mario Geiger, Max Welling, Wouter Boomsma, and Taco Cohen.
2018. “3d steerable cnns: Learning rotationally equivariant features in volumetric data.”
Advances in Neural information processing systems 31.
Weisfeiler, Boris, and Andrei Leman. 1968. “The reduction of a graph to canonical
form and the algebra which appears therein.” NTI Series 2 (9): 12–16.
Werbos, Paul J. 1982. “Applications of advances in nonlinear sensitivity analysis.” In
System modeling and optimization, 762–770. Springer.
316 References
Werbos, Paul J. 1988. “Generalization of backpropagation with application to a
recurrent gas market model.” Neural Networks 1 (4): 339–356.
Weston, Jason, Frédéric Ratle, and Ronan Collobert. 2008. “Deep learning via semi-
supervised embedding.” In Proceedings of the 25th international conference on
Machine learning, 1168–1175.
Weyl, Hermann. 1929. “Elektron und gravitation. I.” Zeitschrift für Physik 56 (5-6):
330–352.
Weyl, Hermann. 1939. The classical groups: their invariants and representations.
Princeton University Press.
Weyl, Hermann. 1952. Symmetry. Princeton University Press.
Wigner, Eugene. 1927. “Einige folgerungen aus der schrödingerschen theorie für die
termstrukturen.” Zeitschrift für Physik 43 (9): 624–652.
Williams, Christopher. 1996. “Computing with infinite networks.” Advances in neural
information processing systems 9.
Wilson, JJ, Maya Bechler-Speicher, and Petar Veli
ˇ
ckovi
´
c. 2025. “Cayley Graph Prop-
agation.” In Proceedings of the Third Learning on Graphs Conference, edited by Guy
Wolf and Smita Krishnaswamy, vol. 269, 8:1–8:20. Proceedings of Machine Learning
Research. PMLR, 26–29 Nov. https://proceedings.mlr.press/v269/wilson25a.html.
Wiswesser, William J. 1968. “107 Years of line-formula notations (1861-1968).”
Journal of Chemical Documentation 8 (3): 146–150.
Worrall, Daniel, and Max Welling. 2019. “Deep scale-spaces: Equivariance over scale.”
Advances in Neural Information Processing Systems 32.
Wu, Felix, Amauri Souza, Tianyi Zhang, Christopher Fifty, Tao Yu, and Kilian
Weinberger. 2019. “Simplifying graph convolutional networks.” In ICML.
Wu, Lingfei, Peng Cui, Jian Pei, and Liang Zhao. 2022. Graph Neural Networks:
Foundations, Frontiers, and Applications. 725. Singapore: Springer Singapore.
Wu, Xinyi, Amir Ajorlou, Zihui Wu, and Ali Jadbabaie. 2023. “Demystifying over-
smoothing in attention-based graph neural networks.” Advances in Neural Information
Processing Systems 36:35084–35106.
Wu, Yuxin, and Kaiming He. 2018. “Group normalization.” In ECCV.
Xhonneux, Louis-Pascal, Meng Qu, and Jian Tang. 2020. “Continuous graph neural
networks.” In International conference on machine learning, 10432–10441. PMLR.
Xu, Da, Chuanwei Ruan, Evren Korpeoglu, Sushant Kumar, and Kannan Achan. 2020.
“Inductive representation learning on temporal graphs.” arXiv:2002.07962.
Xu, Keyulu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka. 2018. “How powerful
are graph neural networks?” arXiv:1810.00826.
Yang, Chen-Ning, and Robert L Mills. 1954. “Conservation of isotopic spin and
isotopic gauge invariance.” Physical Review 96 (1): 191.
References 317
Yang, Jianke, Robin Walters, Nima Dehmamy, and Rose Yu. 2023. “Generative adver-
sarial symmetry discovery.” In International conference on machine learning, 39488–
39508. PMLR.
Ying, Chengxuan, Tianle Cai, Shengjie Luo, Shuxin Zheng, Guolin Ke, Di He, Yan-
ming Shen, and Tie-Yan Liu. 2021. “Do transformers really perform badly for graph
representation?” Advances in neural information processing systems 34:28877–28888.
Ying, Rex, Ruining He, Kaifeng Chen, Pong Eksombatchai, William L Hamilton,
and Jure Leskovec. 2018. “Graph convolutional neural networks for web-scale recom-
mender systems.” In Proceedings of the 24th ACM SIGKDD international conference
on knowledge discovery & data mining, 974–983.
Zaheer, Manzil, Satwik Kottur, Siamak Ravanbakhsh, Barnabas Poczos, Russ R
Salakhutdinov, and Alexander J Smola. 2017. “Deep sets.” In NIPS.
Zhang, Chuxu, Dongjin Song, Chao Huang, Ananthram Swami, and Nitesh V Chawla.
2019. “Heterogeneous graph neural network.” In Proceedings of the 25th ACM
SIGKDD international conference on knowledge discovery & data mining, 793–803.
Zhang, Jiani, Xingjian Shi, Junyuan Xie, Hao Ma, Irwin King, and Dit-Yan Yeung.
2018. “Gaan: Gated attention networks for learning on large and spatiotemporal
graphs.” arXiv:1803.07294.
Zhang, Richard. 2019. “Making Convolutional Networks Shift-Invariant Again.” In
Proceedings of the 36th International Conference on Machine Learning.
Zhao, Bo, Nima Dehmamy, Robin Walters, and Rose Yu. 2022. “Symmetry-
Teleportation for Accelerated Optimization” [in en]. In Advances in Neural Information
Processing.
Zhao, Bo, Iordan Ganev, Robin Walters, Rose Yu, and Nima Dehmamy. 2023. “Sym-
metries, flat minima, and the conserved quantities of gradient flow.” In Proceedings of
the International Conference on Learning Representations.
Zhao, Tong, Yozen Liu, Matthew Kolodner, Kyle Montemayor, Elham Ghazizadeh,
Ankit Batra, Zihao Fan, Xiaobin Gao, Xuan Guo, Jiwen Ren, et al. 2025. “GiGL: Large-
Scale Graph Neural Networks at Snapchat.” arXiv preprint arXiv:2502.15054.
Zhou, Allan, Kaien Yang, Kaylee Burns, Adriano Cardace, Yiding Jiang, Samuel
Sokota, J Zico Kolter, and Chelsea Finn. 2023. “Permutation equivariant neural
functionals.” Advances in neural information processing systems 36:24966–24992.
Zhu, Rong, Kun Zhao, Hongxia Yang, Wei Lin, Chang Zhou, Baole Ai, Yong Li,
and Jingren Zhou. 2019. “Aligraph: A comprehensive graph neural network platform.”
arXiv preprint arXiv:1902.08730.