IPMU Colloquium

Speaker: Lenka Zdeborová (EPFL)
Title: Statistical Physics of Learning in the Age of Attention
Date (JST): Thu, Mar 12, 2026, 15:30 - 17:00
Place: Lecture Hall
Abstract: Over the past decades, statistical physics has provided a powerful framework for analyzing learning in high-dimensional models, revealing phase transitions, fundamental limits on generalization, and the role of algorithms and architectures. In this talk, I will discuss how these ideas are now being extended beyond classical perceptron-type models to attention-based architectures that process sequences of tokens, opening a path toward a statistical physics theory of transformers.