Machine Learning Theory
Mathematical foundations for optimization, generalization, reasoning, and reliable scaling.
Read direction →PKU SCALE Lab develops mathematical foundations and scalable algorithms at the intersection of machine learning, applied probability, computational mathematics, and scientific discovery.
We study how representation, geometry, simulation, and resource allocation determine whether added computation produces reliable gains.
Mathematical foundations for optimization, generalization, reasoning, and reliable scaling.
Read direction →Sequential Monte Carlo, stochastic simulation, rare events, and high dimensional probability.
Read direction →Randomized numerical algorithms, matrix computation, PDEs, and uncertainty quantification.
Read direction →Inference time scaling, scientific machine learning, and AI assisted mathematical discovery.
Read direction →Current work spans LLM reasoning theory, stochastic networks, generative inference, optimizer geometry, and scientific computing.
A theory for when approximate rewards make long horizon reasoning computationally tractable.
Paper ↗A resolution of the finite signed uniqueness problem in the Harrison Reiman class and an obstruction beyond it.
Paper ↗Width stable geometry and transferable learning rates for neural network optimizers.
Paper ↗Sequential Monte Carlo on path measures for additional inference computation.
Paper ↗Defect correction turns additional simulation into improved high dimensional PDE predictions.
Paper ↗Large deviations expose heavy tail risk hidden by benign average performance.
Paper ↗I am actively recruiting undergraduate students, graduate students, and postdocs to join my research group. Interested candidates are encouraged to email yipinglu [at] bicmr.pku.edu.cn.
See opportunitiesSelected research and group updates.
Research notes, mathematical perspectives, and updates from members of PKU SCALE Lab.
A new space for research notes, mathematical perspectives, and updates from our group.
Read article →