Empirical Bayes provides a powerful approach to learning and adapting to latent structure in data. Theory and algorithms for empirical Bayes have a rich literature for sequence models, but are less understood in settings where latent variables and data interact through more complex designs. In this work, we study empirical Bayes estimation of an i.i.d. prior in Bayesian linear models, via the nonparametric maximum likelihood estimator (NPMLE). We introduce and study a system of gradient flow equations for optimizing the marginal log-likelihood, jointly over the prior and posterior measures in its Gibbs variational representation using a smoothed reparametrization of the regression coefficients. A diffusion-based implementation yields a Langevin dynamics MCEM algorithm, where the prior law evolves continuously over time to optimize a sequence-model log-likelihood defined by the coordinates of the current Langevin iterate. We show consistency of the NPMLE as n,p→∞ under mild conditions, including settings of random sub-Gaussian designs when n≍p. In high noise, we prove a uniform log-Sobolev inequality for the mixing of Langevin dynamics, for possibly misspecified priors and non-log-concave posteriors. We then establish polynomial-time convergence of the joint gradient flow to a near-NPMLE if the marginal negative log-likelihood is convex in a sub-level set of the initialization.

This talk investigates the asymptotic behavior of the least singular value of a heavy-tailed random matrix model, random matrices with alpha-stable entries. We establish that the asymptotic distribution is the same as in the models with finite variance, for example when the entries of the matrix are Gaussian random variables, as the dimension of the matrices grows to infinity. The methods used to establish the result are based on the three step strategy, an important strategy developed in the last decade in the random matrix theory literature.