Preprints/ Publications (by year)

(* = equal contribution )
(** = alphabetical order )
(† = co-last author )

Journal Submissions

Multivariate smoothing via the Fourier integral theorem and Fourier kernel . Under review.
Nhat Ho**, Stephen G. Walker**.

Generative models from the multivariate Fourier integral theorem . Under review.
Nhat Ho**, Stephen G. Walker**.

On integral theorems: Monte Carlo estimators and optimal functions . Under review.
Nhat Ho**, Stephen G. Walker**.

Probabilistic best subset selection via gradient-based optimization. Under review.
Mingzhang Yin, Nhat Ho, Bowei Yan, Xiaoning Qian, Mingyuan Zhou.

Global optimality of the EM algorithm for mixtures of two linear regression . Under review.
Jeongyeol Kwon, Wei Qian, Constantine Caramanis, Yudong Chen, Damek Davis, Nhat Ho.

An exponentially increasing step-size for parameter estimation in statistical models. Under review.
Nhat Ho**, Tongzheng Ren**, Purnamrita Sarkar**, Sujay Sanghavi**, Rachel Ward**.

A general theory for softmax gating Gaussian mixture of experts . To be submitted.
Huy Nguyen, Nhat Ho.

Energy meets sliced Wasserstein distance: From linear to nonlinear projections . To be submitted.
Khai Nguyen, Nhat Ho.

Mixture model meets Transformer . To be submitted.
Tan Nguyen*, Tam Nguyen*, Nhat Ho†, Stanley Osher†.

Improving Transformer via general integral theorems . To be submitted.
Tan Nguyen*, Minh Pham*, Nhat Ho.

Revisiting sliced optimal transport via geometric methods. To be submitted.
Khai Nguyen, Nhat Ho.

Joint self-supervised image-volume representation learning with intra-inter contrastive clustering . To be submitted.
Duy Nguyen, Nguyen Hoang, Truong Mai, Cao Tri, Binh Nguyen, Nhat Ho, Paul Swoboda, Shadi Albarqouni, Pengtao Xie, Daniel Sonntag.

Uniform convergence rates for maximum likelihood estimation under two-component Gaussian mixture models. Arxiv Preprint.
Tudor Manole, Nhat Ho.

Journal extension: Minimax optimal convergence rates for location-scale Gaussian mixture models. To be submitted.

On mean-field variational inference: Non-asymptotic approximation, Bayesian inference, and parameter estimation. To be submitted.
Wenlong Mou, Nhat Ho, Martin J. Wainwright, Peter L. Bartlett, Michael I. Jordan.

BONuS: Multiple multivariate testing with a data-adaptive test statistic . Arxiv Preprint.
Chiao-Yu Yang, Lihua Lei, Nhat Ho, Will Fithian.

Conference Submissions

Statistical perspective of top-K sparse softmax gating in mixture of experts . Under review.
Huy Nguyen, Pedram Akbarian, Fanqi Yan, Nhat Ho.

CompeteSMOE: Effective training of sparse mixture of experts via competition . Under review.
Quang Pham, Huy Nguyen, Tin Nguyen, Nhat Ho.

Quasi-Monte Carlo for 3D sliced Wasserstein . Under review.
Khai Nguyen, Nicola Bariletto, Nhat Ho.

Control variate sliced Wasserstein estimators . Under review.
Khai Nguyen, Nhat Ho.

Towards convergence rates for parameter estimation in Gaussian-gated mixture of experts . Under review.
Huy Nguyen, Tin Nguyen, Khai Nguyen, Nhat Ho.

Posterior collapse in linear conditional and hierarchical variational autoencoders . Under review.
Hien Dang, Tho Tran, Tan Nguyen†, Nhat Ho†.

On parameter estimation under contaminated models with covariates. Under review.
Huy Nguyen, Khai Nguyen, Nhat Ho.

Diffeomorphic deformation via sliced Wasserstein distance optimization for cortical surface reconstruction. Under review.
Tung Le, Khai Nguyen, Shanlin Sun, Kun Han, Nhat Ho, Xiaohui Xie.

Beyond EM algorithm on over-specified two-component location-scale Gaussian mixtures. Under review.
Tongzheng Ren*, Fuheng Cui*, Sujay Sanghavi, Nhat Ho.

Improving computational complexity in statistical models with second-order information . Under review.
Tongzheng Ren, Jiacheng Zhuo, Sujay Sanghavi, Nhat Ho.

Privacy preserving Bayesian federated learning in heterogeneous settings. Under review.
Disha Makhija, Nhat Ho†, Joydeep Ghosh†.

Federated self-supervised learning for heterogeneous clients. Under review.
Disha Makhija, Nhat Ho†, Joydeep Ghosh†.

Statistical and computational complexities of BFGS quasi-Newton method for generalized linear models. Under review.
Qiujiang Jin, Tongzheng Ren, Nhat Ho, Aryan Mokhtari.

On label shift in domain adaptation via Wasserstein distance . Under review.
Trung Le, Dat Do, Tuan Nguyen, Huy Nguyen, Hung Bui, Nhat Ho, Dinh Phung.

Improving generative flow networks with path regularization. Under review.
Anh Hoang, Duy Dinh, Tan Nguyen, Stanley Osher†, Nhat Ho†.

Efficient Transformer with compressive sensing . Under review.
Tan Minh Nguyen, Tho Tran Huu, Tam Minh Nguyen, Minh Pham, Stanley Osher†, Nhat Ho†.

Fast approximation of the generalized sliced-Wasserstein distance. Under review.
Dung Le, Huy Nguyen, Khai Nguyen, Trang Nguyen, Nhat Ho.

Improving multi-task learning via seeking task-based flat regions. Under review.
Hoang Phan, Tung Tran, Ngoc Tran, Nhat Ho, Dinh Phung, Trung Le.

On scalable variant of Wasserstein barycenter . Under review.
Tam Le*, Viet Huynh*, Nhat Ho*, Dinh Phung, Makoto Yamada.

Journal Under Revision

On the computational and statistical complexity of over-parameterized matrix sensing . Under revision.
Jiacheng Zhuo, Jeongyeol Kwon, Nhat Ho, Constantine Caramanis.

On posterior inference for the number of clusters in Dirichlet process mixture models. Under revision.
Chiao-Yu Yang, Eric Xia, Nhat Ho, Michael I. Jordan.

Sampling for Bayesian mixture models: MCMC with polynomial-time mixing. Under revision.
Wenlong Mou, Nhat Ho, Martin J. Wainwright, Peter L. Bartlett, Michael I. Jordan.

2023

[64] Instability, computational efficiency, and statistical accuracy . Accepted with minor revision at Journal of Machine Learning Research (JMLR), 2023.
Nhat Ho*, Raaz Dwivedi*, Koulik Khamaru*, Martin J. Wainwright, Michael I. Jordan, Bin Yu.

[63] A diffusion process perspective on the posterior contraction rates for parameters. Accepted with minor revision at SIAM Journal on Mathematics of Data Science (SIMODS), 2023.
Wenlong Mou, Nhat Ho, Martin J. Wainwright, Peter L. Bartlett, Michael I. Jordan.

[62] A Bayesian perspective of convolutional neural networks through a deconvolutional generative model. Journal of Machine Learning Research (JMLR), 2023.
Nhat Ho*, Tan Nguyen*, Ankit Patel, Anima Anandkumar, Michael I. Jordan, Richard Baraniuk.

[61] Demystifying softmax gating in Gaussian mixture of experts . Advances in NeurIPS, 2023 (Spotlight).
Huy Nguyen, Tin Nguyen, Nhat Ho.

[60] Energy-based sliced Wasserstein distance . Advances in NeurIPS, 2023.
Khai Nguyen, Nhat Ho.

[59] Minimax optimal rate for parameter estimation in multivariate deviated models. Advances in NeurIPS, 2023.
Dat Do*, Huy Nguyen*, Khai Nguyen, Nhat Ho.

[58] Markovian sliced Wasserstein distances: Beyond independent projections . Advances in NeurIPS, 2023.
Khai Nguyen, Tongzheng Ren, Nhat Ho.

[57] Designing robust transformers using robust kernel density estimation. Advances in NeurIPS, 2023.
Xing Han, Tongzheng Ren, Tan Minh Nguyen, Khai Nguyen, Joydeep Ghosh, Nhat Ho.

[56] LVM-Med: Learning large-Scale self-Supervised vision models for medical imaging via second-order graph matching. Advances in NeurIPS, 2023.
Duy Nguyen, Hoang Nguyen, Nghiem Diep, Tan Pham, Tri Cao, Binh T. Nguyen, Paul Swoboda, Nhat Ho, Shadi Albarqouni, Pengtao Xie, Mathias Niepert, Daniel Sonntag.

[55] On excess mass behavior in Gaussian mixture models with Orlicz Wasserstein distances . Proceedings of the ICML, 2023.
Aritra Guha, Nhat Ho, Long Nguyen.

[54] Neural collapse in deep linear network: from balanced to imbalanced data . Proceedings of the ICML, 2023.
Hien Dang*, Tan Nguyen*, Tho Tran, Stanley Osher, Hung Tran, Nhat Ho†.

[53] Self-attention amortized distributional projection optimization for sliced Wasserstein point-clouds reconstruction . Proceedings of the ICML, 2023.
Khai Nguyen*, Dang Nguyen*, Nhat Ho.

[52] Revisiting over-smoothing and over-squashing using Ollivier's Ricci curvature . Proceedings of the ICML, 2023.
Khang Nguyen, Tan Minh Nguyen, Nong Minh Hieu, Vinh Duc Nguyen, Nhat Ho†, Stanley Osher†.

[51] Hierarchical sliced Wasserstein distance. ICLR, 2023.
Khai Nguyen, Tongzheng Ren, Huy Nguyen, Litu Rout, Tan Nguyen, Nhat Ho.

[50] A primal-dual framework for transformers and neural networks. ICLR, 2023 (Spotlight).
Tan Minh Nguyen, Tam Minh Nguyen, Nhat Ho, Andrea L. Bertozzi, Richard Baraniuk, Stanley Osher.

[49] Global-local regularization via distributional robustness. AISTATS, 2023.
Hoang Phan, Trung Le, Trung Phung, Tuan Anh Bui, Nhat Ho, Dinh Phung.

[48] Model fusion of heterogeneous neural networks via cross-layer alignment . IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023 (Top 3%).
Dang Nguyen, Trang Nguyen, Khai Nguyen, Dinh Phung, Hung Bui, Nhat Ho.

[47] A probabilistic framework for pruning transformers via a finite admixture of keys . IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023 (Top 3%).
Tam Nguyen*, Tan Nguyen*, Long Bui, Hai Do, Dung Le, Hung Tran-The, Khuong Nguyen, Nhat Ho, Stanley Osher, Richard Baraniuk.

[46] Joint self-supervised image-volume representation learning with intra-inter contrastive clustering . AAAI, 2023.
Duy Nguyen, Nguyen Hoang, Truong Mai, Cao Tri, Binh Nguyen, Nhat Ho, Paul Swoboda, Shadi Albarqouni, Pengtao Xie, Daniel Sonntag.

[45] Efficient forecasting of large scale hierarchical time series via multilevel clustering . International conference on Time Series and Forecasting (ITISE), 2023.
Xing Han, Tongzheng Ren, Jing Hu, Joydeep Ghosh, Nhat Ho.

2022

[44] Convergence rates for Gaussian mixtures of experts. Journal of Machine Learning Research (JMLR), 2022.
Nhat Ho, Chiao-Yu Yang, Michael I. Jordan.

[43] On the efficiency of entropic regularized algorithms for optimal transport . Journal of Machine Learning Research (JMLR), 2022.
Tianyi Lin, Nhat Ho, Michael I. Jordan.

[42] On the complexity of approximating multi-marginal optimal transport. Journal of Machine Learning Research (JMLR), 2022.
Tianyi Lin*, Nhat Ho*, Marco Cuturi, Michael I. Jordan.

[41] Bayesian consistency with the supremum metric . Statistica Sinica, 2022.
Nhat Ho**, Stephen G. Walker**.

[40] Revisiting projected Wasserstein metric on images: from vectorization to convolution. Advances in NeurIPS, 2022.
Khai Nguyen, Nhat Ho.

[39] FourierFormer: Transformer meets generalized Fourier integral attentions . Advances in NeurIPS, 2022.
Tan Nguyen*, Minh Pham*, Tam Nguyen, Khai Nguyen, Stanley Osher, Nhat Ho.

[38] Amortized projection optimization for sliced Wasserstein generative models. Advances in NeurIPS, 2022.
Khai Nguyen, Nhat Ho.

[37] Improving Transformer with an admixture of attention heads . Advances in NeurIPS, 2022.
Tam Nguyen*, Tan Nguyen*, Hai Do, Khai Nguyen, Vishwanath Saragadam, Minh Pham, Khuong Nguyen,Stanley Osher†, Nhat Ho†.

[36] Beyond black box densities: Parameter learning for the deviated components. Advances in NeurIPS, 2022.
Dat Do*, Nhat Ho*, Long Nguyen.

[35] Stochastic multiple target sampling gradient descent . Advances in NeurIPS, 2022.
Hoang Phan, Ngoc Tran, Trung Le, Toan Tran, Nhat Ho, Dinh Phung.

[34] Refined convergence rates for maximum likelihood estimation under finite mixture models. Proceedings of the ICML, 2022 (Long Presentation).
Tudor Manole, Nhat Ho.

[33] Improving Transformers with probabilistic attention keys . Proceedings of the ICML, 2022.
Tam Nguyen*, Tan Nguyen*, Dung Le, Khuong Nguyen, Anh Tran, Richard Baraniuk, Stanley Osher†, Nhat Ho†.

[32] Entropic Gromov-Wasserstein between Gaussian distributions. Proceedings of the ICML, 2022.
Khang Le*, Dung Le*, Huy Nguyen*, Dat Do, Tung Pham, Nhat Ho.

[31] Improving minibatch optimal transport via partial transportation. Proceedings of the ICML, 2022.
Khai Nguyen, Dang Nguyen, Anh Le, Tung Pham, Nhat Ho.

[30] BoMb-OT: On batch of mini-batches optimal transport . Proceedings of the ICML, 2022.
Khai Nguyen, Dang Nguyen, Quoc Nguyen, Tung Pham, Dinh Phung, Hung Bui, Trung Le, Nhat Ho.

[29] Architecture agnostic federated learning for neural networks. Proceedings of the ICML, 2022.
Disha Makhija, Xing Han, Nhat Ho, Joydeep Ghosh.

[28] Towards statistical and computational complexities of Polyak step size gradient descent . AISTATS, 2022.
Tongzheng Ren*, Fuheng Cui*, Alexia Atsidakou*, Sujay Sanghavi, Nhat Ho.

[27] On multimarginal partial optimal transport: Equivalent forms and computational complexity. AISTATS, 2022.
Huy Nguyen*, Khang Le*, Tung Pham, Nhat Ho.

[26] On structured filtering-clustering: Global error bound and optimal first-order algorithms. AISTATS, 2022.
Nhat Ho*, Tianyi Lin*, Michael I. Jordan.

[25] Weak separation in mixture models and implications for principal stratification. AISTATS, 2022.
Avi Feller**, Evan Greif**, Nhat Ho**, Luke W. Miratrix**, Natesh S. Pillai**.

2021

[24] On posterior contraction of parameters and interpretability in Bayesian mixture modeling . Bernoulli 27 (4), 2159-2188, 2021.
Aritra Guha, Nhat Ho, XuanLong Nguyen.

[23] On efficient multilevel clustering via Wasserstein distances. Journal of Machine Learning Research (JMLR), 22, 1-43, 2021.
Viet Huynh*, Nhat Ho*, Nhan Dam, XuanLong Nguyen, Mikhail Yurochkin, Hung Bui, Dinh Phung.

[22] On robust optimal transport: Computational complexity and barycenter computation . Advances in NeurIPS, 2021.
Huy Nguyen*, Khang Le*, Quang Nguyen, Tung Pham, Hung Bui†, Nhat Ho†.

[21] Structured Dropout variational inference for Bayesian neural networks . Advances in NeurIPS, 2021.
Son Nguyen*, Duong Nguyen*, Khai Nguyen, Khoat Than, Hung Bui†, Nhat Ho†.

[20] LAMDA: Label matching deep domain adaptation. Proceedings of the ICML, 2021.
Trung Le, Tuan Nguyen, Nhat Ho, Hung Bui, Dinh Phung.

[19] Point-set distances for learning representations of 3D point clouds. International Conference on Computer Vision (ICCV), 2021.
Trung Nguyen, Hieu Pham, Tam Le, Tung Pham, Nhat Ho, Son Hua.

[18] On the minimax optimality of the EM algorithm for learning two-component mixed linear regression. AISTATS, 2021.
Jeong Y. Kwon, Nhat Ho, Constantine Caramanis.

[17] Flow-based alignment approaches for probability measures in different spaces. AISTATS, 2021.
Tam Le*, Nhat Ho*, Makoto Yamada.

[16] Distributional sliced-Wasserstein and applications to deep generative modeling. ICLR, 2021 (Spotlight).
Khai Nguyen, Nhat Ho, Tung Pham, Hung Bui.

[15] Improving relational regularized autoencoders with spherical sliced fused Gromov Wasserstein. ICLR, 2021.
Khai Nguyen, Son Nguyen, Nhat Ho, Tung Pham, Hung Bui.

2020

[14] Singularity, misspecification, and the convergence rate of EM. Annals of Statistics, 48(6), 3161-3182, 2020.
Raaz Dwivedi*, Nhat Ho*, Koulik Khamaru*, Martin J. Wainwright, Michael I. Jordan, Bin Yu.

[13] Robust estimation of mixing measures in finite mixture models. Bernoulli, 26(2), 828-857, 2020.
Nhat Ho, XuanLong Nguyen, Ya'acov Ritov.

[12] Projection robust Wasserstein distance and Riemannian optimization . Advances in NeurIPS, 2020 (Spotlight).
Tianyi Lin*, Chenyou Fan*, Nhat Ho, Marco Cuturi, Michael I. Jordan.

[11] Fixed-support Wasserstein barycenters: computational hardness and fast algorithm . Advances in NeurIPS, 2020.
Tianyi Lin, Nhat Ho, Xi Chen, Marco Cuturi, Michael I. Jordan.

[10] On unbalanced optimal transport: an analysis of Sinkhorn algorithm. Proceedings of the ICML, 2020.
Khiem Pham*, Khang Le*, Nhat Ho, Tung Pham, Hung Bui.

[9] Sharp analysis of Expectation-Maximization for weakly identifiable models. AISTATS, 2020.
Raaz Dwivedi*, Nhat Ho*, Koulik Khamaru*, Martin J. Wainwright, Michael I. Jordan, Bin Yu.

[8] Fast algorithms for computational optimal transport and Wasserstein barycenter. AISTATS, 2020.
Wenshuo Guo, Nhat Ho, Michael I. Jordan.

Before 2020

[7] Convergence rates of parameter estimation for some weakly identifiable finite mixtures. Annals of Statistics, 44(6), 2726-2755, 2016.
Nhat Ho and XuanLong Nguyen.

[6] Singularity structures and impacts on parameter estimation behavior in finite mixtures of distributions. SIAM Journal on Mathematics of Data Science (SIMODS), 1(4), 730–758, 2019.
Nhat Ho and XuanLong Nguyen.

[5] On efficient optimal transport: an analysis of greedy and accelerated mirror descent algorithms. Proceedings of the ICML, 2019.
Tianyi Lin*, Nhat Ho*, Michael I. Jordan.

[4] On strong identifiability and convergence rates of parameter estimation in finite mixtures. Electronic Journal of Statistics, 10(1), 271-307, 2016.
Nhat Ho and XuanLong Nguyen.

[3] Probabilistic multilevel clustering via composite transportation distance. AISTATS, 2019.
Nhat Ho*, Viet Huynh*, Dinh Phung, Michael I. Jordan.

[2] Theoretical guarantees for EM under misspecified Gaussian mixture models . Advances in NeurIPS, 2018.
Raaz Dwivedi*, Nhat Ho*, Koulik Khamaru*, Martin J. Wainwright, Michael I. Jordan.

[1] Multilevel clustering via Wasserstein means. Proceedings of the ICML, 2017.
Nhat Ho, XuanLong Nguyen, Mikhail Yurochkin, Hung Hai Bui, Viet Huynh, and Dinh Phung.

Phd Thesis/ Manuscripts

Parameter Estimation and Multilevel Clustering with Mixture and Hierarchical Models . Phd Thesis, University of Michigan, Ann Arbor. Advisors: Professor Long Nguyen and Professor Ya'acov Ritov.