Coupling matrix manifolds assisted optimization for optimal transport problems

• Published in: Machine learning Vol. 110; no. 3; pp. 533 - 558
• Main Authors: Shi, Dai, Gao, Junbin, Hong, Xia, Boris Choy, S. T., Wang, Zhiyong
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.03.2021; Springer Nature B.V
• Subjects: Algorithms; Artificial Intelligence; Computer Science; Control; Coupling; Entropy; Fisher information; Linear programming; Machine Learning; Manifolds (mathematics); Mechatronics; Natural Language Processing (NLP); Optimization; Robotics; Simulation and Modeling; Sinkhorn algorithm; Wasserstein distance; Doubly stochastic matrices; Entropy regularized optimal transport; Optimal transport; Coupling matrix manifold
• ISSN: 0885-6125; 1573-0565; 1573-0565
• DOI: 10.1007/s10994-020-05931-2

Optimal transport (OT) is a powerful tool for measuring the distance between two probability distributions. In this paper, we introduce a new manifold named as the coupling matrix manifold (CMM), where each point on this novel manifold can be regarded as a transportation plan of the optimal transport problem. We firstly explore the Riemannian geometry of CMM with the metric expressed by the Fisher information. These geometrical features can be exploited in many essential optimization methods as a framework solving all types of OT problems via incorporating numerical Riemannian optimization algorithms such as gradient descent and trust region algorithms in CMM manifold. The proposed approach is validated using several OT problems in comparison with recent state-of-the-art related works. For the classic OT problem and its entropy regularized variant, it is shown that our method is comparable with the classic algorithms such as linear programming and Sinkhorn algorithms. For other types of non-entropy regularized OT problems, our proposed method has shown superior performance to other works, whereby the geometric information of the OT feasible space was not incorporated within.