EFFICIENT DISCRETE MULTI-MARGINAL OPTIMAL TRANSPORT REGULARIZATION
2023•par.nsf.gov
Optimal transport has emerged as a powerful tool for a variety of problems in machine
learning, and it is frequently used to enforce distributional constraints. In this context, existing
methods often use either a Wasserstein metric, or else they apply concurrent barycenter
approaches when more than two distributions are considered. In this paper, we leverage
multi-marginal optimal transport (MMOT), where we take advantage of a procedure that
computes a generalized earth mover's distance as a sub-routine. We show that not only is …
learning, and it is frequently used to enforce distributional constraints. In this context, existing
methods often use either a Wasserstein metric, or else they apply concurrent barycenter
approaches when more than two distributions are considered. In this paper, we leverage
multi-marginal optimal transport (MMOT), where we take advantage of a procedure that
computes a generalized earth mover's distance as a sub-routine. We show that not only is …
Optimal transport has emerged as a powerful tool for a variety of problems in machine learning, and it is frequently used to enforce distributional constraints. In this context, existing methods often use either a Wasserstein metric, or else they apply concurrent barycenter approaches when more than two distributions are considered. In this paper, we leverage multi-marginal optimal transport (MMOT), where we take advantage of a procedure that computes a generalized earth mover’s distance as a sub-routine. We show that not only is our algorithm computationally more efficient compared to other barycentric-based distance methods, but it has the additional advantage that gradients used for backpropagation can be efficiently computed during the forward pass computation itself, which leads to substantially faster model training. We provide technical details about this new regularization term and its properties, and we present experimental demonstrations of faster runtimes when compared to standard Wasserstein-style methods. Finally, on a range of experiments designed to assess effectiveness at enforcing fairness, we demonstrate our method compares well with alternatives.
par.nsf.gov
Showing the best result for this search. See all results