Inequality-Constrained 3D Morphable Face Model Fitting
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024-02 · 46 (2) · 1305-1318
DOI: 10.1109/tpami.2023.3334948 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024-02. Verfasst von Evangelos Sariyanidi und 3 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 57 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NICHD NIH HHS, NIMH NIH HHS, National Institutes of Health.
Abstract (Originalsprache)
3D morphable model (3DMM) fitting on 2D data is traditionally done via unconstrained optimization with regularization terms to ensure that the result is a plausible face shape and is consistent with a set of 2D landmarks. This paper presents inequality-constrained 3DMM fitting as the first alternative to regularization in optimization-based 3DMM fitting. Inequality constraints on the 3DMM's shape coefficients ensure face-like shapes without modifying the objective function for smoothness, thus allowing for more flexibility to capture person-specific shape details. Moreover, inequality constraints on landmarks increase robustness in a way that does not require per-image tuning. We show that the proposed method stands out with its ability to estimate person-specific face shapes by jointly fitting a 3DMM to multiple frames of a person. Further, when used with a robust objective function, namely gradient correlation, the method can work "in-the-wild" even with a 3DMM constructed from controlled data. Lastly, we show how to use the log-barrier method to efficiently implement the method. To our knowledge, we present the first 3DMM fitting framework that requires no learning yet is accurate, robust, and efficient. The absence of learning enables a generic solution that allows flexibility in the input image size, interchangeable morphable models, and incorporation of camera matrix.
Förderung
- NICHD NIH HHS
- NIMH NIH HHS
- National Institutes of Health
- Office of the Director
- National Institute of Child Health and Human Development
- National Institute of Mental Health
- CHOP/Penn
Zitieren
APA
Sariyanidi, E., Zampella, C. J., Schultz, R. T., & Tunc, B. (2024). Inequality-Constrained 3D Morphable Face Model Fitting. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(2), 1305-1318. https://doi.org/10.1109/tpami.2023.3334948
Vancouver
Sariyanidi E, Zampella CJ, Schultz RT, Tunc B. Inequality-Constrained 3D Morphable Face Model Fitting. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2024;46(2):1305-1318. doi:10.1109/tpami.2023.3334948
BibTeX
@article{Sariyanidi2024,
author = {Sariyanidi, Evangelos and Zampella, Casey J and Schultz, Robert T and Tunc, Birkan},
title = {Inequality-Constrained 3D Morphable Face Model Fitting},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2024},
volume = {46},
number = {2},
pages = {1305--1318},
doi = {10.1109/tpami.2023.3334948}
}
EUVIMED