A Frontal Reference Gallery Transfers Unevenly Across Head Poses in CMU Captures
Abstract
All thirty-two frontal queries in a complete sixteen-person CMU subset were identified by a frontal-only reference gallery. That perfect within-condition score concealed uneven transfer: left, right, and upward queries reached 65.63%, 78.13%, and 96.88% accuracy. The left-minus-frontal difference was -34.38 percentage points, with a working interval from -60.42 to -8.33; the right and upward intervals included zero. The comparison keeps query expression categories and identity membership common across poses. It shows why a favorable frontal result should not stand for uniform capture-condition performance, while remaining limited to raw whole-image matching on a small familiar roster.
Capture-condition comparison with a common known-identity roster. Head poses are source labels, not randomized treatments or inferred camera angles.
Original publication: November 1, 2026.
References
- He, Xuanhua; Liu, Quande; Qian, Shengju; Wang, Xin; Hu, Tao; Cao, Ke; Yan, Keyu; Zhang, Jie. (2024). ID-Animator: Zero-Shot Identity-Preserving Human Video Generation. arXiv:2404.15275. https://arxiv.org/abs/2404.15275.
- Cao, Qiong, et al. "VGGFace2: A dataset for recognising faces across pose and age" arXiv preprint arXiv:1710.08092, 2017. https://arxiv.org/abs/1710.08092.
- Cook, R. Dennis. (1977). Detection of Influential Observation in Linear Regression. Technometrics. https://doi.org/10.1080/00401706.1977.10489493.
- Benjamini, Yoav and Yosef Hochberg. “Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing.” Journal of the Royal Statistical Society Series B: Statistical Methodology, vol. 57, no. 1, 1995, pp. 289-300. https://doi.org/10.1111/j.2517-6161.1995.tb02031.x.
- Turk, M.A.; Pentland, A.P.. (1991). Face recognition using eigenfaces. Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. https://doi.org/10.1109/cvpr.1991.139758.
- Ovadia, Yaniv, et al. “Can You Trust Your Model’s Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift.” Advances in Neural Information Processing Systems, vol. 32, 2019. https://arxiv.org/abs/1906.02530.
- AT&T Laboratories Cambridge. (2026). Modified Olivetti faces: Sam Roweis MATLAB version [Data archive; mirror accessed 7 November 2026]. File identity and row-label layout verified against the scikit-learn maintainer loader. https://ndownloader.figshare.com/files/5976027.
- Meng, Zijie; Liu, Jiwen; Liu, Yufei; Tong, Chengzhuo; Liu, Xiaoqiang; Zhang, Yuanxing; Xu, Yulong; Wan, Pengfei. (2026). ARGUS: Stacked Multi-View Identity Mosaic Injection for Subject-Preserving Video Generation. arXiv:2606.11670. https://arxiv.org/abs/2606.11670.
- Gal, Rinon, et al. "An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversion." arXiv preprint arXiv:2208.01618, 2022. https://arxiv.org/abs/2208.01618.
- White, Halbert. “A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity.” Econometrica, vol. 48, no. 4, 1980, pp. 817-838. https://doi.org/10.2307/1912934.
- Schroff, Florian, et al. "FaceNet: A Unified Embedding for Face Recognition and Clustering" arXiv preprint arXiv:1503.03832, 2015. https://arxiv.org/abs/1503.03832.
- Ren, Weiming; Yang, Huan; Zhang, Ge; Wei, Cong; Du, Xinrun; Huang, Wenhao; Chen, Wenhu. (2024). ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generation. arXiv:2402.04324. https://arxiv.org/abs/2402.04324.
- Wilkinson, Mark D.; Dumontier, Michel; Aalbersberg, IJsbrand Jan; Appleton, Gabrielle; Axton, Myles; Baak, Arie; Blomberg, Niklas; Boiten, Jan-Willem; da Silva Santos, Luiz Bonino; Bourne, Philip E.; Bouwman, Jildau; Brookes, Anthony J.; Clark, Tim; Crosas, Mercè; Dillo, Ingrid; Dumon, Olivier; Edmunds, Scott; Evelo, Chris T.; Finkers, Richard; Gonzalez-Beltran, Alejandra; Gray, Alasdair J.G.; Groth, Paul; Goble, Carole; Grethe, Jeffrey S.; Heringa, Jaap; ’t Hoen, Peter A.C; Hooft, Rob; Kuhn, Tobias; Kok, Ruben; Kok, Joost; Lusher, Scott J.; Martone, Maryann E.; Mons, Albert; Packer, Abel L.; Persson, Bengt; Rocca-Serra, Philippe; Roos, Marco; van Schaik, Rene; Sansone, Susanna-Assunta; Schultes, Erik; Sengstag, Thierry; Slater, Ted; Strawn, George; Swertz, Morris A.; Thompson, Mark; van der Lei, Johan; van Mulligen, Erik; Velterop, Jan; Waagmeester, Andra; Wittenburg, Peter; Wolstencroft, Katherine; Zhao, Jun; Mons, Barend. (2016). The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data. https://doi.org/10.1038/sdata.2016.18.
- Huang, Gary B., Marwan Mattar, Tamara Berg, and Erik Learned-Miller. "Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments." ECCV Workshop on Faces in Real-Life Images, 2008. https://cs.umass.edu/~elm/papers/Huang_eccv2008-lfw.pdf.
- Gebru, Timnit, et al. "Datasheets for datasets" Communications of the ACM, 2021. https://doi.org/10.1145/3458723.
- Kemelmacher-Shlizerman, Ira, et al. "The MegaFace Benchmark: 1 Million Faces for Recognition at Scale" arXiv preprint arXiv:1512.00596, 2015. https://arxiv.org/abs/1512.00596.
- Stevens, S. S.. (1946). On the Theory of Scales of Measurement. Science. https://doi.org/10.1126/science.103.2684.677.
- Varma, Sudhir and Richard Simon. “Bias in error estimation when using cross-validation for model selection.” BMC Bioinformatics, vol. 7, no. 1, 2006. https://doi.org/10.1186/1471-2105-7-91.
- Carnegie Mellon University. (2026). Neural Networks for Face Recognition: companion data and file documentation [Original educational archive; accessed8November2026]. https://www.cs.cmu.edu/~tom/faces.html.
- Belhumeur, P.N.; Hespanha, J.P.; Kriegman, D.J.. (1997). Eigenfaces vs. Fisherfaces: recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence. https://doi.org/10.1109/34.598228.
- Wang, Hao, et al. "CosFace: Large Margin Cosine Loss for Deep Face Recognition" arXiv preprint arXiv:1801.09414, 2018. https://arxiv.org/abs/1801.09414.
- Meng, Qiang, et al. "MagFace: A Universal Representation for Face Recognition and Quality Assessment." arXiv preprint arXiv:2103.06627, 2021. https://arxiv.org/abs/2103.06627.
- Kumari, Nupur; Zhang, Bingliang; Zhang, Richard; Shechtman, Eli; Zhu, Jun-Yan. (2022). Multi-Concept Customization of Text-to-Image Diffusion. arXiv:2212.04488. https://arxiv.org/abs/2212.04488.
- Mitchell, Tom. (1997). CMU Face Images [Dataset]. UCI Machine Learning Repository. https://doi.org/10.24432/C5JC79.
- Gneiting, Tilmann; Raftery, Adrian E. (2007). Strictly Proper Scoring Rules, Prediction, and Estimation. Journal of the American Statistical Association. https://doi.org/10.1198/016214506000001437.
- Kärkkäinen, Kimmo and Jungseock Joo. "FairFace: Face Attribute Dataset for Balanced Race, Gender, and Age" arXiv preprint arXiv:1908.04913, 2019. https://arxiv.org/abs/1908.04913.
- Kim, Minchul, et al. "AdaFace: Quality Adaptive Margin for Face Recognition." arXiv preprint arXiv:2204.00964, 2022. https://arxiv.org/abs/2204.00964.
- Li, Zhen, et al. "PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embedding." arXiv preprint arXiv:2312.04461, 2023. https://arxiv.org/abs/2312.04461.
- Roberts, David R., et al. “Cross-validation strategies for data with temporal, spatial, hierarchical, or phylogenetic structure.” Ecography, vol. 40, no. 8, 2017, pp. 913-929. https://doi.org/10.1111/ecog.02881.
- Samaria, F.S.; Harter, A.C.. (1994). Parameterisation of a stochastic model for human face identification. Proceedings of 1994 IEEE Workshop on Applications of Computer Vision. https://doi.org/10.1109/acv.1994.341300.
Published
Issue
Section
License
Copyright (c) 2026 Blake King, Noah Knight, Benjamin Lewis

This work is licensed under a Creative Commons Attribution 4.0 International License.