FacePipe: A Low-Cost Solution for 3D Facial Animation
DOI:
https://doi.org/10.5753/jbcs.2026.8232Keywords:
Facial animation, Facial motion capture, UsabilityAbstract
This paper presents FacePipe, a low-cost 3D facial capture and animation solution based on a conventional RGB camera and integrated with Blender. The system was developed from design requirements derived from an exploratory review, workflow analysis, and technology-selection criteria focused on low-cost hardware availability, interoperability, usability, openness, and maintainability. FacePipe consists of a MediaPipe-based capture module, a structured local data management and export workflow, and a dedicated Blender add-on that converts captured blendshape coefficients into editable animation data. The solution was evaluated through a Hierarchical Task Analysis comparing FacePipe, FaceCap, and a MetaHuman-based workflow, and through a between-subjects usability study comparing FacePipe and FaceCap with an adapted UEQ+ questionnaire. The evaluation addresses workflow structure and perceived user experience, but it does not establish objective tracking-accuracy equivalence between FacePipe and FaceCap. Results indicate that both tools were evaluated positively, but with distinct workflow profiles. FaceCap was rated more favorably in setup, perceived dependability, and Blender integration, while FacePipe showed a descriptive advantage in file export and organization and comparable perceived usability during recording. These findings suggest that FacePipe is a viable low-cost alternative for editable facial animation workflows, especially in contexts that value widely available RGB-camera-based capture, structured local file management, open implementation, and integration with Blender.
Downloads
References
Baltrušaitis, T. et al. (2018). OpenFace 2.0: Facial behavior analysis toolkit. In Proceedings of the 13th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2018), pages 59-66, Xi'an, China. IEEE. DOI: 10.1109/FG.2018.00019.
Baxter, M. (1995). Product Design. CRC Press, Boca Raton, FL, 1 edition. DOI: 10.1201/9781315275246.
Beane, A. (2012). 3D Animation Essentials. John Wiley & Sons, Hoboken, NJ, 1 edition. DOI: 10.3389/fcomp.2025.1598099.
Benyon, D. (2013). Designing Interactive Systems: A Comprehensive Guide to HCI, UX and Interaction Design. Pearson, Harlow, UK. Book.
Brooke, J. (1996). SUS: A ``quick and dirty'' usability scale. In Jordan, P. W. et al., editors, Usability Evaluation in Industry, pages 189-194. Taylor & Francis, London. DOI: 10.1201/9781498710411.
Chatziagapi, A. and Samaras, D. (2023). AVFace: Towards detailed audio-visual 4D face reconstruction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 16878-16889, Los Alamitos, CA. IEEE Computer Society. DOI: 10.1109/CVPR52729.2023.01619.
Chhatre, K., Guarese, R., Matviienko, A., and Peters, C. E. (2025). Evaluation of generative models for emotional 3d animation generation in vr. Frontiers in Computer Science, Volume 7 - 2025. DOI: 10.3389/fcomp.2025.1598099.
Cudeiro, D., Bolkart, T., Laidlaw, C., Ranjan, A., and Black, M. J. (2019). Capture, learning, and synthesis of 3d speaking styles. In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 10093-10103. DOI: 10.1109/CVPR.2019.01034.
Danecek, R. et al. (2022). EMOCA: Emotion driven monocular face capture and animation. arXiv preprint arXiv:2204.11312. DOI: 10.48550/arXiv.2204.11312.
de Carvalho Cruz, A. T. and Xavier Natario Teixeira, J. M. (2021). A review regarding the 3d facial animation pipeline. In Proceedings of the 23rd Symposium on Virtual and Augmented Reality, pages 192-196. DOI: 10.1145/3488162.3488226.
Ekman, P. and Friesen, W. V. (1978). Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto, CA. DOI: 10.1037/t27734-000.
Fan, Y., Lin, Z., Saito, J., Wang, W., and Komura, T. (2022). Faceformer: Speech-driven 3d facial animation with transformers. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 18749-18758. DOI: 10.1109/CVPR52688.2022.01821.
Feng, Y. et al. (2021). Learning an animatable detailed 3D face model from in-the-wild images. arXiv preprint arXiv:2012.04012. DOI: 10.48550/arXiv.2012.04012.
Freitas-Magalhães, A. (2018). Facial Action Coding System 3.0: Manual of Scientific Codification of the Human Face. Escrytos, Lisboa. Book.
Gatti Jr., W., Gonçalves, M. A., and Paes, A. C. (2014). Um estudo exploratório sobre a indústria brasileira de animação para a TV. Revista Eletrônica de Administração, 20(2):461-495. DOI: 10.1590/1413-2311057201238250.
Google (2025). Meet Flow: AI-powered filmmaking with Veo 3. Google Blog. Available at: [link] Acesso em: 03 jan. 2026.
Hackos, J. T. and Redish, J. C. (1998). User and Task Analysis for Interface Design. Wiley, New York, NY. Available at: [link].
Hausman, A. (2019). Keep the classic cartoons current. The Prowler News. Available at: [link] Acesso em: 2 nov. 2020.
Hernandez, M. et al. (2012). Laser scan quality 3-D face modeling using a low-cost depth camera. In Proceedings of the European Signal Processing Conference (EUSIPCO), pages 1995-1999, Bucharest, Romania. Available at: [link].
Karras, T. et al. (2017). Audio-driven facial animation by joint end-to-end learning of pose and emotion. ACM Transactions on Graphics, 36(4). DOI: 10.1145/3072959.3073658.
Kerlow, I. V. (2009). The art of 3D computer animation and effects. Wiley, Hoboken, NJ, 4 edition. Available at: [link].
Kling AI (2025). Motion control. Available at: [link] Acesso em: 03 jan. 2026.
LeCun, Y., Bengio, Y., and Hinton, G. (2015). Deep learning. Nature, 521:436-444. DOI: 10.1038/nature14539.
Lewis, J. et al. (2013). UMUX-LITE: when there's no time for the SUS. In Proceedings of the CHI Conference on Human Factors in Computing Systems, pages 2099-2102, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/2470654.2481287.
Lewis, J. P. (1991). Automated lip-sync: background and techniques. Journal of Visualization and Computer Animation, 2(4):118-122. DOI: 10.1002/VIS.4340020404.
Li, T. et al. (2017). Learning a model of facial shape and expression from 4D scans. ACM Transactions on Graphics, 36(6):1-17. DOI: 10.1145/3130800.3130813.
Ma, S. et al. (2024). 3D Gaussian blendshapes for head avatar animation. In Proceedings of the ACM SIGGRAPH Conference, pages 1-10, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3641519.3657462.
Ma, Y. et al. (2025). Controllable video generation: a survey. arXiv preprint arXiv:2507.16869. Acesso em: 03 jan. 2026. DOI: 10.48550/arXiv.2507.16869.
Mao, J. Y. et al. (2001). User-centered design methods in practice: a survey of the state of the art. In Proceedings of the 2001 conference of the Centre for Advanced Studies on Collaborative research (CASCON '01), page 12. IBM Press. Available at: [link].
Marcotte, E. (2011). Responsive web design. Editions Eyrolles. Available at: [link].
Mitchell, B. (2017). Independent animation: developing, producing and distributing your animated films. CRC Press, Boca Raton, FL, 1 edition. DOI: 10.1201/9781315363974.
Nielsen, J. (1993). Usability Engineering. Morgan Kaufmann, San Diego. DOI: 10.1016/C2009-0-21512-1.
Norman, D. A. (2004). Emotional Design: Why We Love (or Hate) Everyday Things. Basic Books, New York, NY. Book.
Norman, D. A. (2013). The Design of Everyday Things: Revised and Expanded. Basic Books, New York, NY. Book.
Orvalho, V. et al. (2012). A facial rigging survey. In Eurographics 2012 - State of the Art Reports, pages 183-204, Cagliari, Italy. The Eurographics Association. DOI: 10.2312/conf/EG2012/stars/183-204.
Parke, F. I. (1972). Computer generated animation of faces. In Proceedings of the ACM annual conference - Volume 1 (ACM '72), pages 451-457, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/800193.569955.
Parke, F. I. (1974). A Parametric Model for Human Faces. PhD thesis, The University of Utah. Available at: [link] Acesso em: 6 ago. 2021.
Parke, F. I. (1982). Parameterized models for facial animation. IEEE Computer Graphics and Applications, 2(9):61-68. DOI: 10.1109/MCG.1982.1674492.
Parke, F. I. and Waters, K. (2008). Computer Facial Animation. A K Peters/CRC Press, Boca Raton, FL, 2 edition. DOI: 10.1201/b10705.
Pham, H. X., Cheung, S., and Pavlovic, V. (2017). Speech-driven 3d facial animation with implicit emotional awareness: A deep learning approach. In 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pages 2328-2336. DOI: 10.1109/CVPRW.2017.287.
Pighin, F. and Lewis, J. P. (2006). Facial motion retargeting. In ACM SIGGRAPH 2006 Courses (SIGGRAPH '06), pages 2-es, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/1185657.1185842.
Ping, Y. et al. (2013). Computer facial animation: A review. International Journal of Computer Theory and Engineering, 5(6):658-662. DOI: 10.7763/IJCTE.2013.V5.770.
Richard, A., Zollhöfer, M., Wen, Y., de la Torre, F., and Sheikh, Y. (2021). Meshtalk: 3d face animation from speech using cross-modality disentanglement. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV), pages 1153-1162. DOI: 10.1109/ICCV48922.2021.00121.
Rogers, Y., Sharp, H., and Preece, J. (2019). Interaction Design: Beyond Human-Computer Interaction. John Wiley & Sons, Chichester, 5 edition. Book.
Sauro, J. (2015). SUPR-Q: a comprehensive measure of the quality of the website user experience. Journal of Usability Studies, 10(2):68-86. Available at: [link].
Schrepp, M., Hinderks, A., and Thomaschewski, J. (2017). Construction of a benchmark for the User Experience Questionnaire (UEQ). International Journal of Interactive Multimedia and Artificial Intelligence, 4(4):40-44. DOI: 10.9781/ijimai.2017.445.
Schrepp, M., Sandkühler, H., and Thomaschewski, J. (2021). How to create short forms of UEQ+ based questionnaires? In Mensch und Computer 2021-Workshopband. Gesellschaft für Informatik e.V.. DOI: 10.18420/muc2021-mci-ws01-230.
Schrepp, M. and Thomaschewski, J. (2019). Design and validation of a framework for the creation of user experience questionnaires. International Journal of Interactive Multimedia and Artificial Intelligence, 5(3):88-95. DOI: 10.9781/ijimai.2019.06.006.
Stanton, N. A. (2006). Hierarchical task analysis: Developments, applications, and extensions. Applied Ergonomics, 37(1):55-79. DOI: 10.1016/j.apergo.2005.06.003.
Sturman, D. J. (1994). A brief history of motion capture for computer character animation. In Proceedings of the International Conference on Computer Graphics and Interactive Techniques (SIGGRAPH), New York, NY, USA. Association for Computing Machinery. Available at: [link] Acesso em: 7 dez. 2020.
Sze, V. et al. (2017). Efficient processing of deep neural networks: A tutorial and survey. arXiv preprint arXiv:1703.09039. DOI: 10.48550/arXiv.1703.09039.
Taylor, S., Kim, T., Yue, Y., Mahler, M., Krahe, J., Rodriguez, A. G., Hodgins, J., and Matthews, I. (2017). A deep learning approach for generalized speech animation. ACM Trans. Graph., 36(4). DOI: 10.1145/3072959.3073699.
Terzopoulos, D. and Waters, K. (1990). Physically-based facial modelling, analysis, and animation. Journal of Visualization and Computer Animation, 1(2):73-80. DOI: 10.1002/vis.4340010208.
Tolstikhin, I. O., Houlsby, N., Kolesnikov, A., Beyer, L., Zhai, X., Unterthiner, T., Yung, J., Steiner, A., Keysers, D., Uszkoreit, J., et al. (2021). Mlp-mixer: An all-mlp architecture for vision. Advances in neural information processing systems, 34:24261-24272. Available at: [link].
Tschang, T. F. and Goldstein, A. (2004). Production and political economy in the animation industry: why insourcing and outsourcing occur. In Proceedings of the DRUID Summer Conference, Copenhagen, Denmark. Copenhagen Business School. Available at: [link] Acesso em: 7 dez. 2025.
Villar, O. (2014). Learning Blender: A Hands-On Guide to Creating 3D Animated Characters. Addison-Wesley Professional, Boston, MA, 1 edition. Book.
Wang, L. et al. (2022). FaceVerse: a fine-grained and detail-controllable 3D face morphable model from a hybrid dataset. arXiv preprint arXiv:2203.14057. DOI: 10.48550/arXiv.2203.14057.
Xing, J., Xia, M., Zhang, Y., Cun, X., Wang, J., and Wong, T.-T. (2023). Codetalker: Speech-driven 3d facial animation with discrete motion prior. In 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 12780-12790. DOI: 10.1109/CVPR52729.2023.01229.
Zhang, H. et al. (2025). GSmoothFace: Generalized smooth talking face generation via fine grained 3D face guidance. IEEE Transactions on Visualization and Computer Graphics, 31(10):8231-8242. DOI: 10.1109/TVCG.2025.3566382.
Zheng, M. et al. (2025). ImFace++: A sophisticated nonlinear 3D morphable face model with implicit neural representations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(2):994-1012. DOI: 10.1109/TPAMI.2024.3480151.
Zhou, Y., Xu, Z., Landreth, C., Kalogerakis, E., Maji, S., and Singh, K. (2018). Visemenet: audio-driven animator-centric speech animation. ACM Trans. Graph., 37(4). DOI: 10.1145/3197517.3201292.
Zhu, C. and Joslin, C. (2024a). A facial motion retargeting pipeline for appearance agnostic 3D characters. Computer Animation and Virtual Worlds, 35(6):e70001. DOI: 10.1002/cav.70001.
Zhu, C. and Joslin, C. (2024b). A review of motion retargeting techniques for 3D character facial animation. Computers & Graphics, 123. DOI: 10.1016/j.cag.2024.104037.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Artur Tavares de Carvalho Cruz, Calíope Corrêa de Araújo, Willams de Lima Costa, Fabiana Frata Furlan Peres, Walter F M Correia, Alexandre Siqueira, Fatima L S Nunes, Joao Marcelo Teixeira
This work is licensed under a Creative Commons Attribution 4.0 International License.
