Interactive rapid prototyping combining 3D Printing and Augmented Reality




Augmented Reality, Virtual Reality, Interactive Rapid Prototyping, 3D Printing


In the development of new products by the industry, a rapid prototyping stage is recommended so that an initial version of the product can be evaluated. In this way, any necessary corrections can be applied while still in the prototyping stage, preventing design errors from reaching the final product. Augmented Reality (AR) and 3D Printing are techniques that have become ubiquitous in recent years due to the reduction of equipment costs. Several works in the area of rapid prototyping have been developed with one of these techniques in isolation; a few works have tried to unite these two tools. In this work, we propose a new functional rapid prototyping process, combining 3D Printing and AR to create functional interactive prototypes. This process is accomplished by projecting the AR onto the 3D-printed prototype. It interprets the user’s gestures on the physical prototype, converting clicks and touches into actions to be executed on the AR virtual prototype, making the prototype functional and interactive. The proposed system is evaluated by means of case studies and the application of the UEQ (User Experience Questionnaire) to users who have tested the system. This way, it is possible to evaluate the relevance of the proposed process.


Download data is not yet available.


Abulrub, A. H. G., Attridge, A. N., and Williams, M. A. (2011). Virtual reality in engineering education: The future of creative learning. In 2011 IEEE Global Engineering Education Conference (EDUCON), pages 751–757. DOI: 10.1109/EDUCON.2011.5773223.

Akaoka, E., Ginn, T., and Vertegaal, R. (2010). Display objects: Prototyping functional physical interfaces on 3d styrofoam, paper or cardboard models. In Proceedings of the Fourth International Conference on Tangible, Embedded, and Embodied Interaction, TEI ’10, pages 49–56, New York, NY, USA. ACM. DOI: 10.1145/1709886.1709897.

Alexander, C. et al. (2009). Value proposition development of early stage computational fluid dynamics analysis in automotive product development. PhD thesis, Massachusetts Institute of Technology.

An, S.-G., Kim, Y., Lee, J. H., and Bae, S.-H. (2017). Collaborative experience prototyping of automotive interior in vr with 3d sketching and haptic helpers. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI ’17, pages 183–192, New York, NY, USA. ACM. DOI: 10.1145/3122986.3123002.

Arrighi, P.-A. and Mougenot, C. (2019). Towards user empowerment in product design: a mixed reality tool for interactive virtual prototyping. Journal of Intelligent Manufacturing, 30(2):743–754. DOI: 10.1007/s10845-016-1276-0.

Balcisoy, S., Kallmann, M., Fua, P., and Thalmann, D. (2000). A framework for rapid evaluation of prototypes with augmented reality. In Proceedings of the ACM symposium on Virtual reality software and technology, pages 61–66. ACM.

Baxter, M. (1995). Product design: A practical guide to systematic methods of new product development.

Brooke, J. (1996). Sus: a ’quick and dirty’ usability. Usability evaluation in industry, 189.

Choi, S. and Chan, A. (2004). A virtual prototyping system for rapid product development. Computer-Aided Design, 36(5):401 – 412. DOI:

Fernandes, A. S., Wang, R. F., and Simons, D. J. (2015). Remembering the physical as virtual: Source confusion and physical interaction in augmented reality. In Proceedings of the ACM SIGGRAPH Symposium on Applied Perception, SAP ’15, pages 127–130, New York, NY, USA. ACM. DOI: 10.1145/2804408.2804423.

Furht, B. (2011). Handbook of augmented reality. Springer Science & Business Media.

Gibson, I., Rosen, D., and Stucker, B. (2014). Additive manufacturing technologies: 3D printing, rapid prototyping, and direct digital manufacturing. Springer.

Gieser, S. N., Gentry, C., LePage, J., and Makedon, F. (2016). Comparing objective and subjective metrics between physical and virtual tasks. In Lackey, S. and Shumaker, R., editors, Virtual, Augmented and Mixed Reality: 8th International Conference, VAMR 2016, Held as Part of HCI International 2016, Toronto, Canada, July 17-22, 2016. Proceedings, pages 3–13, Cham. Springer International Publishing. DOI: 10.1007/978-3-319-39907-21.

Hassenzahl, M., Burmester, M., and Koller, F. (2003). AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität, pages 187–196. Vieweg+Teubner Verlag, Wiesbaden. DOI: 10.1007/978-3-322-80058-919.

Katakura, S. and Watanabe, K. (2018). Protohole: Prototyping interactive 3d printed objects using holes and acoustic sensing. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, CHI EA ’18, pages LBW112:1–LBW112:6, New York, NY, USA. ACM. DOI: 10.1145/3170427.3188471.

Khan, T., Johnston, K., and Ophoff, J. (2019). The impact of an augmented reality application on learning motivation of students. Advances in Human-Computer Interaction, 2019:7208494. DOI: 10.1155/2019/7208494.

Kirakowski, J. and Corbett, M. (1993). Sumi: The software usability measurement inventory. British journal of educational technology, 24(3):210–212.

Laugwitz, B., Held, T., and Schrepp, M. (2008). Construction and evaluation of a user experience questionnaire. In Holzinger, A., editor, HCI and Usability for Education and Work, pages 63–76, Berlin, Heidelberg. Springer Berlin Hei-delberg.

Lee, S. S. (2008). Blender. US Patent App. 29/305,015.

Lee, W. and Park, J. (2005). Augmented foam: A tangible augmented reality for product design. In Proceedings of the 4th IEEE/ACM international symposium on mixed and augmented reality, pages 106–109. IEEE Computer Society.

Leite, J. V. d. F., Teixeira, J. M. X. N., and Teichrieb, V. (2016). Optimizing 3D Object Visualization on the Web, pages 287–298. Springer International Publishing, Cham. DOI: 10.1007/978-3-319-39907-227.

Lewis, J. R. (2002). Psychometric evaluation of the pssuq using data from five years of usability studies. International Journal of Human-Computer Interaction, 14(3-4):463–488.

Macdonald, E., Salas, R., Espalin, D., Perez, M., Aguilera, E., Muse, D., and Wicker, R. B. (2014). 3d printing for the rapid prototyping of structural electronics. IEEE access, 2:234–242.

Mantova, A. R., Ferreira, A. C. M., da Cruz Landim, P., and Marar, J. F. (2016). Escala dos questionários para análise da experiência do usuário: Estudo preliminar. Blucher Design Proceedings, 2(9):1130–1137.

Marner, M. R., Smith, R. T., Porter, S. R., Broecker, M. M., Close, B., and Thomas, B. H. (2011). Large scale spatial augmented reality for design and prototyping. In Handbook of Augmented Reality, pages 231–254. Springer.

Montgomery, D. C. and Runger, G. C. (2021). Estatística aplicada e probabilidade para engenheiros (7nd ed.). LTC, Rio de Janeiro (RJ).

Morozova, A., Rheinstädter, V., and Wallach, D. (2019). Mixe-dux: A mixed prototyping framework for usability testing in augmented reality. In Companion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion, DIS ’19 Companion, pages 41–44, New York, NY, USA. ACM. DOI: 10.1145/3301019.3325146.

Noorani, R. (2006). Rapid prototyping: principles and applications. John Wiley & Sons Incorporated.

Omaia, D. (2023a). 3d car toy prototype using the cypirp. [link].

Omaia, D. (2023b). 3dcar-cypirp [link]

Park, H., Moon, H.-C., and Lee, J. Y. (2009). Tangible augmented prototyping of digital handheld products. Computers in Industry, 60(2):114–125.

Park, H. and Park, J.-I. (2010). Invisible marker-based augmented reality. International Journal of Human-Computer Interaction, 26(9):829–848. DOI: 10.1080/10447318.2010.496335.

Porter, S. R., Marner, M. R., Smith, R. T., Zucco, J. E., and Thomas, B. H. (2010). Validating spatial augmented reality for interactive rapid prototyping. In 2010 IEEE International Symposium on Mixed and Augmented Reality, pages 265–266. DOI: 10.1109/ISMAR.2010.5643599.

Punchoojit, L. and Hongwarittorrn, N. (2017). Usability studies on mobile user interface design patterns: A systematic literature review. Advances in Human-Computer Interaction, 2017:6787504. DOI: 10.1155/2017/6787504.

Rauschenberger, M., Schrepp, M., Pérez Cota, M., Olschner, S., and Thomaschewski, J. (2013). Efficient measurement of the user experience of interactive products. how to use the user experience questionnaire (ueq). example: Spanish language version. DOI: 10.9781/ijimai.2013.215.

Sauro, J. and Lewis, J. R. (2016). Quantifying the user experience: Practical statistics for user research. Morgan Kaufmann.

Schrepp, M., Hinderks, A., and Thomaschewski, J. (2017). Construction of a benchmark for the user experience questionnaire (ueq). International Journal of Interactive Multimedia and Artificial Intelligence, 4:40–44. DOI: 10.9781/iji-mai.2017.445.

Schrepp, M., Hinderks, A., and Thomaschewski, J. (2022). User Experience Questionnaire (UEQ). [link]. [Online; accessed 30-June-2022].

Shen, Y., Ong, S. K., and Nee, A. Y. C. (2011). Vision-based hand interaction in augmented reality environment. International Journal of Human–Computer Interaction, 27(6):523–544. DOI: 10.1080/10447318.2011.555297.

Simões, F., Bezerra, M., Teixeira, J. M., Correia, W., and Teichrieb, V. (2016). A user perspective analysis on augmented vs 3d printed prototypes for product’s project design. In 2016 XVIII Symposium on Virtual and Augmented Reality (SVR), pages 71–80. DOI: 10.1109/SVR.2016.22.

Simon, T. (2012). Tangible spatial augmented reality in rapid prototyping: Multiple and differential tangible object manipulation and interaction.

Stocklein, J., Geiger, C., Paelke, V., and Pogscheba, P. (2009). Poster: Mvce - a design pattern to guide the development of next generation user interfaces. In 2009 IEEE Symposium on 3D User Interfaces, pages 153–154. DOI: 10.1109/3DUI.2009.4811232.

Stöcklein, J., Pogscheba, P., Geiger, C., and Paelke, V. (2010). Mireas: A mixed reality software framework for iterative prototyping of control strategies for an indoor airship. In Proceedings of the 7th International Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa, AFRIGRAPH ’10, pages 27–36, New York, NY, USA. ACM. DOI: 10.1145/1811158.1811164.

Teixeira, J. M., Barros, G., Teichrieb, V., and Correia, W. F. (2016). 3d printing as a means for augmenting existing surfaces. In 2016 XVIII Symposium on Virtual and Augmented Reality (SVR), pages 24–28. DOI: 10.1109/SVR.2016.15.

Tziouvara, I. (2012). Integration of 3d tracking systems for interaction in spatial augmented reality. DOI: uuid:acc16325-1c25-445d-ac3c-02c3e89170d4.

Unity (2022). Unity real-time development platform | 3d, 2d vr & ar engine.

Verlinden, J. (2014). Developing an Interactive Augmented Prototyping Methodology to Support Design Reviews. urn:nbn:nl:ui:24-uuid:253876ef-b158-4aa1-b39a- 7d35fd76f753, TU Delft, Delft University of Technology.

Vuforia (2020). Vuforia developer portal.

Zampelis, D., Loudon, G., Gill, S., and Walker, D. (2012). Iris: Augmented reality in rapid prototyping.

Zorriassatine, F., Wykes, C., Parkin, R., and Gindy, N. (2003). A survey of virtual prototyping techniques for mechanical product development. Proceedings of the institution of mechanical engineers, Part B: Journal of engineering manufacture, 217(4):513–530.




How to Cite

OMAIA, D.; CORREIA, W. F. M.; SANTOS, A. L. M. Interactive rapid prototyping combining 3D Printing and Augmented Reality. Journal on Interactive Systems, Porto Alegre, RS, v. 15, n. 1, p. 20–35, 2024. DOI: 10.5753/jis.2024.3534. Disponível em: Acesso em: 12 jul. 2024.



Regular Paper