Articles

Narrative-driven XR for Cultural Heritage: a comparative evaluation of augmented and virtual reality experiences.


Abstract


This paper investigates the role of narrative-driven XR experiences in supporting cultural heritage interpretation through a comparative analysis of Augmented Reality (AR) and Virtual Reality (VR). Using the Church of Santa Maria in Muris (Italy) as a case study, two parallel experiences were developed. A user-centered evaluation approach was adopted to assess learning outcomes, engagement, usability, and perceived cultural value. Results show that both modalities effectively support comprehension and engagement, with AR enhancing contextual and exploratory learning through spatial integration within the physical environment, and VR providing a fully immersive and controlled virtual setting that supports a coherent and guided interpretation of narrative content. The findings highlight the complementary nature of AR and VR and the importance of narrative design, interaction, and spatial context in XR experiences.


Keywords


Digital Replica; AI-assisted narrative guides; Extended Reality; UX evaluation; Cultural Heritage

Full Text:

PDF


DOI: http://dx.doi.org/10.2423/i22394303v16n1p19

References


Angeloni, R. (2022). Digitization and Virtual Experience of Museum Collections. The Virtual Tour of the Civic Art Gallery of Ancona. SCIRES-IT - SCIentific RESearch and Information Technology, 12(2), 29–42. https://doi.org/10.2423/i22394303v12n2p29

Ariya, P., Worragin, P., Khanchai, S., Poollapalin, D., & Julrode, P. (2026). Voice, text, or embodied AI avatar? Effects of generative AI interface modalities in VR museums. Informatics, 13(3),42. https://doi.org/10.3390/informatics13030042

Banfi, F., Cazzani, A., & Liu, W. (2025). XR technologies for enhanced cultural engagement: From HBIM to a comparative analysis of VR and WebVR development tools. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLVIII-M-9-2025, 95–102. https://doi.org/10.5194/isprs-archives-XLVIII-M-9-2025-95-2025

Bekele, M. K., & Champion, E. (2019). A comparison of immersive realities and interaction methods: Cultural learning in virtual heritage. Frontiers in Robotics and AI, 6, 91.https://doi.org/10.3389/frobt.2019.00091

Bekele, M. K., Pierdicca, R., Frontoni, E., Malinverni, E. S., & Gain, J. (2018). A survey of augmented, virtual, and mixed reality for cultural heritage. Journal on Computing and Cultural Heritage, 11(2), 7:1–7:36. https://doi.org/10.1145/3145534

Beltran Alvarado, G. A. B. (2023). Augmented Reality (AR) in education, medicine and industry: a systematic review of literature. SCIRES-IT - SCIentific RESearch and Information Technology, 13(1), 153– 166. https://doi.org/10.2423/i22394303v13n1p153

Bertolini, S., Piemonte, A., Caroti, G., Bevilacqua, M. G., Capriuoli, F., Rinaldi, E., Santillo, D., & Muccilli, I. (2024). Integrated 3D survey methodologies and digital platforms for the enhancement of archaeological data in the digital transition. SCIRES-IT - SCIentific RESearch and Information Technology, 14(2), 107–124. https://doi.org/10.2423/i22394303v14n2p107

Bozzelli, G., Raia, A., Ricciardi, S., De Nino, M., Barile, N., Perrella, M., Tramontano, M., Pagano, A., & Palombini, A. (2019). An integrated VR/AR framework for user-centric interactive experience of cultural heritage: The ArkaeVision project. Digital Applications in Archaeology and Cultural Heritage, 15. https://doi.org/10.1016/j.daach.2019.e00124

Cirafici, A., Langella, C., Palmieri, A., & Giordano, G. (2025). AI and Digital Technologies for a New Narrative of Archaeological Heritage. SCIRES-IT - SCIentific RESearch and Information Technology, 15(2), 19–34. https://doi.org/10.2423/i22394303v15n2p19

Clini, P., Angeloni, R., D'Alessio, M., Coppetta, L., & Galli, I. (2025). Digital representation and AI-driven virtual experience for historic houses: The case study of Borgo Storico Seghetti Panichi. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLVIII-M-9-2025, 337–344. https://doi.org/10.5194/isprs-archives-XLVIII-M-9-2025-337-2025

Clini, P., Angeloni, R., D’Alessio, M., & Ferretti, U. (2024). Narrare l’inaccessibile: Un virtual immersive movie per le grotte di Palazzo Campana. In Misura/Dismisura: ideare, conoscere, narrare. 45° Convegno internazionale dei docenti delle discipline della rappresentazione. Congresso della Unione Italiana per il Disegno (pp. 2647–2666). https://doi.org/10.3280/oa-1180-c604

Clini, P., Angeloni, R., D’Alessio, M., & Quarchioni, R. (2023). Enhancing onsite and online museum experience through digital reconstruction and reproduction: The Raphael and Angelo Colocci temporary exhibition. SCIRES-IT - SCIentific RESearch and Information Technology, 13(2), 71–84. https://doi.org/10.2423/i22394303v13n2p71

Clini, P., Nespeca, R., Ferretti, U., Galazzi, F., & Bernacchia, M. (2025). Inclusive museum engagement: Multisensory storytelling of Cagli Warriors’ journey and the Via Flamina landscape through interactive tactile experiences and digital replicas. Heritage, 8(2), 61. https://doi.org/10.3390/heritage8020061

DaCosta, B. (2025). Speaking with the past: Constructing AI-generated historical characters for cultural heritage and learning. Heritage, 8(9), 387. https://doi.org/10.3390/heritage8090387

De-Dato, P., Hernández-Navarro, Y., & Cantatore, E. (2025). Conserving architectural heritage through hybrid strategies and open technologies in the phygital era. SCIRES-IT - SCIentific RESearch and Information Technology, 15(2), 121–136. https://doi.org/10.2423/i22394303v15n2p121

Gabellone, F., & Desantis, V. (2025). A philological approach for the 3D reconstruction of the Messapian walls of Manduria in an augmented reality project. SCIRES-IT - SCIentific RESearch and Information Technology, 15(2), 35–52. https://doi.org/10.2423/i22394303v15n2p35

Galasso, F. (2025). Digital narratives for the enhancement of minor historical heritage. SCIRES-IT - SCIentific RESearch and Information Technology, 15(2), 85–102. https://doi.org/10.2423/i22394303v15n2p85

Gao, F., Fang, K., & Chan, W. K. (2024). Humanizing artifacts: An educational game for cultural heritage artifacts and history using generative AI. In CHI-PLAY Companion 2024 - Companion Proceedings of the Annual Symposium on Computer-Human Interaction in Play (pp. 91–96).. https://doi.org/10.1145/3665463.3678792

Gao, H., Lindquist, M., & Serrano Vergel, R. (2024). AI-driven avatars in immersive 3D environments for education workflow and case study of the Temple of Demeter, Greece. Journal of Digital Landscape Architecture, 9, 640–651.https://doi.org/10.14627/537752059

García-León, J., Sánchez-Allegue, P., Peña-Velasco, C., Cipriani, L., & Fantini, F. (2018). Interactive dissemination of the 3D model of a Baroque altarpiece: A pipeline from digital survey to game engines. SCIRES-IT - SCIentific RESearch and Information Technology, 8(2), 59–76. https://doi.org/10.2423/i22394303v8n2p59

Gong, Q., Zou, N., Yang, W., Zheng, Q., & Chen, P. (2024). User experience model and design strategies for virtual reality-based cultural heritage exhibition. Virtual Reality, 28(2), 69. https://doi.org/10.1007/s10055-024-00942-z

Gonizzi Barsanti, S., Guagliano, M., & Rossi, A. (2022). 3D reality-based survey and retopology for structural analysis of cultural heritage. Sensors, 22(24), 9593. https://doi.org/10.3390/s22249593

Guarnieri, A., Fissore, F., Masiero, A., & Vettore, A. (2017). From TLS survey to 3D solid modeling for documentation of built heritage: The case study of Porta Savonarola in Padua. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-2-W5, 303–308. https://doi.org/10.5194/isprs-archives-XLII-2-W5-303-2017

Innocente, C., Ulrich, L., Moos, S., & Vezzetti, E. (2023). A framework study on the use of immersive XR technologies in the cultural heritage domain. Journal of Cultural Heritage, 62, 268–283.. https://doi.org/10.1016/j.culher.2023.06.001

Jakob, W., Tarini, M., Panozzo, D., & Sorkine-Hornung, O. (2015). Instant field-aligned meshes. ACM Transactions on Graphics, 34(6), 189. doi:10.1145/2816795.2818078

Konstantakis, M., Aliprantis, J., Teneketzis, A., & Caridakis, G. (2018). Understanding user experience aspects in cultural heritage interaction. In Proceedings of the 22nd Pan-Hellenic Conference on Informatics (pp. 267–271). https://doi.org/10.1145/3291533.3291580

Koo, S., Kim, J., Kim, C., Kim, J., & Cha, H. S. (2019). Development of an augmented reality tour guide for a cultural heritage site. Journal on Computing and Cultural Heritage, 12(4), 21. https://doi.org/10.1145/3317552

Lo Pilato, A., Scandurra, S., Palomba, D., & Di Luggo, A. (2023). Valorizing cultural heritage by employing digital technologies for survey and communication: The Church of San Vincenzo Ferreri. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLVIII-M-2-2023, 969– 975. https://doi.org/10.5194/isprs-Archives-XLVIII-M-2-2023-969-2023

Loureiro, S. M. C., Guerreiro, J., & Ali, F. (2020). 20 years of research on virtual reality and augmented reality in tourism context: A text-mining approach. Tourism Management, 77, 102120. https://doi.org/10.1016/j.tourman.2019.104028

Milgram, P., & Kishino, F. (1994). A taxonomy of mixed reality visual displays. IEICE Transactions on Information and Systems, 77(12), 1321–1329 http://vered.rose.utoronto.ca/people/paul_dir/IEICE94/ieice.html

Moga, E. S., Hernández-Muñoz, Ó., & Sánchez-Ortiz, A. (2022). 3D scanning for comparative analysis of manufacture and deterioration tracking: A case study of the 18th century wax Venus de’ Medici. SCIRES-IT - SCIentific RESearch and Information Technology, 12(1), 1–18.

Natale, S., Surace, B., Mensa, E., & Befera, L. (2025). ChatGPT for cultural heritage and the customization of generative AI: A talkthrough analysis of the Luigi Einaudi chatbot. New Media & Society. https://doi.org/10.1177/14614448251384258

Ntoa, S. (2025). Usability and user experience evaluation in intelligent environments: A review and reappraisal. International Journal of Human–Computer Interaction, 41(5), 2829–2858. https://doi.org/10.1080/10447318.2024.2394724

Pepe, M., Alfio, V. S., & Costantino, D. (2022). UAV platforms and the SfM-MVS approach in the 3D surveys and modelling: A review in the cultural heritage field. Applied Sciences, 12(24), 12866. https://doi.org/10.3390/app122412886

Saccucci, M., & Pelliccio, A. (2025). SFM as visual enargeia of damage in paintings. SCIRES-IT - SCIentific RESearch and Information Technology, 15(1), 131–140. https://doi.org/10.2423/i22394303v15n1p131

Sanfilippo, F., Tataru, M., Hua, M. T., Johansson, I. J. S., & Andone, D. (2025). Gamifying cultural immersion: Virtual reality and mixed reality in city heritage. IEEE Transactions on Games, 17(4), 893–911. https://doi.org/10.1109/TG.2025.3553712

Singh, P., Pahuja, N., Kansal, M., Gurung, S., Shukla, U., & Gupta, S. (2024). Enhancing tourism experiences and preserving cultural heritage with AR and VR. In 2nd International Conference on Disruptive Technologies, ICDT 2024 (pp. 225–231). https://doi.org/10.1109/ICDT61202.2024.10489490

Souropetsis, M., & Kyza, E. A. (2025). CompARe: Design and development of a gamified augmented reality learning environment for cultural heritage sites. Journal on Computing and Cultural Heritage, 18(1), 14. https://doi.org/10.1145/3703917

Sylaiou, S., & Fidas, C. (2022). Virtual humans in museums and cultural heritage sites. Applied Sciences, 12(19), 9913. https://doi.org/10.3390/app12199913

Theodoropoulos, A., & Antoniou, A. (2022). VR games in cultural heritage: A systematic review of the emerging fields of virtual reality and culture games. Applied Sciences, 12(17), 8476. https://doi.org/10.3390/app12178476

Trunfio, M., Della Lucia, M., Campana, S., & Magnelli, A. (2022). Innovating the cultural heritage museum service model through virtual reality and augmented reality: The effects on the overall visitor experience and satisfaction. Journal of Heritage Tourism, 17(1), 1–19. https://doi.org/10.1080/1743873X.2020.1850742

Vasileva, S., & McNeilly, N. (2024). Measuring the instances and value of digital cultural heritage reuse. L'Aia, Paesi Bassi: Europeana Foundation.

Wang, H., Gao, Z., Zhang, X., Du, J., Xu, Y., & Wang, Z. (2024). Gamifying cultural heritage: Exploring the potential of immersive virtual exhibitions. Telematics and Informatics Reports, 15, 100150. https://doi.org/10.1016/j.teler.2024.100150

Wilkinson, C. M., Roughley, M., Liu, C. Y. J., Shrimpton, S., Davidson, C., & Dickinson, T. (2026). The affordances of AI-powered, deepfake, avatar creator systems in archaeological facial depiction and the related changes in the cultural heritage sector. Applied Sciences, 16(2), 1023. https://doi.org/10.3390/app16021023

Zhang, J., Wan Yahaya, W. A. J., & Sanmugam, M. (2024). The impact of immersive technologies on cultural heritage: A bibliometric study of VR, AR, and MR applications. Sustainability, 16(15), 6446. https://doi.org/10.3390/su16156446

Zhao, J., Ma, Y., Zhang, X., Lin, H., Lu, Y., Wu, R., . . . Zou, F. (2025). An empirical study on the impact of different interaction methods on user emotional experience in cultural digital design. Sensors, 25(17), 5273. https://doi.org/10.3390/s25175273

Zhao, Y., Li, Y., Dai, T., Sedini, C., Wu, X., Jiang, W., . . . LC, R. (2025). Virtual reality in heritage education for enhanced learning experience: A mini-review and design considerations. Frontiers in Virtual Reality, 6, 1560594. https://doi.org/10.3389/frvir.2025.1560594


Article Metrics

Metrics Loading ...

Metrics powered by PLOS ALM

Refbacks

  • There are currently no refbacks.


Copyright (c) 2026 Paolo Clini, Renato Angeloni, Laura Coppetta

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

 

 

SCIRES-IT, e-ISSN 2239-4303

Journal founded by Virginia Valzano