Articles

A Tailored Framework for the Impact Assessment of Virtual Exhibitions in Glam Sector: a Case Study from Spain


Abstract


This article presents the development and initial pilot implementation of a methodological framework adapted to assess the impact of the virtual exhibition ‘The Library of the Lady of Elche’ [La Biblioteca de la Dama de Elche]. By combining a virtual exhibition creation model with the guidelines of the Europeana Impact Playbook, the proposed framework structures the definition of objectives, stakeholders, impact types and value lenses with specific evaluation indicators. The proposal addresses three dimensions of impact while prioritising the assessment of online reach through data from the exhibition’s digital dissemination strategies. The measurement process is based on web traffic, social media activity, academic citations and participation in both scholarly and public outreach events, demonstrating the effectiveness of designing digital cultural projects with an impact-oriented approach within the GLAM (Galleries, Libraries, Archives, Museums) sector.


Keywords


Virtual exhibitions; Dissemination of bibliographic heritage; GLAM institutions; Impact measurement; Lady of Elche

Full Text:

PDF


DOI: http://dx.doi.org/10.2423/i22394303v15n2p103

References


Angeloni, R. (2022). Digitization and Virtual Experience of Museum Collections. The Virtual Tour

of the Civic Art Gallery of Ancona. SCIRES-IT - SCIentific RESearch and

Information Technology, 12(2), 29-42. http://dx.doi.org/10.2423/i22394303v12n2p29

Arquero-Avilés, R., Marco-Cuenca, G., & Cobo-Serrano, S. (2023). Exposiciones virtuales del patrimonio cultural en instituciones GLAM. In R. Arquero-Avilés (Coord.). Patrimonio e instituciones GLAM (galerías, bibliotecas, archivos y museos): innovación, gestión y difusión. Gijón: Trea.

Barbieri, L., Bruno, F., & Muzzupappa, M. (2017). Virtual museum system evaluation through user studies. Journal of Cultural Heritage, 26, 101-108. https://doi.org/10.1016/j.culher.2017.02.005

Bellini, N., Bergamasco, M., Brehonnet, R., Carrozzino, M., & Lagier, J. (2018). Virtual Cultural Experiences: The Drivers of Satisfaction. Symphonya. Emerging Issues in Management, 2, 52-65. http://dx.doi.org/10.4468/2018.2.5bellini.bergamasco.brehonnet.carozzino.lagier

Borrego, A. (2020). Measuring the Impact of Digital Heritage Collections Using Google Scholar. Information Technology and Libraries, 39(2). https://doi.org/10.6017/ital.v39i2.12053

Chen, A., Pickle, S., & Waldroup, H. (2015). Changing and expanding libraries: exhibitions, institutional repositories, and the future of academia. In J. C. Maclachlan, E. A. Waraksa & C. Williford (Eds.). The Process of Discovery (pp. 62-81). https://clir.wordpress.clir.org/wp-content/uploads/sites/6/pub167.pdf

Content Reuse Working Group, & DLF Assessment Interest Group. (2023). Measure the impact of your digital collections. Digital Content Reuse Assessment Framework Toolkit (D-CRAFT). https://reuse.diglib.org/

DARIAH. Impactomatrix. https://dariah-de.github.io/Impactomatrix/

Digital Library Federation (2015). Best Practices for Google Analytics in Digital Libraries. https://osf.io/th8av

Dyson, M.C., & Moran, K.M. (2000). Informing the Design of Web Interfaces to Museum Collections. Museum Management and Curatorship, 18, 391 - 406.

EMOTIVE. Storytelling for virtual heritage, https://emotiveproject.eu/

Europeana (2022). Europeana Impact Playbook online resource. https://pro.europeana.eu/page/europeana-impact-playbook

Fisher, M., Twiss-Garrity, B.A., & Sastre, A. (2008). The Art of Storytelling: Enriching Art Museum Exhibits and Education through Visitor Narratives. Museums and the Web 2008: Proceedings. Toronto: Archives & Museum Informatics. https://www.archimuse.com/mw2008/papers/fisher/fisher.html

Franco, P.D.G., Matthews, J.L., & Matlock, T. (2016). Framing the past: How virtual experience affects bodily description of artefacts. Journal of Cultural Heritage, 17, 179–187.

Frandsen, T.F., Sørensen, K.M., & Anne Merete, L.F. (2021). Library stories: A systematic review of narrative aspects within and around libraries. Journal of Documentation, 77(5), 1128-1141. https://doi.org/10.1108/JD-10-2020-0182

Fornerino M., Helme-Guizon A., & Gotteland D. (2008). Movie consumption experience and immersion: Impact on satisfaction. Recherche et Applications en Marketing (English Edition), 23(3), 93–110. https://doi.org/10.1177/205157070802300306

Fukuyama, J., & Tanner, S. (2022). Impact assessment indicators for the UK web archive. Performance Measurement and Metrics, 23(1), 13-25. https://doi.org/10.1108/PMM-09-2021-0049

Global Evaluation Initiative (2022). Better Evaluation knowledge platform. https://www.betterevaluation.org/

Global Libraries (2015). Impact Planning and Assessment Guide. http://www.publiclibraryadvocacy.org/wp-content/uploads/2015/06/IPA-Guide-2015.pdf

Herrera Morillas, J. L. (2005). Las bibliotecas y las exposiciones virtuales: orientaciones para su diseño. Scire: Representación y organización Del Conocimiento, 11(1), 113–122. https://doi.org/10.54886/scire.v11i1.1511

IFLA (2010). Guidelines for easy-to-read materials, revision by Misako Nomura, Gyda Skat Nielsen and Bror Tronbacke. The Hague: IFLA (IFLA Professional Reports; 120).

Inclusion Europe (2017). Information for all. European standards for making information easy to read and understand. Brussels: Inclusion Europe.

INDICATE (2012). Handbook on virtual exhibitions and virtual performances. https://www.indicate-project.eu/

INDICES. Measuring the impact of digital culture. https://indices-culture.eu/

ISO (2014). Information and documentation. Methods and procedures for assessing the impact of libraries.

Kabassi, K. (2017). Evaluating websites of museums: state of the art. Journal of Cultural Heritage, 24, 184–196, https://doi.org/10.1016/j.culher.2016.10.016

Kabassi, K., Amelio, A., Komianos, V., & Oikonomou, K. (2019). Evaluating Museum Virtual Tours: The Case Study of Italy. Information, 10(11), 351. https://doi.org/10.3390/info10110351

Karacan, E., & Resta, G. (2020). Virtual exhibition and visitor experience: how digital storytelling enhances online exhibition spaces. In Y. Aksoy & E. Duyan (Eds.), Contemporary issues in architecture: Ecology, urban environment, experience (pp. 135-154). Istanbul: DAKAM.

Konkiel, S., Dalmau, M., & Scherer, D. (2015). Altmetrics and analytics for digital special collections and institutional repositories (Version 1). figshare. https://doi.org/10.6084/m9.figshare.1392140.v1

Laugwitz, B., Held, T., & Schrepp, M. (2008). Construction and evaluation of a user experience questionnaire. In: A. Holzinger (Ed.), HCI and Usability for Education and Work (pp. 63–76). Berlin: Springer. https://doi.org/10.1007/978-3-540-89350-9_6

Lee, K.J., King, W.E., Dahya, N., & Lee, J.H. (2020). Librarian perspectives on the role of virtual reality in public libraries. Proceedings of the Association for Information Science and Technology, 57(e254). https://doi.org/10.1002/pra2.254

Marsh, D.E. (2023). Digital knowledge sharing: perspectives on use, impacts, risks, and best practices according to Native American and Indigenous community-based researchers. Archival Science, 23, 81–115. https://doi.org/10.1007/s10502-021-09378-9

Marsh, D.E., Punzalan, R.L., Leopold, R., Butler, B., & Petrozzi, M. (2016). Stories of impact: the role of narrative in understanding the value and impact of digital collections. Archival Science, 16, 327–372. https://doi.org/10.1007/s10502-015-9253-5

ME-MIND. Museum events. Measuring impact on local environment with data analytics. https://www.memind.eu/

Meyer, E.T. (2011). Splashes and Ripples: Synthesizing Evidence on the Impact of Digital Resources. London: JISC. http://ssrn.com/abstract=1846535

Munilla, G., García, D., & Solanilla, L. (2003). TIC y patrimonio: seguimiento, evaluación y estudio de público. Museo virtual y museo presencial. UOC (Documento de proyecto). https://www.uoc.edu/in3/dt/20093/20093.pdf

Nielsen, J. (1994a). Heuristic evaluation. In J. Nielsen & R.L. Mack (Eds.), Usability Inspection Methods. New York: John Wiley & Sons.

Nielsen, J. (1994b). 10 Usability Heuristics for User Interface Design. Nielsen Norman Group. https://www.nngroup.com/articles/ten-usability-heuristics/

NEMO. MOI Framework. https://www.ne-mo.org/resources/moi-self-evaluation-tool

Olmedo-Pagés, E.L., & Arquero-Avilés, R. (2024). Building bridges to an accessible culture for all: integrating easy-to-read into virtual exhibitions. AIB Studi, 64(1), 73-83. https://doi.org/10.2426/AIBSTUDI-14069

Polys, N., Roshan, S., Newton, E., Narula, M., & Thai, B.T. (2022). Designing for Social Interactions in a Virtual Art Gallery. In C. Mouton, M. Preda & I. Thouvenin (Eds.), Proceedings of the 27th International Conference on 3D Web Technology. https://dl.acm.org/doi/abs/10.1145/3564533.3564562

Punzalan, R.L., Marsh, D.E., & Cools, K. (2017). Beyond Clicks, Likes, and Downloads: Identifying Meaningful Impacts for Digitized Ethnographic Archives. Archivaria, 84, 61-102. https://archivaria.ca/index.php/archivaria/article/view/13614

Resta, G., Dicuonzo, F., Karacan, E., & Pastore, D. (2021). The impact of virtual tours on museum exhibitions after the onset of covid‐19 restrictions: visitor engagement and long-term perspectives. SCIentific RESearch and Information Technology, 11(1), 151-166. http://dx.doi.org/10.2423/i22394303v11n1p151

Rosli, H., Kamaruddin, N., & Shamsarini, N. (2022). A Contextual Document Review on the Digital Storytelling Process for Museum Exhibition, E-BPJ, 7(SI7). http://dx.doi.org/10.21834/ebpj.v7iSI7.3835

SAA-ACRL/RBMS (2018). Standardized statistical measures and metrics for public services in archival repositories and special collections libraries. http://bit.ly/3GXZe4J

Siso-Calvo, B., & Arquero-Avilés, R. (2023). El concepto GLAM (galerías, bibliotecas, archivos y museos) en perspectiva: una visión integradora. In R. Arquero Avilés (Coord.). Patrimonio e instituciones GLAM (galerías, bibliotecas, archivos y museos): innovación, gestión y difusión. Gijón: Trea

Sutcliffe, A., & Gault, B. (2004). Heuristic evaluation of virtual reality applications. Interacting with Computers, 16, 831–849. https://doi.org/10.1016/j.intcom.2004.05.001

Sylaiou, S., Dafiotis, P., Koukopoulos, D., Koukoulis, K., Vital, R., Antoniou, A., & Fidas, Ch. (2024). From physical to virtual art exhibitions and beyond: Survey and some issues for consideration for the metaverse, Journal of Cultural Heritage, 66, 86-98. https://doi.org/10.1016/j.culher.2023.11.002

Sylaiou, S., Kasapakis, V., Gavalas, D., & Djardanova, E. (2020). Avatars as storytellers: affective narratives in virtual museums. J. Pers. Ubiquitous Comput., 24(6), 829-841, 10.1007/s00779-019-01358-2

Tanner, S. (2012). Measuring the Impact of Digital Resources: The Balanced Value Impact Model. King's College London. http://www.kdcs.kcl.ac.uk/innovation/impact.html

Tanner, S. (2016). Using Impact as a Strategic Tool for Developing the Digital Library via the Balanced Value Impact Model. Library Leadership & Management, 30(4). https://doi.org/10.5860/llm.v30i4.7146

Tanner, S. (2020a). Delivering impact with digital resources: planning strategy in the attention economy. Facet Publishing

Tanner, S. (2020b). The Balanced Value Impact Model. https://www.bvimodel.org/

Williams, R.D., Dumas, C., Chow, A., Hofman, D. and MacLeod, J. (2024), Why VR? Exploring the Intersection of Virtual Reality and Information Science. Proceedings of the Association for Information Science and Technology, 61: 833-835. https://doi.org/10.1002/pra2.1112


Article Metrics

Metrics Loading ...

Metrics powered by PLOS ALM

Refbacks

  • There are currently no refbacks.


Copyright (c) 2025 Brenda Siso-Calvo, Gonzalo Marco-Cuenca, Rosario Arquero-Avilés

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

 

 

SCIRES-IT, e-ISSN 2239-4303

Journal founded by Virginia Valzano