Sound Caption for Immersive Experience

This paper explores the role of sound as a tool for communication and accessibility in experiencing cultural heritage in VR. Through experimental studies conducted over six years, we analyze various immersive technologies, including CAVE and Oculus, to understand the impact of the auditory dimension on the user experience. Following a theoretical contextualization and an exploratory journey through various cultural themes, we delve into the analysis of a specific immersive environment and the compositional process of a “sound caption” specifically designed for a virtual context. We present and analyze the data collected to measure the level of engagement generated by this sonic implementation.