This study investigates whether user engagement during multimedia viewing can be predicted from self-reported affective and experiential variables. The analysis is based on data collected from 112 participants who watched seven movie clips and completed a four-item post-viewing Likert questionnaire after each clip, reporting prior knowledge of the clip, user experience (UX), engagement (EN), and emotional experience (EX). In addition, a dominant-emotion label derived from the clip-level emotional characterization was included as one of the input variables. Using stratified 10-fold cross-validation repeated 30 times, we evaluated 40 machine-learning classifiers under 5-class, 3-class, and 2-class engagement settings. The best-performing model was a 2-class Wide Artificial Neural Network, which achieved an average accuracy above 87% with a weighted F1-score above 0.87. Models with fewer output classes consistently outperformed the 5-class setting, highlighting a trade-off between granularity and predictive reliability, although these results should be interpreted in light of the lower difficulty of coarser classification tasks. Correlation analysis, Somers’ D, and feature permutation importance converged in showing that emotional experience is the strongest predictor of engagement, followed by user experience. These findings should be interpreted as a benchmark based on subjective post-viewing measures rather than as a real-time multimodal sensing system. Nevertheless, the study offers a useful baseline for future work integrating physiological, behavioral, or audiovisual signals into adaptive context-aware systems.

Human Engagement and Multimedia Content: A Predictive Study Based on Self-Reported Affective and Experiential Variables

Antonio Di Tecco
;
2026-01-01

Abstract

This study investigates whether user engagement during multimedia viewing can be predicted from self-reported affective and experiential variables. The analysis is based on data collected from 112 participants who watched seven movie clips and completed a four-item post-viewing Likert questionnaire after each clip, reporting prior knowledge of the clip, user experience (UX), engagement (EN), and emotional experience (EX). In addition, a dominant-emotion label derived from the clip-level emotional characterization was included as one of the input variables. Using stratified 10-fold cross-validation repeated 30 times, we evaluated 40 machine-learning classifiers under 5-class, 3-class, and 2-class engagement settings. The best-performing model was a 2-class Wide Artificial Neural Network, which achieved an average accuracy above 87% with a weighted F1-score above 0.87. Models with fewer output classes consistently outperformed the 5-class setting, highlighting a trade-off between granularity and predictive reliability, although these results should be interpreted in light of the lower difficulty of coarser classification tasks. Correlation analysis, Somers’ D, and feature permutation importance converged in showing that emotional experience is the strongest predictor of engagement, followed by user experience. These findings should be interpreted as a benchmark based on subjective post-viewing measures rather than as a real-time multimodal sensing system. Nevertheless, the study offers a useful baseline for future work integrating physiological, behavioral, or audiovisual signals into adaptive context-aware systems.
File in questo prodotto:
File Dimensione Formato  
Paper.pdf

accesso aperto

Descrizione: Paper
Tipologia: Documento in Post-print/Accepted manuscript
Licenza: Copyright dell'editore
Dimensione 296.75 kB
Formato Adobe PDF
296.75 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11382/588872
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
social impact