Hugh Alexander von Arnim

• Christodoulou, Anna-Maria; Arnim, Hugh Alexander von & Jensenius, Alexander Refsum (2025). Supporting Narrative Comprehension in Programmatic Music through Music and Light. In McArthur, Angela; Matthews, Emma-Kate & Holberton, Tom (Ed.), Proceedings of the 17th International Symposium on Computer Music Multidisciplinary Research. The Laboratory PRISM ¡°Perception, Representations, Image, Sound, Music¡±. ISSN 9791097498061. p. 447¨C454. doi: 10.5281/zenodo.17509282. Full text in Research Archive Show summary

  Programmatic music, such as Tchaikovsky¡¯s Overture Romeo and Juliet, relies on the audience¡¯s ability to associate musical motifs with narrative elements. This is a demanding task for less experienced listeners, particularly when cues are subtle, such as those conveyed through timbre. This paper explores how dynamic stage lighting, driven by physiological signals, can enhance narrative comprehension in orchestral performance. Using the LightHearted interactive lighting system, different characters of the Overture were mapped to distinct colored lights, whose intensities were dynamically modulated in real time by the heart rates of the conductor and selected musicians. This integration aimed to convey subtle narrative cues to the audience in real time. Audience feedback suggests that this approach not only clarifies musical narratives but also enhances the overall experience.

• Rolfsjord, Sigmund Johannes Ljosvoll; Fatima, Safia; Arnim, Hugh Alexander von & Baselizadeh, Adel (2025). Multimodal Transfer Learning for Privacy in Human Activity Recognition. In Emilia, Barakova,; Ben, Allouch, Somaya; Kazuhiro, Nakadai, & Goldie, Nejat, (Ed.), Proceedings of the IEEE International Conference on Robot and Human Interactive Communication (RO-MAN) 2025. IEEE (Institute of Electrical and Electronics Engineers). ISSN 9798331587710. p. 15¨C20. doi: 10.1109/ro-man63969.2025.11217600. Full text in Research Archive Show summary

  IEEE International Conference on Robot & Human Interactive Communication (RO-MAN) This conference is a leading forum where state-of-the-art innovative results, the latest developments as well as future perspectives relating to robot and human interactive communication are presented and discussed. The conference covers a wide range of topics related to Robot and Human Interactive Communication, involving theories, methodologies, technologies, empirical and experimental studies. Papers related to the study of robotic technology, psychology, cognitive science, artificial intelligence, human factors, ethics and policies, interaction-based robot design and other topics related to human-robot interaction are welcome.

• Arnim, Hugh Alexander von; Erdem, Cagri; C?t¨¦-Allard, Ulysse Teller Masao & Jensenius, Alexander Refsum (2025). A Sensor is not a Sensor: Diffracting the Preservation of Sonic Microinteraction with the SiFiBand. In Sei?a, Mariana & Wirfs-Brock, Jordan (Ed.), AM '25: Proceedings of the 20th International Audio Mostly Conference. Association for Computing Machinery (ACM). ISSN 9798400720659. p. 318¨C325. doi: 10.1145/3771594.3771626. Full text in Research Archive Show summary

  This paper documents our exploratory work to preserve the interactive music system Stillness Under Tension¡ªdeveloped to explore inverse sonic microinteraction¡ªby porting it from the original and discontinued Myo sensor armband to SiFiBand, a new prototype armband with motion (IMU) and muscle (EMG) sensors. We approach this by merging the Multilevel Dynamic Preservation model with a ¡°diffraction-in-action¡± method grounded in a theoretical entanglement perspective. Rather than focusing on the Myo version¡¯s artefactual remains, we explore the difference in data representations offered by the two devices as our point of departure. The paper describes the sensor devices, evaluating their data representations given their technical specifications, and describing how these differences propagate throughout our attempt to preserve the system, enacting necessary changes. We discuss the implications of merging these methods in view of the long-term preservation of interactive music systems. Our version 2.0 of Stillness Under Tension finds itself experientially in a position between familiarity and newness.

• Arnim, Hugh Alexander von; Kelkar, Tejaswinee & Noven, Live (2025). Motion Pointillism: The (Re/De)Construction of the Normative Body through Motion Capture. Documenta: tijdschrift voor theater. ISSN 0771-8640. 42(1), p. 51¨C79. doi: 10.21825/documenta.93271. Full text in Research Archive Show summary

  Marker-based, optical motion capture systems make use of reflective markers, interpreting them as clusters of dimensionless points in space. Before labeling and arranging these markers, potentially to fit a model of a kinematic chain, these markers possess little referentiality to objects in physical space. However, the construction of a kinematic model of the human body requires making several assumptions about the body and its affordances. In this article, we problematize the use of the kinematic model in dance performance that employs motion capture, placing focus on the referentiality of visual representations derived from markers and models while examining how motion capture contributes to the construction of the body through the embedding of assumptions and values about what a body is and can do within the technology. Through the design and conceptualization of two interactive dance performances titled Reconfigurations and The Shapeshifter, we develop an approach to working with motion capture that we term motion pointillism, which aims to resist the systemic assumptions embedded in the modeling process. This approach conceptualizes the emergence of the dimensionless points¡¯ referentiality to a human body as a collaborative component of system development and performance, which occurs both in the design of visual representations as well as in the viewers¡¯ perception.

• Thorsen, Ola; Esema, Emmanuel Joseph; Hemaz, Said; Ellefsen, Kai Olav; Herrebr?den, Henrik & Arnim, Hugh Alexander von [Show all 7 contributors for this article] (2024). Can machine learning help reveal the competitive advantage of elite beach volleyball players? In Westphal, Florian; Peretz-Andersson, Einav; Riveiro, Maria; Bach, Kerstin & Heintz, Fredrik (Ed.), 14th Scandinavian Conference on Artificial Intelligence SCAI 2024, June 10-11, 2024, J?nk?ping, Sweden. Swedish Artificial Intelligence Society. ISSN 9789180757096. p. 57¨C66. doi: 10.3384/ecp208007. Full text in Research Archive Show summary

  As the world of competitive sports increasingly embraces data-driven techniques, our research explores the potential of machine learning in distinguishing elite from semi-elite beach volleyball players. This study is motivated by the need to understand the subtle yet crucial differences in player movements that contribute to high-level performance in beach volleyball. Utilizing advanced machine learning techniques, we analyzed specific movement patterns of the motion of the torso during spikes, captured through vest-mounted accelerometers. Our approach offers novel insights into the nuanced dynamics of elite play, revealing that certain movement patterns are distinctly characteristic of higher skill levels. One of our key contributions is the ability to classify spiking movements at different skill levels with an accuracy rate as high as 87%. This current research provides a foundation of what separates elite players from their semi-elite counterparts.

• Arnim, Hugh Alexander von; Fasciani, Stefano & Erdem, Cagri (2023). The Feedback Mop Cello: An Instrument for Interacting with Acoustic Feedback Loops. In Ortiz, Miguel & Marquez-Borbon, Adnan (Ed.), Proceedings of the International Conference on New Interfaces for Musical Expression. Universidad Aut¨®noma Metropolitana. p. 494¨C499. doi: 10.5281/zenodo.11189258. Full text in Research Archive Show summary

  This paper presents the Feedback Mop Cello, an instrument integrating acoustic feedback loops generated through a microphone and loudspeaker in combination with a control interface inspired by the cello. Current paradigms of interaction with feedback instruments are based around ideas of negotiation with autonomous systems rather than control. We explore the possibility of integration of negotiated and controlled elements through a design focused on isolating the acoustic feedback loop signal path from the signal path to which sound processing is applied. We focus on three musical parameters of timbre, pitch, and dynamics. We present timbre as a parameter to mainly be negotiated within the feedback loop, while pitch and dynamics are parameters that can be explicitly controlled through the interface. An approach is taken to minimize components within the feedback loop in order to foreground the choice of the loudspeaker as an integral part of the instrument¡¯s sound. A preliminary user study is carried out involving five semiprofessional musicians, focusing on their reflection regarding their interaction with the acoustic feedback loop.

View all works in NVA

• Arnim, Hugh Alexander von; Fleckenstein, Abbigail Marie & Christodoulou, Anna-Maria (2025). SysMus25 Conference Proceedings. Zenodo. 164 p. doi: 10.5281/zenodo.17632991. Full text in Research Archive
• Fleckenstein, Abbigail Marie; Arnim, Hugh Alexander von & Christodoulou, Anna-Maria (2025). SysMus25 Book of Abstracts. Zenodo. 165 p. doi: 10.5281/zenodo.17531650. Full text in Research Archive

View all works in NVA

• Fleckenstein, Abbigail Marie; Arnim, Hugh Alexander von & Christodoulou, Anna-Maria (2025). Editorial Note. In Arnim, Hugh Alexander von; Fleckenstein, Abbigail Marie & Christodoulou, Anna-Maria (Ed.), SysMus25 Conference Proceedings. Zenodo. p. 5¨C5. Full text in Research Archive
• Christodoulou, Anna-Maria; Arnim, Hugh Alexander von & Jensenius, Alexander Refsum (2025). Supporting Narrative Comprehension in Programmatic Music through Music and Light. Full text in Research Archive
• Arnim, Hugh Alexander von; Christodoulou, Anna-Maria; Burnim, Kayla; Upham, Finn; Kelkar, Tejaswinee & Jensenius, Alexander Refsum (2025). LightHearted¡ªA Framework for Mapping ECG Signals to Light Parameters in Performing Arts. Full text in Research Archive
• Rolfsjord, Sigmund Johannes Ljosvoll; Arnim, Hugh Alexander von; Fatima, Safia & Baselizadeh, Adel (2025). Multimodal Transfer Learning for Privacy in Human Activity Recognition. Full text in Research Archive
• Arnim, Hugh Alexander von; Erdem, Cagri; C?t¨¦-Allard, Ulysse Teller Masao & Jensenius, Alexander Refsum (2025). A Sensor is not a Sensor: Diffracting the Preservation of Sonic Microinteraction with the SiFiBand. Full text in Research Archive Show summary

  This paper documents our exploratory work to preserve the interactive music system Stillness Under Tension¡ªdeveloped to explore inverse sonic microinteraction¡ªby porting it from the original and discontinued Myo sensor armband to SiFiBand, a new prototype armband with motion (IMU) and muscle (EMG) sensors. We approach this by merging the Multilevel Dynamic Preservation model with a ¡°diffraction-in-action¡± method grounded in a theoretical entanglement perspective. Rather than focusing on the Myo version¡¯s artefactual remains, we explore the difference in data representations offered by the two devices as our point of departure. The paper describes the sensor devices, evaluating their data representations given their technical specifications, and describing how these differences propagate throughout our attempt to preserve the system, enacting necessary changes. We discuss the implications of merging these methods in view of the long-term preservation of interactive music systems. Our version 2.0 of Stillness Under Tension finds itself experientially in a position between familiarity and newness.

• Esterhazy, Rachelle; Arnim, Hugh Alexander von & Damsa, Crina I. (2025). Multimodal learning analytics to explore key moments of interdisciplinary knowledge-construction. Full text in Research Archive
• Sanchez, Daniel; Damsa, Crina I.; Esterhazy, Rachelle & Arnim, Hugh Alexander von (2024). Sense-making and Use of Multimodal Feedback in Team-based Simulations in Nursing Education. EARLI-SIG27 Conference. Full text in Research Archive
• Esterhazy, Rachelle; Arnim, Hugh Alexander von & Damsa, Crina I. (2024). Multimodal learning analytics to explore key moments of interdisciplinary knowledge-construction. Full text in Research Archive
• Arnim, Hugh Alexander von & Kelkar, Tejaswinee (2024). The Shapeshifter: Motion Capture and Interactive Dance for Co-constructing the Body. Full text in Research Archive
• Arnim, Hugh Alexander von; Fasciani, Stefano & Erdem, Cagri (2023). The Feedback Mop Cello: An Instrument for Interacting with Acoustic Feedback Loops. Full text in Research Archive

View all works in NVA