On the multiple origins of new musical instruments
The notion of Remediation has been sketched by McLuhan in his theory of Media and further developed by Bolter & Grusin. Remediation can be defined as the formal logic by which new media refashion prior media forms. This implies that characteristics typical of an existing media are translated into the new designs. For instance, modular synths often remediate prior radio technology which remediate early electromagnetic measurement technology. The process of remediation does not only related to physical and material features but it also concern the transfer of more abstract knowledge and cultural notions. Within the context of music technology, Wester tuning is probably one of the most remediated musical notions. It indeed provided the basis for the development of the MIDI communication protocol.
Considering the genesis of new musical instruments through the perspective of mediation it is possible to argue that new design often remediate physical properties and cultural paradigms already associated to existing devices. Magnusson argues that “what new instruments translate from earlier technologies are not simply the simulation of an interface, but a whole constellation of embodied contexts”. Within this constellation we include the values, imaginaries and concerns inherited from communities of practice.
On the influences of communities and musical backgrounds
To explore how diverse musical backgrounds might influence the understanding of music technology we ran a value discovery exercise exploring the breadth of perspectives different communities might have in relation to the values inscribed in fictional technologies for musical interaction. We conducted a hands-on activity in which musicians active in different contexts were invited to envision not-yet-existent musical instruments. The outcomes revealed several sources of influence on participants’ artefacts, including cultural background, instrumental training, and prior experience with music technology. Overall the research highlighted the importance of cultural awareness and value rationality for the design of interactive systems within and beyond the musical domain.
As If By Magic workshop
Our work builds on Kristina Andersen’s Magic Machines workshops in which the notion of Magical Unknown is exploited to free a participant’s imagination and generate manifestations of unknown technologies. Our workshop is therefore based on the idea that “embodied making processes facilitate a different form of thinking”. Through the act of building, narratives entailing the maker’s intentions, motivations and feelings can emerge. However, compared to the work of Andersen, our approach is more focused in the emergence of existing musical values and instrumental concerns rather then provoking new disruptive ideas and designs.
- Write down a relevant aspect of your instrumental musical practice
- Draw one sonic element of a music you particularly enjoy playing or listening to
- Build the machine that addresses the sound you drew or the words you wrote
- G. Lepri and A. P. McPherson. Making Up Instruments: Design Fiction for Value Discovery in Communities of Musical Practice. Proc. ACM Designing Interactive Systems (DIS), San Diego, Californis, USA. 2019.
Fictional artefacts - real values
We then ran an online survey targeting musicians and technologists with experience in musical interface design. We recruited the participants using academic mailing lists (NIME and SMC) and social networks. We aimed to see if respondents could discover musical values through the artefacts created during the various As If by Magic workshops and link them to specific aesthetics and communities. Survey participants reviewed an image of eachfictional instrument and a short description of it provided by its creator. The survey asked the following open questions:
What kind of musical style/genre do you think the musician plays? Why do you think that? What instrument(s) do you think this musician plays? Why?
Overall, our participants were rather successful in guessing the genre/style of the artefacts’ creators: 44% of answers were correct, and a further 27% partly correct. In particular we were impressed by the overall ability of the survey respondents to discover the multiplicity of cultural sources and musical practices in the designer’s background. Besides technical expertise, the design of a music technology entails the materialisation of purposes, assumptions and values. These are situated factors, emerging from specific communities, contexts and cultures. This research provides us the possibility to engage with this type of knowledge: context-dependent values emerging from situated practices.
- G. Lepri and A. P. McPherson. Fictional Instruments, Real Values: Discovering Musical Backgrounds with Non-Functional Prototypes. Proc. New Interfaces for Musical Expression, Porto Alegre, Rio Grande do Sul, Brazil. 2019.
A practice based account
The Chowndolo is an Interactive Sonic Sculpture based on a magnetic pendulum whose trajectories are altered by magnets placed underneath the device. This creates unstable patterns of oscillation which are translated into synthesis parameters and sound. The Chowndolo was conceived as an interactive experience: the scuplture can be played like an instrument and audience participation is crucial. The magnets below the pendulum can be arranged to compose new shapes: different configurations will modify the pendulum oscillations and the generated sonorities. The unstable patterns produced by the pendulum oscillations are transformed into sound, articulating a music that evolves based on the pendulum’s motion.
The magnetic fields and their interactions are revealed through nuanced tones, acting as counterpoint to the pendulum’s dance. The installation aims to make visible the invisible, letting us feel forces that we are not able to perceive. The sounds generated are entirely based on FM synthesis whose sound parameters are controlled by sensing the variations in the magnetic field. According to Faraday’s law of induction, a variation in the magnetic field generates an induced electromagnetic force. This force is then amplified by a custom-designed preamp and the resulting signal is sent to a Bela board where it is processed before the audio being sent to the output.
The Chowndolo is a tribute to John Chowning, a pioneer in the field of Computer Music mostly known for his electroacoustic compositions, the discovery of FM synthesis and research on voice and instrument synthesis. During the development of the Chowndolo, we were lucky enough to welcome John Chowning to our lab and show him the project. He provided precious comments for the improvement of both the sensing technique and the FM synthesis implementation.
Cembalo Scrivano: an interactive audio-visual installation based on an augmented typewriter. By detecting the user’s typing activity, the CS1 generates in realtime audio and visual materials. The project is inspired by the writing machine created in 1855 by the Italian inventor Giuseppe Ravizza. Ravizza called his invention Cembalo Scrivano (Scribe Harpsichord) due to the usage of piano-keys. This invention reworks the harpsichord interface: an existing musical instrument was used as source of inspiration for the development of a new machine (from art technology to typewriting).
The piece aims to mirror this process: a typewriter is converted into an interactive art installation (from typewriting to art technology). Oscillating between two domains (musical and literary), the same technology travels across history, carrying knowledge, behaviours and meanings. In media theory, the practice to understand new and emerging technologies by taking into account the history and evolution of past new media often relate to media archaeology studies. These cultural studies focus on the critical scrutiny of forgotten technologies, observing that new media often renovate old interactive paradigms and communication techniques. Media Archaeology is also a methodology for contemporary artistic practice introducing the concept of ‘zombie media’: a media that is not only out of use, but resurrected to new uses, contexts and adaptations.
G. Lepri and A. P. McPherson. First-person Research in the Arts: Exploring the Values Behind New Music Technology. Proc. ACM Designing Interactive Systems (DIS), San Diego, Californis, USA. 2019.
G. Lepri, A. P. McPherson. Mirroring the past, from typewriting to interactive art: an approach to the re-design of a vintage technology.. Proc. New Interfaces for Musical Expression, Blacksburg, Virginia, USA. 2018.