Space as Timbre (SAT) Research-Creation Project Report

Jun 20

Written By Musicians Auditory Perception Research Team

Initial Project Report published July 1st, 2024

Space As Timbre (SAT)

Research-Creation Project Report

Pedram Diba (Northwestern University), Jonas Regnier (McGill University), Anqi Liu (UCSD), Jeanne Côté (McGill University) , Charles Eric Fontaine (McGill University), Carmine-Emanuele Cella (University of California Berkley), Robert Hasegawa (McGill University) [Principal Investigator],

1. Introduction

The primary objective of the Space As Timbre (SAT) project is to conduct meticulous experiments on orchestration solutions and playing techniques, and to achieve timbral effects that closely approximate the perceptual characteristics of diverse acoustical spaces. To this end, SAT endeavors to illuminate the intricate interplay between the spectral content of a target sound, its resynthesis through orchestration, and the resulting perception of the quality of the acoustical space in which the target sound was produced. Presented below is a concise review of a ten-month-long collaboration involving three composers (Pedram Diba, Jonas Regnier, and Anqi Liu) and seven performers (Alex Huyghebaert (flute), Matias Perenetti-Paniagua (clarinet), Éric Bourgeois (trombone), Paul Celebi (piano), Jeanne Côté (violin), William Boivin (double bass), and Charles-Eric Fontaine (conductor)), as well as a sound engineer (Seungwoo Han), from two ACTOR partner institutions, namely McGill University and the University of California San Diego. The collaboration primarily consisted of virtual meetings, workshops, rehearsals, two presentations, a concert, and post-reflections.

SAT's research approach began with the application of various impulse responses[1] to recorded or synthesized sounds, thereby creating a diverse range of acoustical spaces for each sound. Subsequently, these newly formed sounds served as sonic material for instrumental resynthesis. To achieve the instrumental resynthesis, SAT employed target-based computer-assisted orchestration[2 ], specifically the software Orchidea[3], to generate multiple solutions for the orchestration of each target sound. Throughout this process, the primary objective was to explore various settings for partial filtering and sparsity to attain a timbral result that closely matched the perceptual characteristics of the space of each target sound. In conjunction with the use of Orchidea, the musicians of the ensemble were tasked with critically listening to the audio files and striving to capture the closest perceptual qualities of the space of each target sound by experimenting with a diverse range of playing techniques, including extended techniques, pedaling techniques, bow placement, and more. These experiments were based on the outcomes generated by Orchidea; nonetheless, the musicians were also encouraged to conceive completely new solutions. This collaborative effort ultimately yielded innovative playing techniques that were not suggested by Orchidea.

2. Collaborative Summary
Choice of Target Sounds

Pedram initially started with twelve sounds, which were all unique in nature —sustained sounds, short sounds, sounds with an attack-decay form, grainy and textural sounds, etc., and 402 impulse responses. He explains, “the use of impulse responses can alter what Denis Smalley refers to as the spectral space (Smalley, 2007), and consequently the timbre of a sound. As a result, we can achieve various timbral qualities in a sound by changing its space. I experimented with all possible pairings of impulse responses and sounds to find what combinations could create the most interesting results for me.” Eventually, Pedram chose two sounds and four impulse responses. The first sound was the recording of a marble bouncing on a balloon that was stretched over the opening of a jar. The second sound was one of the bell recordings included in the Orchidea package called archeos-bell. Ultimately, Pedram applied two different impulse responses to each sound and created four target sounds for experimentation with Orchidea and the ensemble - Dry Marble , Marble in Reverberant Space, Bell #1, and Bell #2 .

Similarly, Jonas started his endeavors with a large number of sounds. He explains, “I chose ten different sounds that I wanted to experiment with, and that I found could bring an interesting result after being orchestrated for a small ensemble. Some sounds had textural effects, some had interesting partials or harmonic content, and some had specific gestures.” Jonas ultimately chose three sounds. Two of the sounds were created through a digital synthesis software called Absynth 5, and the third sound was the sound of a cooking pan hit with a percussion mallet, that he recorded in a sound-proofed studio. “The two synthesized sounds seemed interesting to me not only because of their complex dynamic, harmonic, and timbral characteristics, but because they carried a strong sense of wide-open space within them. I was curious to know whether this spatial effect produced by a digital, artificial timbre could be reproduced with acoustic timbres. The first synthesis sound, called ‘Sinus low vibration,’ consists of a twelve second low vibration containing a small and progressive glissando (going down by almost half a tone, then up by the same interval). The second synthesized sound ‘Vibration F#’, is a twenty-five-second slow vibration which is centered around F-sharp. Some of the partials of the sound have different speed and amplitude vibrations.” Lastly, Jonas also decided to use the pan sound, which consists of a single attack on a coocking pan with a nine-second reverb time, due to how it would transform when different impulse responses were applied to it. “Although many ‘bell-like’ sounds have already been orchestrated and used in instrumental music by contemporary composers, I wanted to use this sound nevertheless to try to orchestrate it in different spaces. I noticed indeed that changing the space (through impulse-response convolution reverb) in which this sound is heard not only changes the timbre of the original sound but also its perceived harmonic content. This is something that I wanted to explore in this piece and used as the main idea for building the form and structure of the piece.” The phenomenon of experiencing a distinct shift in perceived harmonic characteristics within a sound following the application of a different impulse response is also clearly apparent in the case of the bell sounds that Pedram specifically chose as his two target sounds: Bell #1 and Bell #2.

In contrast to Pedram and Jonas, Anqi focused solely on one sound: the sound of snow. She intentionally selected this subtle and nuanced sound being aware that it might not align well with the strengths of Orchidea. However, she viewed the ever-changing dynamics and unpredictable nature of the sound of snow as a fitting challenge for her project, believing it would push the boundaries of this computer-aided composition approach. Anqi's primary objective was to investigate how Orchidea would address such an inherently organic and variable sound. Additionally, she aimed to explore the intricate interplay between nature, technology, and human interpretation. “The experience gave me invaluable insights into the balance between the structured precision of technology and the ever-changing dynamics of sonic phenomena. Embracing this tension, understanding it, and allowing it to inform my work has been an immensely rewarding aspect of this journey.”

Working with Orchidea

While working with Orchidea in preparation for the first workshop, Pedram used the FullSOL2020 instrumental dataset[4 ] to have the software consider a diverse set of playing techniques in the orchestration solutions. With this dataset, he hoped that Orchidea would generate more compelling results in terms of timbre compared to other instrumental datasets such as the TinySOL. “After choosing my dataset, I experimented with the parameters of sparsity and partialsfiltering [5 ] to achieve the closest timbral result to each target sound. I also experimented with the parameters of onsetthreshold and onsettimegate to achieve the best outcome for a dynamic orchestration. If the time gate interval for the onset segmentation was short, Orchidea would generate a lot of material, but the identity of the sound would be lost. If the time gate interval was longer, I would get less material, but the identity of the sound was better preserved in the orchestration solution.” During this phase, Pedram attempted to find a fine balance between the four mentioned parameters in Orchidea for each of his target sounds to retain some of their identity features in a dynamic orchestration most important of which for him was the timbral quality. Pedram notes that Orchidea was a very powerful tool for providing orchestration solutions and compositional ideas to him. However, during the process of exploring various orchestration solutions for his target sounds, he also employed his intuition as a composer. “Sometimes, I could hear a timbral quality in a target sound that I was interested in, but not all the solutions from Orchidea would highlight that timbral quality. In those moments, I chose a solution that was timbrally close to the target sound and hoped to explore more solutions with the ensemble during the workshops.”

Jonas also employed the FullSol library in his endeavors. However, he initially found working with Orchidea challenging as he thought that textural sounds were not very practical to orchestrate with the use of Orchidea due to its reliance on the pitch content of the sound. Throughout the orchestration process, Jonas sought to ensure that the most prominent and perceptible musical parameters of the target sounds were also perceptible in the orchestrations, encompassing vibrations, specific rhythms, overall timbre, and space. Guided by this artistic vision, Jonas faced a dilemma between adhering closely to the Orchidea solutions in terms of pitches or preserving the original timbre and rhythms of the sound. “At first, I decided to use all, or almost all the notes given to me by the software in the orchestration solution, but after the first workshop, I realized this was not optimal as the result was not close to the target sound. I then started to get rid of most pitch materials from the solution, and only keep the salient pitches that I could hear from the recording. This gave me more freedom in the use of rhythms and timbre manipulations (through extended techniques), and the results were much closer to the target sounds.” Furthermore, during his work with Orchidea Jonas came to the conclusion that the most important parameter for him to experiment with was the onsettimegate parameter. “The results varied greatly depending on the value of the time gate, which had to be set accordingly to the target sound: I found that the minimum value for this parameter in order to have an accurate (and not overly complex) solution was 500 ms.” Jonas ultimately used values between 1000 ms to 3000 ms for his sounds, as the harmonic content was changing quite rapidly. He notes that he didn’t find that the parameters of sparsity and partialsfiltering had a notable impact on the orchestration solutions for his specific sounds. He adds that the difference with the orchestration solutions between two similar sounds played in two different spaces was mainly in the partials/pitches. However, he didn’t notice any important change in the timbre of the orchestration solution that was generated by Orchidea.

Meanwhile, Anqi, using the TinySol library, grappled with a challenging question during this phase. While Orchidea suggested complex rhythmic patterns and diverse pitch combinations to capture the dynamic essence of her target sound, Anqi questioned the distinction between Orchidea's algorithmic solutions and stochastic choices. This endeavor prompted deep reflection on the nuances lost or overlooked in the computer-aided orchestration process. Anqi emphasized the significance of addressing this issue, given her extensive exploration into the role of meticulously crafted scores, which serve as guiding frameworks for musicians’ understanding of their surrounding “spaces” and “ecologies.” She remarks, “I perceive past experiences, memories, training, and learnings as integral components of a psychological ecosystem that influence our cognitive patterns, decision-making, and behaviors.” Anqi thought that Orchidea did not integrate this human element into its orchestration solutions.

Workshop with the Ensemble

Throughout the course of this project, the composers engaged in three comprehensive workshops alongside the ensemble. Following the conclusion of each workshop, the composers received meticulously annotated parts from the ensemble musicians, providing detailed insights into the discussions and modifications made during the session. With the use of the annotated parts, the composers would refine their material in anticipation of the subsequent workshop, ensuring a continual evolution and enhancement of their compositional material. In preparation for the first workshop, Pedram made several adjustments to the solutions provided by Orchidea. These adjustments encompassed various aspects, such as incorporating glissandi, extending specific articulations, utilizing arrows to indicate gradual transitions between different playing techniques, accelerating or decelerating certain figures, and employing unison tremolo on adjacent strings. These modifications aimed to create smooth transitions in terms of timbre, pitch, and activity within the different segmentations, while also enhancing the timbral qualities.

Given that the piano was not included in the FullSOL2020 instrumental dataset, Orchidea did not provide any material specifically tailored for the piano. Consequently, Pedram made the decision not to compose anything for the piano for the first workshop. Instead, Pedram invited the pianist to generate suggestions during the workshop, taking into account the target sounds, the sound of the ensemble, and the material provided for the other instruments.

Throughout the three workshop sessions, Pedram, along with the ensemble members, made various modifications to the orchestration solutions. These adjustments encompassed several aspects, including pitch alterations, dynamic markings, and changes to playing techniques, all aimed at getting closer approximations to the timbral qualities of the target sounds. Examples of technique modifications included substituting the half-tone sound for the air sound in the flute, utilizing molto sul tasto with half hair in the violin instead of col legno tratto, and employing continuous bow bouncing (ricochet) in place of tremolo in the double bass. Furthermore, they delved into the exploration of novel playing techniques, such as performing vocal fry into the bass flute, rubbing a coin on the bass strings of the piano, clarinet key clicks, and simultaneously playing and singing a quarter tone apart in the low register of the flute. These explorations led to the integration of experimental techniques that surpassed the suggestions provided by the FullSOL2020 instrumental dataset in Orchidea. For the final workshop, Pedram revised the orchestration of all the target sounds based on the annotations provided by the ensemble members after the initial two workshops. Furthermore, Pedram endeavored to refine the orchestration solutions further, drawing upon the observations and knowledge acquired during the workshops. For instance, Pedram noticed that incorporating a noise component such as air sound could impart a sense of spaciousness to the timbral quality of a sound. Consequently, Pedram decided to introduce an airy multiphonic in the bass flute for one of the marble sounds, which carried a reverberant and spacious quality. By doing so, Pedram aimed to augment the timbral characteristics of the ensemble’s sound, while also creating an overall impression of spaciousness in the sound. During the last workshop, the ensemble experimented with two different multiphonics provided by the composer to determine the optimal execution for achieving this effect.

Jonas had an exceptionally positive experience while interacting with the ensemble. The opportunity to receive direct feedback on the composed musical ideas and their realization proved to be a privilege that Jonas wished to have for the composition of every piece. He notes that the workshops provided valuable insights into orchestration techniques that would not have been attainable within the confines of a traditional orchestration course. Each musician contributed valuable insights regarding the feasibility and effectiveness of the musical materials. In situations where certain aspects of the music did not unfold as intended, the ensemble members offered alternative solutions that bridged the gap between the intended sonority and the actual outcome. The majority of modifications made during the workshops pertained to pitch adjustments and the incorporation of various timbral effects through the utilization of extended techniques. Since the ensemble musicians had the possibility to collectively listen to the target sounds that the composers aimed to reproduce, they were able to propose innovative solutions to replicate the timbral and spatial characteristics of these sounds, surpassing the scope of Jonas's initial considerations. Additionally, while working with the ensemble, Jonas realized that achieving a unified blend between the instruments was crucial for listeners to perceive the projected space in the music. Without this timbral blend, the intended spatial qualities in the composition would remain largely imperceptible. This experience highlighted the importance of close collaboration and careful orchestration within the framework of the SAT project.

3. Compositional Phase/Structure of the Compositions

Pedram proceeded to create a formal plan for the composition following the workshops. Throughout this process, he gave careful consideration to the pitch organization and the most perceptually prominent pitch in each sound as well as timbral qualities and organizations such as brightness and orchestration. These considerations influenced the decision-making regarding the order of sound appearances and the transitions between them. Pedram’s observations ultimately guided him to introduce the marble sounds before the bell sounds in his plan. Additionally, Pedram chose not to commence the piece with the marble sounds, but rather crafted a progression that would eventually lead to the first marble sound, which occurs at the 1:25 mark in the final composition.

During the composition phase, Pedram drew inspiration from Nicolas Donin's article "Sonic Imprints: Instrumental Resynthesis in Contemporary Composition[6 ]." He placed particular emphasis on the timbral qualities of the impulse responses and aimed to faithfully recreate those qualities in the final work, rather than precisely reproducing the original sound reference of the target sounds in the composition. Pedram acknowledges that while the instrumental resynthesis does not perfectly reproduce the original sound reference in his piece, familiarity with the source content can aid in recognizing the illusion of the target sounds.

When listening to the premiere performance of the piece, Pedram experienced a dual perception regarding the change of space in the formal structure. Pedram notes that since the target sounds do not appear one after another in the composition, the sense of space between them was challenging to discern. However, the overall change in timbre throughout the larger formal structure of the work was evident. In addition to utilizing the target sounds, Pedram also incorporated various changes of space within smaller formal structures throughout the composition. These changes occurred at a faster pace, making the perception of spatial shifts more noticeable. For instance, in measures 54-57 (second marble sound), the orchestration conveys an open and reverberant space. However, when all instruments drop out in measure 58, leaving the violin alone, Pedram perceived the space to become smaller and drier. Similar examples of spatial changes within smaller formal structures could be found in mm. 1-4 or mm. 4-13, where the progressively brighter sound gives the impression of the source getting closer in space.

Jonas decided to incorporate inspiration from extra musical elements during the composition phase. He created the general form of the piece based on three different light techniques used in photography and their metaphorical spatial meaning. The first section of the composition, spanning from the beginning to measure 55, incorporated two distinct photography techniques. The first technique, known as "tension," aims to generate contrast in photographs with the use of light. In the context of his piece, Jonas tried to use space to create opposition and tension within various elements. The second technique, called "emphasis," directed the listener's attention to the crucial aspects of the composition through the use of lines, shapes, and negative space, which refers to the area surrounding an object. A negative space usually doesn’t contain as many details as a positive space. This concept is similar to the concept of background and foreground in music. In the context of the work this form of opposition is derived from the dichotomy between the initial attack (m. 1) and its composed resonance, both of which come from the orchestrated sound of the pan. Jonas also tried to further evoke tension in this section by breaking the expectation of the listener (via the use of silences), "blurry" effects (small modifications of musical parameters in materials that have previously appeared in the piece), and by progressively building up the polyphony. The attack and resonance motifs reappeared in increasingly complex forms, ultimately merging to create a completely new sonic space (mm.39-55). This newly introduced space maintains the essence of tension and opposition present at the beginning of the piece. However, in this instance, the contrasting materials are juxtaposed simultaneously, rather than sequentially. The foreground features frantic, chaotic, and noisy elements, which serve as a counterpoint to the background's persistent ascending melody played on the piano. The piano melody oscillates in dynamics while overall gradually increasing in volume, progressively emerging into the foreground. This interplay of contrasting elements within the space exemplified the concept of negative space, as listeners' attention alternates between the chaotic noise and the piano melody, with the latter continually shifting between foreground and background.

In the second section of the piece, spanning from measure 56 to 84, Jonas explored the concept of "substance" derived from photography. This technique aims to enhance the depth of the narrative by reinforcing the primary subject through the use of light or space within the concept of Jonas’s composition. The section begins by prominently featuring the "Vibration F#" sound, introducing a second element to the narration while concurrently altering the spatial environment. At measure 69, a dramatic clash between registers occurs on the piano, contrasting a loud chord utilizing extreme registers with a quiet chord confined to a restricted register. This clash generated a sudden shift in space, transitioning from a wide space to a more narrow one. The transformation in space also includes the reminiscence of the resonance of the pan sound previously heard in the first section of the piece. By the conclusion of the section, the narrow space material grows louder and precedes the wide space material.

The final section of the composition, spanning from measure 85 until the end, deals with the photography technique known as "separation." This technique aims to shape the narrative by employing basic tonal differentiation. The section begins in silence and gradually expands the space through the accumulation of rhythms, melodic lines, harmonies, and timbres. At the beginning of this segment, a new musical element emerges, partially introduced in the concluding measures of the second section (m.79), starting with the violin part and subsequently integrating with other instrumental parts. This element consists of a recurring descending scale that grows progressively longer, softer, and lower in pitch. The unfolding of this heterophonic texture gradually opens up a wide space, subsequently filled by the final musical material of the piece, namely the "Sinus low vibration" sound. This concluding sound slowly fades away within the same space it had initially occupied, leaving behind a quiet and never-ending resonance as an integral part of the space.

In contrast to Pedram's meticulous attention to pitch organization and timbral qualities, and Jonas's incorporation of extra-musical elements, Anqi's exploration diverged after the workshops as she delved into the realm of musical notation for her compositional process. She explains, “Instead of solely relying on computer-aided software, I felt an urge to explore alternative solutions. This divergence wasn't just about moving away from technological means, but it also called into question the very linguistic model that has anchored musical endeavors for centuries: notation.”

In her reflection, Anqi explored the realm of linguistic models, pondering their role in simplifying intricate phenomena into language that is universally comprehensible. This contemplation led her to draw a parallel between linguistic models and traditional music notation, recognizing the latter as a framework for condensing expansive sonic landscapes into simple symbols on staves. She further elaborates, “Just as technology provides a framework to process and produce, so does musical notation offer a language for our sonic expressions. Both, at their heart, are linguistic models, shaping and codifying our interactions with sound.”

However, Anqi acknowledges the limitations of notation, recognizing that every symbol carries cultural, historical, and personal baggage, potentially hindering its ability to fully capture the essence of sound or the musician's intended emotion. Her reflection ultimately guided her to seek a deeper understanding of human connection, gesture, and emotion in her work.

In light of these revelations, she sought to carve out microscopic spaces within the confines of musical notation. While acknowledging the richness of a traditional score, she recognized its limitations in its linear, time-bound representation of sound. Her endeavor aimed to transcend these constraints, offering a more holistic, spatial, and interactive experience. She sought to create a dynamic system where notation itself would evolve, akin to the ecologies previously mentioned. This new notation would integrate the performer's experiences, memories, and training, resulting in a transient rendition with each performance, thereby bridging the gap between the rigidity of linguistic models and the fluidity of human experiences.

Consequently, she introduced the concept of threshold in her notation to signify a state that is in-between and ongoing. She explains, “In this situation, uncertainties and unpredictabilities are unenviable. The thresholds are revealed in multiple parameters while playing the instruments. “Part of the concepts of the piece is to find, explore, and define those thresholds. The thresholds are conditions of uncertainties and are conditions of the edge of new or different things starting emerging; therefore it’s always in the in-between and either-or situations.” An example of this can be observed in the strings shown in Figure 1, where thresholds are applied to the parameters of the bow. As the bow interacts with the string, factors such as its positioning and pressure serve as variables, influencing the pitch, volume, and overall sound quality produced. Despite the complexity of these variables, they remain limited by the constraints of physicality. Nevertheless, it is precisely this physical aspect that facilitates the expression of the abstract. Anqi elaborates, “my scoring system embraces the unpredictable, allowing it to flow freely, shaped by a multitude of human phenomena. The essence of the score changes when each performer brings their personal touch, be it through subtle differences in interpretation, fleeting moments of subconscious interference, or even a rekindling of past memories evoked during the performance. These moments, rich with individual experience and unspoken narratives, can influence the micro gestures utilized to approach these thresholds. Instead of being precise and defined, the application of technique becomes a reflection of these underlying psychological ecologies.”

Figure 1: Example of threshold in bow placement and pressure on the double bass

Anqi explains that this approach to orchestration and notation aims not to replace traditional systems, but to enhance them. Through these new systems and ongoing exploration, Anqi’s goal is to create a space where technology complements human experiences rather than restricts them. Here, linguistic models provide foundational frameworks that are flexible enough to accommodate the unpredictable nature of human experiences. This journey embodies Anqi’s philosophical reflections on space, ecology, human connection, and the delicate balance between structure and uncertainties.

4. Experience of the Ensemble

Following the conclusion of the concert, we sought the insights and perspectives of the musicians comprising the ensemble in order to capture their experiences throughout the entirety of this project. Presented below is an assortment of carefully curated questions tailored specifically for the performers, alongside some of their respective reflective responses. Although there were seven performers in the ensemble, the responses included here are from four of the musicians, chosen to provide a representative sample of the performers' diverse perspectives and experiences throughout the SAT project.

What did you find the most fascinating during this project in relation to timbre and space?

Alex Huyghebaert (flute): I was very fascinated by how easily we were able to improve the sound from the original output generated by Orchidea. Just using our ears we were able to make better decisions on which harmonics to bring out and make better choices on dynamics to imitate the target sound. Because computers can pick up more pitches and sounds than human ears notice, Ochidea would notate these pitches, but we couldn’t actually hear them in the original sound.

I was also kind of surprised by the fact that I never thought about how the space that we played in as the ensemble would affect the sound until the day of the concert in Tanna Hall.

Éric Bourgeois (clarinet): I got to pay more attention to low and high frequencies to accurately reproduce the sounds in different spaces.

Jeanne Côté (violin): The most fascinating thing about this project is the way it led me to develop a better sensibility to space as a performer and a listener. The more details I was able to identify on one sound (for example, the length, the harmonics, the attack.), the more I was able to understand the orchestration and to play with the right intention.

Charles-Eric Fontaine (conductor): To me, the reflection with the composers and performers about finding musical solutions to alter metaphorically the perception of space was the most fascinating aspect of this research. As performers, we are used to adjusting details of playing (i.e. length of notes, dynamics, articulations) to adapt to the acoustical properties of a hall or space. During this research, the goal was to implement sound objects with a set of variations to give them the illusion that they are ringing in a different environment. We came to a vast pool of ideas about how to manipulate these sounds: their voicing and balance of the voices among instruments, presence and absence of a specific spectrum of overtones, quality of articulation and bowing, specificity of sound production on extended techniques, and so on.

How did you approach thinking of spatial quality on your instrument and how would you define the role of your own instrument within the orchestration of the target sounds we studied, among the 5 other instruments?

Alex Huyghebaert (flute): I've always thought of the flute, even in a classical orchestral setting, as the top harmonic of sound. It's easier to tune when thinking of it this way - to fit into the sound of the lower orchestra. I think flute was used in this way for SAT maybe a couple times but honestly not as much as I had thought. It helped obviously give the sound depth because of its register in comparison to trombone or bass, but my role kind of changed with each target sound. Sometimes my role was as I said - being a harmonic or higher partial - but sometimes I was part of the main meat of the sound helping change the colour (to be brighter or more airy), sometimes my role was to fill out notes in a chord (i.e. for harmonic structure), and sometimes I created texture or rhythm (like the marbles dropping + vocal fry). It was interesting to see how my biases took me always towards thinking of flute as the higher partial, whereas others would suggest another role for me and what ended up happening was something different. So mostly I'd say I was either a higher partial, a modifier of colour, a contributor to harmony, creator of textures, or equal with the rest of the ensemble.

Éric Bourgeois (clarinet): I found the trombone had to play the role of a bass instrument, along with the actual double bass we had with us, but also the trombone played a role in the mid-range frequencies to fill in the gaps between the low and high instruments and make the sound thicker.

Jeanne Côté (violin): In my opinion, thinking about space when playing the violin boils down not only to working on the timbre of the instrument in a given acoustic, but also to going beyond the properties of this space. This was done by exploring different playing techniques with the ensemble. Through the experimentation sessions, we explored several combinations. Due to the range of my instrument and my timbre palette, the sounds of high harmonics and incisive attacks were often attributed to me.

How did you experience the space parameter while playing a fraction of the sum total of the sound?

Alex Huyghebaert (flute): Like any music I guess. You have to know your role in the overall timbre just as you would if you were playing Beethoven. Except in this case we had a sound to imitate, whereas Beethoven is... Beethoven. The goal most of the time with music like Beethoven is to move the audience emotionally or impress them with virtuosity. The purpose of SAT particularly at the beginning was to recreate a sound we had just heard, which had its own challenges but in some ways was even actually more straightforward. So my answer would be....I experienced it exactly as I would experience it in any other context, with any other music, only that the goal timbre and sound had a different aesthetic purpose.

Éric Bourgeois (clarinet): I had the tendency to hear myself a lot more than I wanted to, but it was a good exercise to try to really blend in with the rest of the group and not come out on top.

Jeanne Côté (violin): Within the ensemble, it is difficult to hear the space. The physical position occupied by the musicians does not allow for an accurate representation of the sound of the whole. Despite everything, certain composition and interpretation techniques made me hear the space. This is the case of variations in playing techniques, articulations and volume balance between instruments.

How did taking part in the workshops influence the way you were performing the pieces at the concert?

Alex Huyghebaert (flute): It gave so much more context on what our sound goal was. If there was an excerpt in the piece that came from the workshops it was easy to connect to the other instruments, understand my role, and understand the point and musical goal of the score. It also helped morale between musicians I think as well; I really respected everything that was suggested during the workshops and you really got to see everyone's creativity and personality coming out when problem solving, and it gave so much more depth to my understanding of my fellow musicians as creators and how I could work and create with them in the moment of performance.

Éric Bourgeois (clarinet): I felt some moments throughout the pieces were meant to be played with close attention to the sound, which reminded me of the workshops.

Jeanne Côté (violin): The experiments preceding the creation of new pieces allowed me to understand the material constituting the compositions. I was able to get to know the work and style of Anqi, Jonas and Pedram, including their different perception of space. My interpretation was greatly influenced by these moments of exchange.

Charles-Eric Fontaine (conductor): The workshops were aiming at listening to target sounds on which we implemented impulse responses, comparing them to the orchestration generated with Orchidea, and then bringing ideas in from composers, performers and conductor altogether to enhance these orchestrations. As performers were put in contact with these sound materials very early on in the process towards the concert, as well as reflecting and troubleshooting the proposed orchestrations, I perceived that the result at the concert was that the ensemble played in a cohesive and confident manner. Indeed, through this process, each performer had listened over and over to the target sounds and had reflected upon its role in the orchestration of these materials. Therefore, our collective goal was absolutely clear and every performance detail we implemented took root in that experience of the workshops. It was a very effective process and a rewarding performance from my point of view.

What’s still on your mind now that this project is over? Would you like to share anything else of your experience?

Alex Huyghebaert (flute): It was just such an amazing experience using our own ears to mimic another sound and be successful at it. Listening back to our recordings was just so encouraging as a musician.

Éric Bourgeois (clarinet): Creating music of this genre is not easy. I learned that it requires attention to very small details, a lot of patience to put in the work, and open mindedness to actually take the music on paper and really try to produce a piece out of it because it doesn’t happen on its own.

Jeanne Côté (violin): As a performer, I think listening to the space is an interesting aspect to develop. Indeed, the disadvantageous physical position of the musician makes this listening difficult to apply. I would like to add another thought. The interpretation of a new composition already requires great concentration. The space available for listening to space is therefore limited. With practice, I think it would be possible to develop this skill further.

Charles-Eric Fontaine (conductor): I consider this research project as the exploration phase for a larger-scale project about the component of space perception in music. It was a fascinating process, and I hope to be able to pursue the orchestration experimentation and theorization of the spatial dimension from the compositional and performative angles.

Has this process influenced your way of listening and/or practice? If yes, how?

Alex Huyghebaert (flute): It has made me question a little bit my role as a flute player. I don't always have to be the high voice, the solo melody, the little cherry on top of the C major chord. I can have other roles and purposes in an ensemble.

Éric Bourgeois (clarinet): Yes, I pay more attention to the different elements that might constitute a sound, just for the fun of it. The workshops did teach me a little bit about the art of production.

Jeanne Côté (violin): Following this project, I try to integrate a listening of space into my violin practice and thus adapt my playing according to my needs. I manage to apply this practice only when I have a good knowledge of the score.

Charles-Eric Fontaine (conductor): This research definitely influenced the way I relate to sounds in rehearsal, and how I listen to music in general. Since then, I am more sensitive to conceptualizing certain sound objects as spatial structures and in dialogue with their spatial resonance. I developed a personal toolbox with some of the "spatial manipulations" of the sounds we workshopped, which I use when studying and understanding scores, but also when rehearsing to deepen the interpretative and performance components. It changed my ear to the degree that I now understand better certain composers and genres.

What are some examples of some new playing techniques you discovered on your instrument?

Alex Huyghebaert (flute): Vocal fry into the instrument. This was one that I came up with while trying to imitate the rapid bouncing of marbles. And it made it into the final piece! I was so proud hahah

I think it's a really cool effect because it sounds odd, the audience can't really tell how the musician is making the sound, and it's kind of creepy as well, very unknown.

Éric Bourgeois (clarinet): I did discover how to “slap tongue” effectively and loud, something I didn’t think was possible.

Jeanne Côté (violin): I don't think I discovered any new violin techniques during this project.

5. Conclusion

Before the emergence of electronic music, the sound of an ensemble was bound to the placement of the musicians and the space in which they performed. Nonetheless, the exploration of spatial elements within instrumental music is not a novel concept, as numerous composers have ventured into spatial experimentation, resulting in diverse outcomes regarding the perception of distance, depth, and movement in their compositions. For example, Giovanni Gabrieli used stereo choirs in St Mark’s Basilica in Venice, and Berlioz created the perception of distance through various wind instruments in his Requiem (Normandeau, 2009). Other composers have also sought to utilize space by spatializing sound sources or timbral sources within the performance space using instruments. One compelling example is Philippe Leroux's composition De la Texture, which provides specific instructions to performers to navigate designated pathways while executing the piece. Although this method effectively spatializes various sounds and timbres, the spatial component in such a work is primarily perceivable when experiencing it in a live performance. The recorded version of the work tends to lose the full spatial essence.

Conversely, other composers who have explored the concept of space may have encountered contrasting outcomes. An illustration of this is Pedram Diba's As Close As Breath, a collaborative work with violinist Jeanne Côté, developed as part of the Musician's Auditory Perception (MAP) research project with ACTOR. In the final recording of the composition, Diba and Côté utilized MS-EHB-2-Sound Professionals-ultra low noise ear-hook binaural microphones. The use of binaural microphones facilitated the perception of sound movement within the intimate sonic space of the performer, as well as enhancing the quality of the intimate space, particularly during moments involving breath sounds or when the performer brushes the violin against her hair. However, the live performance of the piece loses much of its spatial quality due to the impracticality of employing binaural microphones, which leads to feedback issues, necessitating the use of DPA microphones instead.

The efforts undertaken within the framework of Space As Timbre lay the foundation for innovative approaches to incorporating space in music composition and performance. By considering space as a timbral effect, there is an opportunity to integrate spatial elements into composition in a manner that preserves the timbral structures and trajectories in both live performances and recorded versions of a piece. Moreover, the discovery of techniques that go beyond Orchidea's suggestions, such as playing vocal fry into the bass flute, creates an opportunity to develop new datasets for Orchidea to expand its orchestration capabilities.

In the future, it would be intriguing to conduct an in-depth analysis of the compositions developed within this project, aiming to identify similar instances of playing techniques or sounds that contribute to the perceptual qualities of various acoustical spaces. For instance, in both Pedram's "marble sound" and Jonas's "pan sound" we can observe that instrumental synthesis necessitated the inclusion of noise components (airy sound) when the orchestration aimed to depict a spacious and reverberant environment. Other intriguing future endeavors could include exploring how the perception of projected space in music necessitates a unified blend between instruments, as realized by Jonas during his work, and analyzing the different orchestration techniques used to create this blend in the three pieces written within the framework of this project. Additionally, exploring how traditional versus innovative notation methods, as examined by Anqi, might alter the outcome would be an interesting future endeavor. Lastly, the perceptual qualities of space extend beyond the mere reverberation and spaciousness of a given environment. Parameters such as delays, grains, and more also influence our perception of space. Exploring such factors in future research endeavors would be worthwhile.

Program Notes

Different Same

This work explores how the space we put a sound in can affect how we perceive that sound. Poetically, we can also see the influence of space in our lives: various aspects of our environment and the space we are put in, such as family, home country, hometown, historical and political aspects, socioeconomic status, language, schools, etc., can directly impact how we perceive our world.

Flou, Flash, Lucide

With this piece, I intended to make a metaphor between photography and music, by drawing an analogy between light as used in photography, and space in music. Both can be used to create tension, emphasis on small details, a sense of separation or even to provide additional depth to the main materials. I was inspired from photography and light techniques, which allowed me to develop orchestration techniques that would directly influence our perception of space. Just like in photography, some musical materials in the piece can be clearly identified while others may be perceived as blurry and harder to grasp.

While Snow Buries…
Over the past years, I have been working mainly on fragile nuances embedded in the sonic phenomenon. These practices always involve slow time evolution for the nuances to be perceived. I thus wished to explore space with chaotic textures in the "Space As Timbre" research project. The feature of Orchidea (the computer- aided patch) seems not supportive of this kind, but it helps me greatly in a way to determine and continue what's important to me. The composition didn't use Orchidea nor other computer-aided software. It is an expansion of the Etude Series that the first etude was composed back in 2019 for the ACTOR CORE seminar at UCSD. These etudes view performers' micro-kinetic capabilities and psychological thresholds at the edge of their bodily and mental ecologies and keep questioning the limits of that edge; function notated score as heuristic space that encourages the performers into self-exploration. They then can observe, experience, and finally break previous boundaries.

7. Media
Scores and Recordings

Different Same - Pedram Diba
Flou, Flash, Lucide - Jonas Regnier
While Snow Buries… - Anqi Liu

Annotated Parts

After workshop #1
After workshop #2
No parts were annotated after workshop#3

References

Bampis, Evripidis, et al. (2023)."Target-based Computer-assisted Orchestration: Complexity and Approximation Algorithms." European Journal of Operational Research 304, no. 3: 926-938.

Cella, Carmine-Emanuele.(2021). Workshop on Computer-assisted orchestration and Orchidea. Ircam, streaming video. YouTube.

Diba, Pedram. (2021). As Close As Breath. Paris: BabelScores. BabelScores catalogue.

Donin, Nicolas. (2015). “Sonic Imprints: Instrumental Resynthesis in Contemporary Composition.” In Musical Listening in the Age of Technological Reproduction, 323–44. Farnham: Ashgate.

Ircam, HEM, UC Berkeley, and Carmine-Emanuele Cella. "Orchidea: Creative Computer-Assisted Orchestration." Accessed June 11, 2024. http://www.orch-idea.org/.

Leroux, Philippe. (2008). De la texture. Paris: Gerard Billaudot.

Leroux, Philippe. (2014) De la texture. Meitar Ensemble. Pierre-Andre Valade. Meitar Ensemble, streaming video. YouTube: https://www.youtube.com/watch?v=EwTFRQ15bpA

Normandeau, Robert. (2009). “Timbre Spatialisation: The Medium Is the Space.” Organised Sound: An International Journal of Music Technology 14, no. 3 : 277–85. RILM.

Schneider, Berk, Florian Grond, Jeanne Côté, Pedram Diba, Min Seok Peter Ko, Sang Song, Tiange Zhou, and Shahrokh Yadegari. (2022). “Musicians Auditory Perception: Listening and Empathizing in the Creative Process.” Timbre and Orchestration Resource: Interactive Project Report: 1-38. ACTOR Project.

Smalley, Denis. (2007). “Space-Form and the Acousmatic Image.” Organised Sound: An International Journal of Music Technology 12, no. 1: 35–58. RILM.