Tag Archives: music composition

Climate measurements as music

Given that it was Earth Day yesterday (April 22, 2024), this seems like a good second act. From an April 18, 2024 news item on phys.org,

A geo-environmental scientist from Japan has composed a string quartet using sonified climate data. The 6-minute-long composition—titled “String Quartet No. 1 “Polar Energy Budget”—is based on over 30 years of satellite-collected climate data from the Arctic and Antarctic and aims to garner attention on how climate is driven by the input and output of energy at the poles.

This is a little longer video than I usually like to embed here at 6 mins. 29 secs. and it is one of the more aesthetically pleasing I’ve heard,

An April 18, 2024 Cell Press press release, which originated the news item, describes the data sonification work and its application to art/science projects, Note: A link has been removed,

“I strongly hope that this manuscript marks a significant turning point, transitioning from an era where only scientists handle data to one where artists can freely leverage data to craft their works,” writes author and composer Hiroto Nagai, a geo-environmental scientist at Rissho University.

Scientist-composer Hiroto Nagai asserts that music, as opposed to sound, evokes an emotional response and posits that “musification” (as opposed to sonification) of data requires some intervention by the composer to build tension and add dynamics. For this reason, Nagai was more liberal in adding a “human touch” compared to previous data-based musical compositions, aiming to meld sonification with traditional music composition.

“As a fundamental principle in music composition, it is necessary to combine temporal sequences from tension-building to resolution in various scales, from harmonic progressions to entire movements,” Nagai writes. “So far, there haven’t been published attempts and open discussion on sonification-based music composition, nor attempts to demonstrate the methodology required to intentionally affect the audience’s emotions with an artistic piece.”

To do this, he first used a program to sonify environmental data by assigning sounds to different data values. The publicly available data was collected from four polar locations between 1982 and 2022: an ice-core drilling site in the Greenland ice sheet, a satellite station in Norway’s Svalbard archipelago, and two Japanese-owned research stations in the Antarctic (Showa Station and Dome Fuji Station). For each of the sites, Nagai used data on monthly measurements of short- and longwave radiation, precipitation, surface temperature, and cloud thickness.

In the next step, he transformed this collection of sounds into a musical composition to be played by two violins, a viola, and a cello. This process involved many steps, including manipulating the pitch of different datapoints and assigning sections of data to the different instruments, overlaying passages created from different data, and introducing musical playing techniques such as pizzicato and staccato. Nagai also intervened in more artistic ways by introducing rhythm, deliberately removing certain sounds, and introducing handwritten (non-data derived) parts into the composition.

The quartet’s premiere live performance was shared at Waseda University in Tokyo in March 2023 followed by a panel discussion. A filmed performance of the piece by PRT Quartet, a Japanese professional string quartet, was also released on YouTube in March 2023.

“Upon listening, my initial reaction was like, ‘What is this?’ It felt like a typical contemporary piece,” said Haruka Sakuma, the professional violinist who performed 2nd violin. “The flow of the music was a bit hard to memorize quickly, and it was quite challenging at first.”

Nagai says that, in contrast to graphical representations of data, music elicits emotion before intellectual curiosity and suggests that using graphical and music representations of data in conjunction might be even more powerful.

“It grabs the audiences’ attention forcefully, while graphical representations require active and conscious recognition instead,” Nagai writes. “This reveals the potential for outreach in the Earth sciences through music.”

Here’s a link to and a citation for the paper,

String Quartet No. 1 “Polar Energy Budget” – Music composition using Earth observation data of polar regions by Hiroto Nagai. iScience DOI: https://doi.org/10.1016/j.isci.2024.109622 Published: April 18, 2024 Copyright © 2024 The Author(s). Published by Elsevier Inc. User license Creative Commons Attribution (CC BY 4.0)

As you may have guessed on seeing the Creative Commons licence, this is an open access paper,

Brain composer

This is a representation of the work they are doing on brain-computer interfaces (BCI) at the Technical University of Graz (TU Graz; Austria),

A Sept. 11, 2017 news item on phys.org announces the research into thinking melodies turning them into a musical score,

TU Graz researchers develop new brain-computer interface application that allows music to be composed by the power of thought. They have published their results in the current issue of the journal PLOS ONE.

Brain-computer interfaces (BCI) can replace bodily functions to a certain degree. Thanks to BCI, physically impaired persons can control special prostheses via their minds, surf the internet and write emails.

A group led by BCI expert Gernot Müller-Putz from TU Graz’s Institute of Neural Engineering shows that experiences of quite a different tone can be sounded from the keys of brain-computer interfaces. Derived from an established BCI method for writing, the team has developed a new application by which music can be composed and transferred onto a musical score through the power of thought. It employs a special cap that measures brain waves, the adapted BCI, music composition software, and a bit of musical knowledge.

A Sept. 6, 2017 TU Graz press release by Suzanne Eigner, which originated the news item, explains the research in more detail,

The basic principle of the BCI method used, which is called P300, can be briefly described: various options, such as letters or notes, pauses, chords, etc. flash by one after the other in a table. If you’re trained and can focus on the desired option while it lights up, you cause a minute change in your brain waves. The BCI recognises this change and draws conclusions about the chosen option.

Musical test persons

18 test persons chosen for the study by Gernot Müller-Putz, Andreas Pinegger and Selina C. Wriessnegger from TU Graz’s Institute of Neural Engineering as well as Hannah Hiebel, meanwhile at the Institute of Cognitive Psychology & Neuroscience at the University of Graz, had to “think” melodies onto a musical score. All test subjects were of sound bodily health during the study and had a certain degree of basic musical and compositional knowledge since they all played musical instruments to some degree. Among the test persons was the late Graz composer and clarinettist, Franz Cibulka. “The results of the BCI compositions can really be heard. And what is more important: the test persons enjoyed it. After a short training session, all of them could start composing and seeing their melodies on the score and then play them. The very positive results of the study with bodily healthy test persons are the first step in a possible expansion of the BCI composition to patients,” stresses Müller-Putz.

Sideshow of BCI research

This little-noticed sideshow of the lively BCI research at TU Graz, with its distinct focus on disabled persons, shows us which other avenues may yet be worth exploring. Meanwhile there are some initial attempts at BCI systems on smart phones. This makes it easier for people to use BCI applications, since the smart phone as powerful computer is becoming part of the BCI system. It is thus conceivable, for instance, to have BCI apps which can analyse brain signals for various applications. “20 years ago, the idea of composing a piece of music using the power of the mind was unimaginable. Now we can do it, and at the same time have tens of new, different ideas which are in part, once again, a long way from becoming reality. We still need a bit more time before it is mature enough for daily applications. The BCI community is working in many directions at high pressure.

Here’s a link to and a citation for the paper,

Composing only by thought: Novel application of the P300 brain-computer interface by Andreas Pinegger, Hannah Hiebel, Selina C. Wriessnegger, Gernot R. Müller-Putz. PLOS https://doi.org/10.1371/journal.pone.0181584 Published: September 6, 2017

This paper is open access.

This BCI ‘sideshow’ reminded me of The Music Man, a musical by Meredith Wilson. It was both a play and a film  and I’ve only ever seen the 1962 film. It features a con man, Harold Hill, who sells musical instruments and uniforms in small towns in Iowa. He has no musical training but while he’s conning the townspeople he convinces them that he can provide musical training with his ‘think method’. After falling in love with one of the townsfolk, he is hunted down and made to prove his method works. This is a clip from a Broadway revival of the play where Harold Hill is hoping that his ‘think method’ while yield results,

Of course, the people in this study had musicaltraining so they could think a melody into a musical score but I find the echo from the past amusing nonetheless.