Tag Archives: data sonification

Climate measurements as music

Leave a reply

Given that it was Earth Day yesterday (April 22, 2024), this seems like a good second act. From an April 18, 2024 news item on phys.org,

A geo-environmental scientist from Japan has composed a string quartet using sonified climate data. The 6-minute-long composition—titled “String Quartet No. 1 “Polar Energy Budget”—is based on over 30 years of satellite-collected climate data from the Arctic and Antarctic and aims to garner attention on how climate is driven by the input and output of energy at the poles.

…

This is a little longer video than I usually like to embed here at 6 mins. 29 secs. and it is one of the more aesthetically pleasing I’ve heard,

An April 18, 2024 Cell Press press release, which originated the news item, describes the data sonification work and its application to art/science projects, Note: A link has been removed,

“I strongly hope that this manuscript marks a significant turning point, transitioning from an era where only scientists handle data to one where artists can freely leverage data to craft their works,” writes author and composer Hiroto Nagai, a geo-environmental scientist at Rissho University.

Scientist-composer Hiroto Nagai asserts that music, as opposed to sound, evokes an emotional response and posits that “musification” (as opposed to sonification) of data requires some intervention by the composer to build tension and add dynamics. For this reason, Nagai was more liberal in adding a “human touch” compared to previous data-based musical compositions, aiming to meld sonification with traditional music composition.

“As a fundamental principle in music composition, it is necessary to combine temporal sequences from tension-building to resolution in various scales, from harmonic progressions to entire movements,” Nagai writes. “So far, there haven’t been published attempts and open discussion on sonification-based music composition, nor attempts to demonstrate the methodology required to intentionally affect the audience’s emotions with an artistic piece.”

To do this, he first used a program to sonify environmental data by assigning sounds to different data values. The publicly available data was collected from four polar locations between 1982 and 2022: an ice-core drilling site in the Greenland ice sheet, a satellite station in Norway’s Svalbard archipelago, and two Japanese-owned research stations in the Antarctic (Showa Station and Dome Fuji Station). For each of the sites, Nagai used data on monthly measurements of short- and longwave radiation, precipitation, surface temperature, and cloud thickness.

In the next step, he transformed this collection of sounds into a musical composition to be played by two violins, a viola, and a cello. This process involved many steps, including manipulating the pitch of different datapoints and assigning sections of data to the different instruments, overlaying passages created from different data, and introducing musical playing techniques such as pizzicato and staccato. Nagai also intervened in more artistic ways by introducing rhythm, deliberately removing certain sounds, and introducing handwritten (non-data derived) parts into the composition.

The quartet’s premiere live performance was shared at Waseda University in Tokyo in March 2023 followed by a panel discussion. A filmed performance of the piece by PRT Quartet, a Japanese professional string quartet, was also released on YouTube in March 2023.

“Upon listening, my initial reaction was like, ‘What is this?’ It felt like a typical contemporary piece,” said Haruka Sakuma, the professional violinist who performed 2nd violin. “The flow of the music was a bit hard to memorize quickly, and it was quite challenging at first.”

Nagai says that, in contrast to graphical representations of data, music elicits emotion before intellectual curiosity and suggests that using graphical and music representations of data in conjunction might be even more powerful.

“It grabs the audiences’ attention forcefully, while graphical representations require active and conscious recognition instead,” Nagai writes. “This reveals the potential for outreach in the Earth sciences through music.”

Here’s a link to and a citation for the paper,

String Quartet No. 1 “Polar Energy Budget” – Music composition using Earth observation data of polar regions by Hiroto Nagai. iScience DOI: https://doi.org/10.1016/j.isci.2024.109622 Published: April 18, 2024 Copyright © 2024 The Author(s). Published by Elsevier Inc. User license Creative Commons Attribution (CC BY 4.0)

As you may have guessed on seeing the Creative Commons licence, this is an open access paper,

Venice Biennale 2024 (April 20 – November 24, 2024)

Leave a reply

Every once in a while I get an email from a lawyer (Gale P. Eston) in New York City who specializes in the art and business communities. How I got on her list is a mystery to me but her missives are always interesting. The latest one was a little difficult to understand until I looked at the Venice Biennale website and saw the theme for this year’s exhibition,

Courtesy: Venice Biennale [downloaded from https://www.labiennale.org/en/news/biennale-arte-2024-stranieri-ovunque-foreigners-everywhere]

Biennale Arte 2024: Stranieri Ovunque – Foreigners Everywhere

The 60th International Art Exhibition, curated by Adriano Pedrosa, will be open from Saturday 20 April to Sunday 24 November at the Giardini and Arsenale venues.

The 60th International Art Exhibition, titled Stranieri Ovunque – Foreigners Everywhere, will open to the public from Saturday April 20 to Sunday November 24, 2024, at the Giardini and the Arsenale; it will be curated by Adriano Pedrosa and organised by La Biennale di Venezia. The pre-opening will take place on April 17, 18 and 19; the awards ceremony and inauguration will be held on 20 April 2024.

Since 2021, La Biennale di Venezia launched a plan to reconsider all of its activities in light of recognized and consolidated principles of environmental sustainability. For the year 2024, the goal is to extend the achievement of “carbon neutrality” certification, which was obtained in 2023 for La Biennale’s scheduled activities: the 80th Venice International Film Festival, the Theatre, Music and Dance Festivals and, in particular, the 18th International Architecture Exhibition which was the first major Exhibition in this discipline to test in the field a tangible process for achieving carbon neutrality – while furthermore itself reflecting upon the themes of decolonisation and decarbonisation

The Exhibition will take place in the Central Pavilion (Giardini) and in the Arsenale, and it will present two sections: the Nucleo Contemporaneo and the Nucleo Storico.

As a guiding principle, the Biennale Arte 2024 has favored artists who have never participated in the International Exhibition—though a number of them may have been featured in a National Pavilion, a Collateral Event, or in a past edition of the International Exhibition. Special attention is being given to outdoor projects, both in the Arsenale and in the Giardini, where a performance program is being planned with events during the pre-opening and closing weekend of the 60th Exhibition.

Stranieri Ovunque – Foreigners Everywhere, the title of the 60th International Art Exhibition of La Biennale di Venezia, is drawn from a series of works started in 2004 by the Paris-born and Palermo-based Claire Fontaine collective. The works consist of neon sculptures in different colours that render in a growing number of languages the words “Foreigners Everywhere”. The phrase comes, in turn, from the name of a Turin collective who fought racism and xenophobia in Italy in the early 2000s.

«The expression Stranieri Ovunque – explains Adriano Pedrosa – has several meanings. First of all, that wherever you go and wherever you are you will always encounter foreigners— they/we are everywhere. Secondly, that no matter where you find yourself, you are always truly, and deep down inside, a foreigner.»

«The Italian straniero, the Portuguese estrangeiro, the French étranger, and the Spanish extranjero, are all etymologically connected to the strano, the estranho, the étrange, the extraño, respectively, which is precisely the stranger. Sigmund Freud’s Das Unheimliche comes to mind—The Uncanny in English, which in Portuguese has indeed been translated as “o estranho”– the strange that is also familiar, within, deep down side. According to the American Heritage and the Oxford Dictionaries, the first meaning of the word “queer” is precisely “strange”, and thus the Exhibition unfolds and focuses on the production of other related subjects: the queer artist, who has moved within different sexualities and genders, often being persecuted or outlawed; the outsider artist, who is located at the margins of the art world, much like the self-taught artist, the folk artist and the artista popular; the indigenous artist, frequently treated as a foreigner in his or her own land. The productions of these four subjects are the interest of this Biennale, constituting the Nucleo Contemporaneo.»

«Indigenous artists have an emblematic presence and their work greets the public in the Central Pavilion, where the Mahku collective from Brazil will paint a monumental mural on the building’s façade, and in the Corderie, where the Maataho collective from Aotearoa/New Zealand will present a large-scale installation in the first room. Queer artists appear throughout the exhibition, and are also the subject of a large section in the Corderie, and one devoted to queer abstraction in the Central Pavilion.»

The Nucleo Contemporaneo will feature a special section in the Corderie devoted to the Disobedience Archive, a project by Marco Scotini, which since 2005 has been developing a video archive focusing on the relationships between artistic practices and activism. In the Exhibition, the presentation of the Disobedience Archive is designed by Juliana Ziebell, who also worked in the exhibition architecture of the entire International Exhibition. This section is divided into two main parts especially conceived for our framework: Diaspora activism and Gender Disobedience. The Disobedience Archive will include works by 39 artists and collectives made between 1975 and 2023.»

«The Nucleo Storico gathering works from 20th century Latin America, Africa, the Middle East and Asia. Much has been written about global modernisms and modernisms in the Global South, and a number of rooms will feature works from these territories, much like an essay, a draft, a speculative curatorial exercise that seeks to question the boundaries and definitions of modernism. We are all too familiar with the histories of modernism in Euroamerica, yet the modernisms in the Global South remain largely unknown. […]. European modernism itself travelled far beyond Europe throughout the 20th century, often intertwined with colonialism, and many artists in the Global South traveled to Europe to be exposed to it […].»

In the Central Pavilion three rooms are planned for the Nucleo Storico: one room is titled Portraits, one Abstractions and the third one is devoted to the the worldwide Italian artistic diaspora in the 20th century.

«The double-room named Portraits, includes works from 112 artists, mostly paintings but also works on paper and sculpture, spanning the years of 1905 and 1990. […] The theme of the human figure has been explored in countless different ways by artists in the Global South, reflecting on the crisis of representation around the that very figure that marked much of the art in 20th century art. In the Global South, many artists were in touch with European modernism, through travels, studies or books, yet they bring in their own highly personal and powerful reflections and contributions to their works […]. The room devoted to Abstractions includes 37 artists: most of them are being exhibited together for the first time, and we will learn from these unforeseen juxtapositions in the flesh, which will then hopefully point towards new connections, associations, and parallels much beyond the rather straightforward categories that I have proposed. […]»

Artists from Singapore and Korea have been brought into this section, given that at the time they were part of the so-called Third World. In a similar manner, Selwyn Wilson and Sandy Adsett, from Aotearoa/New Zealand, have been brought into this Nucleo Storico as they are historical Maori artists.

«[…] A third room in the Nucleo Storico is dedicated to the worldwide Italian artistic diaspora in the 20th century: Italian artists who travelled and moved abroad developing their careers in Africa, Asia, Latin America, as well as in the rest of Europe and the United States, becoming embedded in local cultures—and who often played significant roles in the development of the narratives of modernism beyond Italy. This room will feature works by 40 artists who are first or second generations Italians, exhibited in Lina Bo Bardi’s glass easel display system (Bo Bardi herself an Italian who moved to Brazil, and who won the 2021 Biennale Architettura’s Special Golden Lion for Lifetime Achievement in Memoriam).»

«Two quite different but related elements have emerged – underlines Pedrosa – rather organically in the research and have been developed, appearing as leitmotivs throughout the International Exhibition. The first one is textiles, which have been explored by many artists in the show in multiple, from key historical figures in the Nucleo Storico, to many artists in the Nucleo Contemporaneo. […] These works reveal an interest in craft, tradition, and the handmade, and in techniques that were at times considered other or foreign, outsider or strange in the larger field of fine arts. […] A second motif is artists—artists related by blood, many of them Indigenous. […] Again tradition plays an important role here: the transmission of knowledge and practices from father or mother to son or daughter or among siblings and relatives.»

…

There’s a lot more about this huge art exhibition on the Venice Biennale website but this is enough to give you a sense of the size and scope and how the work Eston describes fits into the 2024 exhibition theme.

Gale P. Eston‘s April 12, 2024 email announced an exhibition she curated and which is being held on site during the 2024 Venice Biennale (Note 1: I’ve published too late for the opening reception but there’s more to Eston’s curation than a reception; Note 2: There is an art/science aspect to the work from artist China Blue),

Hospitality in the Pluriverse, curated by Gale Elston during the 60th edition of the Venice Biennial from April 16 to May 4, 2024.

The Opening Reception will be held April 16th, 2024 from 5-7 pm

HOSPITALITY IN THE PLURIVERSE

JEREMY DENNIS

ANITA GLESTA

ANN MCCOY

WARREN NEIDICH

ILONA RICH

Corte de Ca’ Sarasina, Castello 1199, Venezia, IT, 30122

April 16 to May 4, 2024

OPENING RECEPTION: April 16, 5 to 7 PM

Gallery hours: Tuesday-Saturday 10-6 PM

Performances by CHINA BLUE curated by Elga Wimmer

April 16, 18 and 19 at 6 PM

RAINER GANAHL, Requiem, performed April 17 at 6 PM

This exhibition includes five artists who explore the political, historical, aesthetical, physical, and epistemological dimensions of hospitality and its’ conflicts. Based upon the analysis of Jacques Derrida, in his Of Hospitality, this exhibition scrutinizes the reaction of the host to alterity or otherness.

Each artist examines various questions surrounding the encounter of a foreigner and their host sovereign using a variety of media such as painting, photography, sculpture, and animation.

In discussion with Adriano Pedrosa’s exhibition Foreigners Everywhere, the exhibition Hospitality in the Pluriverse understands the complexity of immigration and begs the question of what hospitality is and when and how should it be extended to the stranger, the foreigner, the “other”.

On the one hand the devastating effects of global inequality, climate change (climate refugees) and the political pressures created have led to mass migration and political and chaos. In opposition, the richness of the contributions of the other in the form of cultural and epistemological multiplicity is invaluable.

Jeremy Dennis, First Nation artist and Tribal Member of the Shinnecock Indian Nation in Southampton, NY, uses staging and computer assisted techniques to create unusual color photographs which portray indigenous identity, culture, and assimilation. His photographs challenge how indigenous people have been presented in film in America Westerns as well as empowering them through the use of a haunting Zombie trope establishing the power of ancestral knowledge as a means of resistance.

Ann McCoy, a New York-based sculptor, painter, and art critic, and Editor-at- Large for the Brooklyn Rail includes a new drawing from her recent Guggenheim Fellowship exploring the fairy tale of a wolf in her father’s silver, gold and tungsten mill. The fairy tale is based on an historic site of many Irish immigrant workers’ deaths and expresses the tragedy using Jungian and alchemical references.

Warren Neidich’s work Pluriverse* engages with the concept of cognitive justice. As Bonaventure de Sousa Santos has said there can be no social justice without cognitive justice. Cognitive which includes the right of different traditions of knowledge and the cultural practices they are engaged with to co-exist without duress. Especially relevant for us here are those forms of knowledge that have evolved in the so-called enlightened global North, Indigenous Knowledges and those in the subaltern global South and Asia. Pluriverse is an expression that is inclusive of these diverse epistemologies. We don’t want to live in a normative, homogeneous Universe but rather a heterogeneous and multiplicitous Pluriverse.*

Anita Glesta, depicts the non-human foreigner (a corona virus moving through the body like a bug or a butterfly) set to a soundtrack from Hildegard von Bingen, the abbess and composer from the medieval ages. Glesta’s video was developed on a Fellowship with The ARC Laureate Felt Experience & Empathy Lab to research how anxiety affects our nervous system. As an extension of the pandemic series her animations invite the viewer to experience how humans process fear and anxiety in their bodies.

Spanish artist Ilona Rich work continues the theme of what it is to be a foreigner on a psychological level. Her colorful sculptures describe a dystopian view of the commonplace and the everyday.

Her work shows us a person who feels like a stranger in their own skin, anxious, precarious, not normative. Her dogs have two heads and the many feet of a centipede. Her sculpture Wheel of Fortune will be displayed which posits that fate is contingent on chance and our roles as host or foreigner are subject to rapid unexpected change.

The exhibition offers a dizzying study of alterity, on the biological (Glesta), the social (Dennis), the historical (McCoy), cognitive (Neidich) and personal levels (Rich).The viewer will come away with an expanded and enriched view of what it means to be a foreigner and asks what contingencies, if any, should accompany hospitality.

— Gale Elston

China Blue, Saturn Walk: Embodying Listening during the 2024 Venice Biennial with (Re)Create [emphasis mine]

Project Space Venice, curated by Elga Wimmer.

US/Canadian artist China Blue creates art performances that give a physical expression to sound based on her interest in connecting through art and science.

For her 2024 Venice exhibition, Saturn Walk: Embodying Listening by China Blue, performers and visitors walk in a labyrinth to a composition created by her and Lance Massey. This is a work based on the sonics in Saturn’s rings that China Blue and Dr. Seth Horowitz discovered as a result of a grant from NASA to explore Saturn’s rings.

In Saturn Walk: Embodying Listening for the (Re)Create Project Space Venice, the artist invites viewers to experience the sound walk following the dance performance. The dancers include Andrea Nann and Jennifer Dahl, Canada, and Laura Coloman, UK. A trace of China Blue’s performance, an artwork, Celestial Pearls, based on 16 of Saturn’s 100+ moons, will remain on view at (Re)Create Project Space Venice.

Austrian artist Rainer Ganahl performs his work, Requiem in memoriam for Russian dissident Alexei Navalny.

It seems like you might need the full seven months to fully appreciate the work on display at the 2024 Venice Biennale.

Chandra Sonifications (extraplanetary music and data sonification)

Leave a reply

I’m not sure why the astronomy community is so taken with creating music out of data but it seems to be the most active of the science communities in the field. This October 15. 2023 article by Elizabeth Hlavinka for Salon.com provides a little context before describing some of the latest work, Note: Links have been removed,

Christine Malec, who has been blind since birth, has always been a big astronomy buff, fascinated by major questions about the universe like what happens when a limit reaches infinity and whether things like space travel could one day become a reality. However, throughout her childhood, most astronomical information was only accessible to her via space documentaries or science fiction books.

Nearly a decade ago, Malec discovered a completely new way to experience astronomy when she saw astronomer and musician Matt Russo, Ph.D., give a presentation at a local planetarium in Toronto. Using a process called astronomical sonification, Russo had translated information collected from the TRAPPIST-1 solar system, which has seven planets locked in an orbital resonance, into something people who are blind or have low vision could experience: music. 

Russo’s song sent a wave of goosebumps through Malec’s body. Something she had previously understood intellectually but never had turned into a sensory experience was suddenly, profoundly felt.

“It was unforgettable,” Malec told Salon in a phone interview. “I compare it to what it might be like for a sighted person to look up at the night sky and get a sensory intuition of the size and nature of the cosmos. As a blind person, that’s an experience I hadn’t had.”

Through astronomical sonification, scientists map complex astronomical structures like black holes or exploded stars through the similarly expansive and multidimensional world of sound. Translating data from outer space into music not only expands access to astronomy for people who are blind or have low vision, but it also has the potential to help all scientists better understand the universe by leading to novel discoveries. Like images from the James Webb telescope that contextualize our tiny place in the universe, astronomical sonification similarly holds the power to connect listeners to the cosmos.

“It really does bring a connection that you don’t necessarily get when you’re just looking at a cluster of galaxies that’s billions of light years away from you that stretches across many hundreds of millions of light years,” said Kimberly Kowal Arcand, Ph.D., a data visualizer for NASA’s Chandra X-ray Observatory. “Having sound as a way of experiencing that type of phenomenon, that type of object, whatever it is, is a very valid way of experiencing the world around you and of making meaning.”

Malec serves as a consultant for Chandra Sonifications, which translates complex data from astronomical objects into sound. One of their most popular productions, which has been listened to millions of times, sonified a black hole in the Perseus cluster galaxy about 240 million light-years away. When presenting this sonification at this year’s [2023] SXSW festival in March, Russo, who works with Chandra through an organization he founded called SYSTEM Sounds, said this eerie sound used to depict the black hole had been likened to “millions of damned souls being sucked into the pits of hell.” 

…

Here’s some of what the audience at the 2023 SXSW festival heard,

If you have the time , do read Hlavinka’s October 15. 2023 article as she tells a good story with many interesting tidbits such as this (Note: Links have been removed),

…

William “Bill” Kurth, Ph.D., a space physicist at the University of Iowa, said the origins of astronomical sonification can be traced back to at least the 1970s when the Voyager-1 spacecraft recorded electromagnetic wave signals in space that were sent back down to his team on Earth, where they were processed as audio recordings.

Back in 1979, the team plotted the recordings on a frequency-time spectrogram similar to a voiceprint you see on apps that chart sounds like birds chirping, Kurth explained. The sounds emitted a “whistling” effect created by waves following the magnetic fields of the planet rather than going in straight lines. The data seemed to confirm what they had suspected: lightning was shocking through Jupiter’s atmosphere.

“At that time, the existence of lightning anywhere other than in Earth’s atmosphere was unknown,” Kurth told Salon in a phone interview. “This became the first time that we realized that lightning might exist on another planet.”

…

And this (Note: Links have been removed),

…

Beyond astronomy, sonification can be applied to any of the sciences, and health researchers are currently looking at tonifying DNA strands to better understand how proteins fold in multiple dimensions. Chandra is also working on constructing tactile 3-D models of astronomical phenomena, which also expands access for people who are blind or have low vision — those who have historically only been able to experience these sciences through words, Malec said.

…

Chandra and other sonification projects

I found a brief and somewhat puzzling description of the Chandra sonification project on one of the of US National Aeronautics and Space Administration (NASA) websites. From a September 22, 2021 posting on the Marshall Science Research and Projects Division blog (Note: Links have been removed,)

On 9/16/21, a Chandra sonification image entitled “Jingle, Pluck, and Hum: Sounds from Space” was released to the public.  Since 2020, Chandra’s “sonification” project has transformed astronomical data from some of the world’s most powerful telescopes into sound.  Three new objects — a star-forming region, a supernova remnant, and a black hole at the center of a galaxy — are being released.  Each sonification has its own technique to translate the astronomical data into sound.

For more information visit: Data Sonifications: Westerlund 2 (Multiwavelength), Tycho’s Supernova Remnant, and M87. https://www.nasa.gov/missions_pages/chandra/main/index.html.

A Chandra article entitled “Data Sonification: Sounds from the Milky Way” was also released in the NASA STEM Newsletter.  This newsletter was sent to 54,951 subscribers and shared with the office of STEM engagements social media tools with approximately 1.7M followers. For more information visit: https://myemail.constantcontact.com/NASA-EXPRESS—-Your-STEM-Connection-for-Sept–9–2021.html?soid=1131598650811&aid=iXfzAJk6x_s

I’m a little puzzled by the reference to a Chandra sonification image but I’m assuming that they also produce data visualizations. Anyway, as Hlavinka notes Chandra is a NASA X-ray Observatory and they have a number of different projects/initiatives.

Getting back to data sonification, Chandra offers various audio files on its A Universe of Sound webpage,

Here’s a sampling of three data sonification posts (there are more) here,

Enjoy!

The sounds of recent (December 2023) seismic activity in Iceland

Leave a reply

On the heels of yesterday’s When the rocks sing “I got rhythm” (my December 18, 2023 posting), I received (via email) a media notice/reminder/update about a Northwestern University (Chicago, Illinois, US) app that allows you to listen,

From the original November 16, 2023 Northwestern University news release by Amanda Morris (also published as a November 16, 2023 news item on phys.org),

As seismic activity intensifies ahead of an impending eruption of a fissure near Iceland’s Fagradalsfjall volcano, the island’s Reykjanes Peninsula is experiencing hundreds of earthquakes per day.

Now, listeners can follow along through Northwestern University’s Earthtunes app. Developed in 2019, the app transforms seismic frequencies into audible pitches. Whereas a classic seismometer records motions in the Earth’s surface as squiggly lines scratched across a page, Earthtunes enables users to hear, rather than see, activity.

So far, Iceland’s recent, ongoing seismic activity sounds like a jarring symphony of doors slamming, hail pelting against a tin roof or window and people cracking trays of ice cubes.

By listening to activities recorded by the Global Seismographic Network station (named BORG), located to the north-northeast of Reykjavik, people can hear how the seismic activity has changed around the Fagradalsfjall area.

In this audio clip, listeners can hear 24 hours of activity recorded from Friday, Nov. 10, into Saturday, Nov. 11. Peppered with a cacophony of sharp knocking noises, it sounds like someone is insistently banging on a door.

“The activity is formidable, exciting and scary,” said Northwestern seismologist Suzan van der Lee, who co-developed Earthtunes. “Iceland did the right thing by evacuating residents in nearby Grindavik and the nearby Svartsengi geothermal power plant, one of the world’s oldest geothermal power plants, which was the first to combine electricity generation with hot water for heating in the region.”

Van der Lee is the Sarah Rebecca Roland Professor of Earth and Planetary Sciences at Northwestern’s Weinberg College of Arts and Sciences. In her research, she applies data science to millions of records of seismic waves in order to decode seismic signals, which harbor valuable information about the Earth’s interior dynamics.

As hundreds of earthquakes shake the ground, Van der Lee says the impending eruption is reminiscent of the 1973 eruption of Heimaey on Iceland’s Vestmannaeyjar archipelago.

“This level of danger is unprecedented for this area of Iceland, but not for Iceland as a whole,” said van der Lee, who hiked Fagradalsfjall in June. “While most Icelandic volcanoes erupt away from towns and other infrastructure, Icelanders share the terrible memory of an eruption 50 years ago on the island Vestmannaeyjar, during which lava covered part of that island’s town, Heimaey. The residents felt very vulnerable, as the evacuated people of Grindavik feel now. In a few days or weeks, they might no longer have their jobs, homes and most possessions, while still having to feed their families and pay their mortgages. However, partially resulting from that eruption on Vestmannaeyjar, Icelanders are well prepared for the current situation in the Fagradallsfjall-Svartsengi-Grindavik area.” 

Accelerated audio

This audio clip presents the same data, with the pitch increased by 10 octaves. Listeners will hear a long, low rumbling sound, punctuated by an occasional slamming door.

“What you’re hearing is 24 hours of seismic data — filled with earthquake signals,” van der Lee said. “The vast majority of these quakes are associated with the magma intrusion into the crust of the Fagradallsfjall-Svartsengi-Grindavik area of the Reykjanes Peninsula. Seismic data are not audible; their frequencies are too low. So, the 24 hours of data are compressed into approximately 1.5 minutes of audio data. You can hear an unprecedented intensity of earthquakes during the night from last Friday into Saturday and related to a new magma intrusion into the crust area.”

In a third audio clip, the same data is less compressed, with the pitch increased by just seven octaves

“One can hear frequent earthquakes happening at this point,” van der Lee said. “Icelandic seismologists have been monitoring these quakes and their increasing vigor and changing patterns. They recognized similar patterns to earthquake swarms that preceded the 2021-2023 eruptions of the adjacent Fagradallsfjall volcano.”

Earthtunes is supported by the American Geophysical Union and Northwestern’s department of Earth and planetary sciences. Seismic data is obtained from the Earthscope Consortium. The app was designed and developed by van der Lee, Helio Tejedor, Melanie Marzen, Igor Eufrasio, Josephine Anderson, Liam Toney, Cooper Barth, Michael Ji and Leonicio Cabrera.

Jennifer Ouellette’s November 16, 2023 article for Ars Tecnica draws heavily from the news release while delving into the topic of data sonification (making sounds from data), Note: Links have been removed,

….

Sonification of scientific data is an area of growing interest in many different fields. For instance, several years ago, a project called LHCSound built a library of the “sounds” of a top quark jet and the Higgs boson, among others. The project hoped to develop sonification as a technique for analyzing the data from particle collisions so that physicists could “detect” subatomic particles by ear. Other scientists have mapped the molecular structure of proteins in spider silk threads onto musical theory to produce the “sound” of silk in hopes of establishing a radical new way to create designer proteins. And there’s a free app for Android called the Amino Acid Synthesizer that enables users to create their own protein “compositions” from the sounds of amino acids.

…

The December 19, 2023 Northwestern University media update points to the latest audio file of the eruption of the svartsengi-grindavik fissure in Iceland: 24 hours as of Monday, December 18, 2023 14:00:00 UTC.

Enjoy!

One last thing, there are a number of postings about data sonification here; many but not all scientists and/or communication practitioners think to include audio files.

The sound of dirt

Leave a reply

So you don’t get your hopes up, this acoustic story doesn’t offer any accompanying audio/acoustic files, i.e., I couldn’t find the sound of dirt.

In any event, there’s still an interesting story in an April 10, 2023 news item on phys.org,

U.K. and Australian ecologists have used audio technology to record different types of sounds in the soils of a degraded and restored forest to indicate the health of ecosystems.

Non-invasive acoustic monitoring has great potential for scientists to gather long-term information on species and their abundance, says Flinders University [Australia] researcher Dr. Jake Robinson, who conducted the study while at the University of Sheffield in England.

…

Photo: Pixabay

An April 8, 2023 Flinders University press release, which originated the news item, delves into the researcher’s work, Note: Links have been removed,

“Eco-acoustics can measure the health lf landscapes affected by farming, mining and deforestation but can also monitor their recovery following revegetation,” he says.  

“From earthworms and plant roots to shifting soils and other underground activity, these subtle sounds were stronger and more diverse in healthy soils – once background noise was blocked out.”   

The subterranean study used special microphones to collect almost 200 sound samples, each about three minutes long, from soil samples collected in restored and cleared forests in South Yorkshire, England. 

“Like underwater and above-ground acoustic monitoring, below-ground biodiversity monitoring using eco-acoustics has great potential,” says Flinders University co-author, Associate Professor Martin Breed. 

Since joining Flinders University, Dr Robinson has released his first book, entitled Invisible Friends (DOI: 10.53061/NZYJ2969) [emphasis mine], which covers his core research into ‘how microbes in the environment shape our lives and the world around us’. 

Now a researcher in restoration genomics at the College of Science and Engineering at Flinders University, the new book examines the powerful role invisible microbes play in ecology, immunology, psychology, forensics and even architecture.  

“Instead of considering microbes the bane of our life, as we have done during the global pandemic, we should appreciate the many benefits they bring in keeping plants animals, and ourselves, alive.”  

In another new article, Dr Robinson and colleagues call for a return to ‘nature play’ for children [emphasis mine] to expose their developing immune systems to a diverse array of microbes at a young age for better long-term health outcomes. 

“Early childhood settings should optimise both outdoor and indoor environments for enhanced exposure to diverse microbiomes for social, cognitive and physiological health,” the researchers say.  

“It’s important to remember that healthy soils feed the air with these diverse microbes,” Dr Robinson adds.  

It seems Robinson has gone on a publicity blitz, academic style, for his book. There’s a May 22, 2023 essay by Robinson, Carlos Abrahams (Senior Lecturer in Environmental Biology – Director of Bioacoustics, Nottingham Trent University); and Martin Breed (Associate Professor in Biology, Flinders University) on the Conversation, Note: A link has been removed,

Nurturing a forest ecosystem back to life after it’s been logged is not always easy.

It can take a lot of hard work and careful monitoring to ensure biodiversity thrives again. But monitoring biodiversity can be costly, intrusive and resource-intensive. That’s where ecological acoustic survey methods, or “ecoacoustics”, come into play.

Indeed, the planet sings. Think of birds calling, bats echolocating, tree leaves fluttering in the breeze, frogs croaking and bush crickets stridulating. We live in a euphonious theatre of life.

Even the creatures in the soil beneath our feet emit unique vibrations as they navigate through the earth to commute, hunt, feed and mate.

…

Robinson has published three papers within five months of each other, in addition to the book, which seems like heavy output to me.

First, here’s a link to and a citation for the education paper,

Optimising Early Childhood Educational Settings for Health Using Nature-Based Solutions: The Microbiome Aspect by Jake M. Robinson and Alexia Barrable. Educ. Sci. 2023, 13 (2), 211 DOI: https://doi.org/10.3390/educsci13020211
Published: 16 February 2023

This is an open access paper.

For these two links and citations, the articles seem to be very closely linked.,

The sound of restored soil: Measuring soil biodiversity in a forest restoration chronosequence with ecoacoustics by Jake M. Robinson, Martin F. Breed, Carlos Abrahams. doi: https://doi.org/10.1101/2023.01.23.525240 Posted January 23, 2023

The sound of restored soil: using ecoacoustics to measure soil biodiversity in a temperate forest restoration context by Jake M. Robinson, Martin F. Breed, Carlos Abrahams. Restoration Ecology, Online Version of Record before inclusion in an issue e13934 DOI: https://doi.org/10.1111/rec.13934 First published: 22 May 2023

Both links lead to open access papers.

Finally, there’s the book,

Invisible Friends; How Microbes Shape Our Lives and the World Around Us by Jake Robinson. Pelagic Publishing, 2022. ISBN 9781784274337 DOI: 10.53061/NZYJ2969

This you have to pay for.

For those would would like to hear something from nature, I have a May 27, 2022 posting, The sound of the mushroom. Enjoy!

Music of the chemical elements

Leave a reply

It’s a little late since this work was presented at the American Chemical Society’s (ACS) Spring 2023 meeting but it’s a fascinating approach to the periodic table of elements that features a longstanding interest of mine, data sonification.

A March 26, 2023 news item on phys.org announces the then upcoming presentation abut a musical version of the periodic table of elements,

In chemistry, we have He [helium], Fe [iron] and Ca [calcium]—but what about do, re and mi? Hauntingly beautiful melodies aren’t the first things that come to mind when looking at the periodic table of the elements. However, using a technique called data sonification, a recent college graduate has converted the visible light given off by the elements into audio, creating unique, complex sounds for each one. Today [March 26, 2023], the researcher reports the first step toward an interactive, musical periodic table.

…

A March 26, 2023 ACS news release on EurekAlert, which originated the news item, provides more detail (the presentation abstract is included),

The researcher will present his results at the spring meeting of the American Chemical Society (ACS). ACS Spring 2023 is a hybrid meeting being held virtually and in-person March 26–30 [2023], and features more than 10,000 presentations on a wide range of science topics.

…

Previously, W. Walker Smith, the project’s sole investigator, took his combined passions of music and chemistry and converted the natural vibrations of molecules into a musical composition. “Then I saw visual representations of the discrete wavelengths of light released by the elements, such as scandium,” says Smith. “They were gorgeous and complex, and I thought, ‘Wow, I really want to turn these into music, too.’”

Elements emit visible light when they are energized. This light is made up of multiple individual wavelengths, or particular colors, with brightness levels that are unique for each element. But on paper, the collections of wavelengths for different elements are hard to tell apart visually, especially for the transition metals, which can have thousands of individual colors, says Smith. Converting the light into sound frequencies could be another way for people to detect the differences between elements.

However, creating sounds for the elements on the periodic table has been done before. For instance, other scientists have assigned the brightest wavelengths to single notes played by the keys on a traditional piano. But this approach reduced the rich variety of wavelengths released by some elements into just a few sounds, explains Smith, who is currently a researcher at Indiana University.

To retain as much of the complexity and nuance of the element spectra as possible, Smith consulted faculty mentors at Indiana University, including David Clemmer, Ph.D., a professor in the chemistry department, and Chi Wang, D.M.A., a professor in the Jacobs School of Music. With their assistance, Smith built a computer code for real-time audio that converted each element’s light data into mixtures of notes. The discrete color wavelengths became individual sine waves whose frequency corresponded to that of the light, and their amplitude matched the brightness of the light.

Early in the research process, Clemmer and Smith discussed the pattern similarities between light and sound vibrations. For instance, within the colors of visible light, violet has almost double the frequency of red, and in music, one doubling of frequency corresponds to an octave. Therefore, visible light can be thought of as an “octave of light.” But this octave of light is at a much higher frequency than the audible range. So, Smith scaled the sine waves’ frequencies down by approximately 10-12, fitting the audio output into a range where human ears are most sensitive to differences in pitch.

Because some elements had hundreds or thousands of frequencies, the code allowed these notes to be generated in real time, forming harmonies and beating patterns as they mixed together. “The result is that the simpler elements, such as hydrogen and helium, sound vaguely like musical chords, but the rest have a more complex collection of sounds,” says Smith. For example, calcium sounds like bells chiming together with a rhythm resulting from how the frequencies interact with each other. Listening to the notes from some other elements reminded Smith of a spooky background noise, similar to music used in cheesy horror movies. He was especially surprised by the element zinc, which despite having a large number of colors, sounded like “an angelic choir singing a major chord with vibrato.”

“Some of the notes sound out of tune, but Smith has kept true to that in this translation of the elements into music,” says Clemmer. These off-key tones — known musically as microtones — come from frequencies that are found between the keys of a traditional piano. Agreeing, Wang says, “The decisions as to what’s vital to preserve when doing data sonification are both challenging and rewarding. And Smith did a great job making such decisions from a musical standpoint.”

The next step is to turn this technology into a new musical instrument with an exhibit at the WonderLab Museum of Science, Health, and Technology in Bloomington, Indiana. “I want to create an interactive, real-time musical periodic table, which allows both children and adults to select an element and see a display of its visible light spectrum and hear it at the same time,” says Smith. He adds that this sound-based approach has potential value as an alternative teaching method in chemistry classrooms, because it’s inclusive to people with visual impairments and different learning styles.

…

Smith acknowledges support and funding from Indiana University’s Department of Chemistry, Center for Electronic and Computer Music, and Center for Rural Engagement; an Indiana University Undergraduate Research grant; the 2022 Annual Project Jumpstart Innovation Competition; and the Indiana University Hutton Honors College Grant Program.

A recorded media briefing on this topic will be posted Monday, March 27 [2023], by 10 a.m. Eastern time at www.acs.org/acsspring2023briefings. Reporters can request access to media briefings during the embargo period by contacting newsroom@acs.org. [The ACS 2023 Spring Meeting media briefings are freely available as of June 12, 2023. The “What do the elements sound like? Media Briefing” runs approximately 11 mins.]

…

If you keep going past the news release, you’ll find this presentation abstract,

Title
Designing an interactive musical periodic table: sonification of visible element emission spectra

Abstract
What does the element helium sound like? What about hydrogen? While these may seem like absurd questions, the process of data sonification can be used to convert the visible spectra of chemical elements into sounds. When stimulated by electricity or heat, elements release distinct wavelengths of light depending on their electron energy levels—a sort of “chemical footprint” unique to every element. These frequencies of light, which we perceive as different colors, can be scaled into the audio range to yield different sonic frequencies, allowing one to hear the different sounds of chemical elements. This research project involved the construction of an interactive musical periodic table, combining musical and visual representations of elemental spectra from high-resolution spectral datasets.

The interactive periodic table was designed using Max/MSP, a programming language that uses digital signal processing (DSP) algorithms to generate real-time audio and visual outputs. This allows all spectral lines of an element to be played simultaneously (as a “chord”) or for individual lines to be played in succession (as a “melody”). This highly interdisciplinary project has applications spanning data analysis, STEAM (STEM [science, technology, engineering, and mathematics] + Arts) education, and public science outreach. Sonification of scientific data provides alternative methods of analysis that can expand access of such data to blind and visually impaired people. Sonification can even enhance data analysis via traditional data visualization by providing a supplementary layer of auditory information, and sonification-based learning models have been shown to improve student engagement and understanding of scientific concepts like protein folding.

This program is currently being implemented in several middle and high school music and science classes, as well as a public music/science show titled “The Sound of Molecules” at WonderLab Museum of Science. Future work will focus on designing a free and open-source version of the program that does not require specialized DSP software.

“The Heart’s Knowledge: Science and Empathy in the Art of Dario Robleto” from Jan. 27 to July 9, 2023 at The Block Museum of Art (Northwestern University, Chicago, Illinois)

Leave a reply

I’m sorry to be late. Thankfully this show extends into July 2023, so, there’s still plenty of time to get to Chicago’s The Block Museum of Art (at Northwestern University) art/science exhibition. I found this on the museum’s exhibition page for “The Heart’s Knowledge: Science and Empathy in the Art of Dario Robleto” show,

What do we owe to the memories of one another’s hearts?

For American artist Dario Robleto (b. 1972), artists and scientists share a common aspiration: to increase the sensitivity of their observations. Throughout the history of scientific invention, instruments like the cardiograph and the telescope have extended the reach of perception from the tiniest stirrings of the human body to the farthest reaches of space. In his prints, sculptures, and video and sound installations, Robleto contemplates the emotional significance of these technologies, bringing us closer to the latent traces of life buried in the scientific record.

The Heart’s Knowledge concentrates on the most recent decade of Robleto’s creative practice, a period of deepening engagement with histories of medicine, biomedical engineering, sound recording, and space exploration. The exhibition organizes the artist’s conceptually ambitious, elegantly wrought artworks as a series of multisensory encounters between art and science.  Each work seeks to attune viewers to the material traces of life at scales ranging from the intimate to the universal, returning always to the question: Does empathy extend beyond the boundaries of time and space?

…

Banner image for “The Heart’s Knowledge: Science and Empathy in the Art of Dario Robleto” exhibition page. Courtesy of The Block Museum of Art (Northwestern University) and artist, Dario Robleto

Here’s more from a January 27, 2023 Northwestern University news release (received via email),

Exhibition searches for meaning at the limits of science and perception

“The Heart’s Knowledge: Science and Empathy in the Art of Dario Robleto” is on view Jan. 27 to July 9 [2023] at The Block Museum of Art

  • Works are informed by dialogue with Northwestern Engineering researchers during five-year residency  
  • Exhibition a tribute to NASA Golden Record creator, ‘whose heart has left the solar system’
  • Opening conversation with the artist will take place at 2 p.m. on [Saturday] Feb. 4 [2023]

American artist Dario Robleto (b. 1972) believes artists and scientists share a common aspiration: to increase the sensitivity of their observations.

From understanding the human body’s pulses and brainwaves to viewing the faintest glimmers of light from the edge of the observable universe, groundbreaking science pushes the limits of perception. Similarly, the perceptive work of artists can extend the boundaries of empathy and understanding.

Since 2018, Robleto served as an artist-at-large at the McCormick School of Engineering. This unique partnership between The Block Museum and McCormick gave the artist an open “hall pass” to learn from, collaborate with and question scientists, engineers and experts from across the University.

Robleto’s five-year residency concludes with the exhibition “The Heart’s Knowledge: Science and Empathy in the Art of Dario Robleto.” Co-presented by The Block Museum and McCormick, the exhibition is on view from Jan. 27 to July 9 [2023] at The Block Museum, 40 Arts Circle Drive on Northwestern’s Evanston campus. [emphasis mine]

A free opening conversation with the artist will take place at 2 p.m. on Saturday, Feb. 4 [2023], in Norris University Center’s McCormick Auditorium, 1999 Campus Drive in Evanston.

About the Exhibition: “The Heart’s Knowledge”

Throughout the history of scientific invention, instruments like the cardiograph and the telescope have extended the reach of perception from the tiniest stirrings of the human body to the farthest reaches of space.

Robleto’s prints, sculptures and video and sound installations contemplate the emotional significance of these technologies, bringing viewers closer to the latent traces of life buried in the scientific record.

“The Heart’s Knowledge” represents a decade of Robleto’s creative practice, from 2012 to 2022, a period marked by a deepening engagement with science, including astronomy, synthetic biology and exobiology, and a widening embrace of new materials and creative forms, from 3D-printed objects to film.

Robleto dedicates the exhibition to Ann Druyan, the creative director of NASA’s Golden Record for the Voyager 1 and 2 projects. The record includes Druyan’s brainwaves and heartbeats, recorded as she reflected on her secret love for famed astronomer and future husband Carl Sagan. The act of sneaking “love on board the Voyager” inspired Robleto to compose a love letter to the only human whose “heart has left the solar system.”

Robleto sees Druyan’s act to include her emotions on the record as the central inspiration of his work. “I consider it the greatest work of subversive, avant-garde art not yet given its due,” Robleto said. “The Golden Record and Ann’s radical act brought us all together to think about what it means to be human — to one another and to unknown beings on other worlds.”

The exhibition organizes the artist’s conceptually ambitious, elegantly wrought artworks as a series of multisensory encounters between art and science. Each asks viewers to seek out the material traces of life in scales ranging from the intimate to the universal, and to question: Does empathy extend beyond the boundaries of time and space?

“Whether he’s addressing the most minute phenomena of the body or the horizons of the known universe, Robleto binds the rigor of scientific inquiry with artistic expression,” said exhibition curator Michael Metzger, The Block’s Pick-Laudati Curator of Media Arts.

“Straining at the bounds of observation, Robleto discovers unity at the limits; the common endeavor of art and science to achieve a form of knowledge that language alone cannot speak,” Metzger said.

The exhibition includes three sections:

“Heartbeats“
Rooted in the artist’s longstanding fascination with the clinical and cultural history of the human heart, “Heartbeats” draws inspiration from 19th-century pioneers of cardiography, whose instruments graphically measured heart activity for the first time, leaving behind poignant records of human subjectivity. In “The First Time, the Heart (A Portrait of Life 1854-1913)” (2017), Robleto transforms early measurements of heartbeats into photolithographs executed on paper hand-sooted with candle flames. For the installation “The Pulse Armed with a Pen (An Unknown History of the Human Heartbeat)” (2014), Robleto collaborated with sound historian Patrick Feaster to digitally resurrect these heartbeats in audio form, giving visitors access to intimate pulses of life recorded before the invention of sound playback.

“Wavelengths“
Robleto has recently embraced digital video to create works that narrate transformational episodes in the recording and study of wave phenomena. “Wavelengths” comprises two hour-long immersive video installations. “The Boundary of Life is Quietly Crossed” (2019) is inspired by NASA’s Voyager Golden Record, a gold-plated phonographic disc launched into space onboard the Voyager I and II space probes in 1977. In “The Aorta of an Archivist” (2020-2021), Robleto investigates three breakthroughs in the history of recording: the first recording of a choral performance made with an Edison wax cylinder, the first heartbeat captured while listening to music and the first effort to transcribe the brain wave activity of a dreaming subject.

“Horizons“
In the final section, “Horizons,” Robleto evokes the spirit of the Hubble telescope and the search for extraterrestrial life, gazing out at the boundaries of the observable universe. Inspired by his time as an artist-in-residence at the SETI Institute (Search for Extraterrestrial Intelligence) and as artistic consultant to the Breakthrough Initiatives, his intricate sculptures, such as “Small Crafts on Sisyphean Seas” (2018), give shape to the speculative search for intelligent life in the universe. Other works like “The Computer of Jupiter” (2019) are framed as “gifts for extraterrestrials” offering an alternative view of the best way to begin a dialogue with alien intelligences.

The Artist-at-Large Program at Northwestern

Lisa Corrin, the Ellen Philips Katz Executive Director of The Block Museum of Art, and Julio M. Ottino, dean of McCormick School of Engineering, envisioned the possibilities of this unconventional partnership between scientist and artist when they launched the artist-at-large initiative together. The work is part of an ongoing Art + Engineering initiative and a part of the whole-brain engineering philosophy at Northwestern Engineering.

“Here, a university’s school of engineering and its art museum come together in the shared belief that transformative innovation can happen at the intersections of usually distinct academic disciplines and modes of creativity and inquiry,” Corrin said. “We had faith that something meaningful would emerge organically if we merely provided structures in which informal interactions might take place.”

“We wanted to model for young engineers the value of embracing uncertainty as part of the journey that leads to innovation and opens pathways within the imagination — as artists do,” Ottino said. “We are grateful to Dario Robleto for accepting our invitation to come to Northwestern and to enter the unknown with us. He has taught us that our shared future resides in our capacity for compassion and for empathy, the ethos at the heart of his work that holds the most promise for those at the forefront of science in the interest of humankind.”

More information about Robleto’s residency can be found in the article “Dario is our Socrates” on the Block Museum website and by viewing the Northwestern Engineering video “Artist-at-Large Program: Dario Robleto.”

Exhibition Events

“The Heart’s Knowledge” will include six months of events and dialogues that will illuminate the intersections in Robleto’s practice. All events are free and open to the public. For current program information, visit The Block Museum website.

Program highlights for February and March include:

Science, Art and the Search for Meaning: Opening Conversation with Dario Robleto
Saturday, Feb. 4 [2023], 2 p.m.
Norris University Center, McCormick Auditorium
1999 Campus Drive

The Block Museum hosts a discussion that reaches across boundaries to examine the shared pursuit that binds artists and scientists. The conversation features artist Dario Robleto; Jennifer Roberts, professor of the humanities at Harvard University; Lucianne Walkowicz, astronomer and co-founder of the JustSpace Alliance; and Michael Metzger, Pick-Laudati Curator of Media Arts and curator of “The Heart’s Knowledge.”

“X: The Man with the X-Ray Eyes” (1963)
Friday, Feb. 10 [2023], 7 p.m.
Block Cinema
40 Arts Circle Drive

A Science on Screen program with Catherine Belling, associate professor of medical education at Northwestern University Feinberg School of Medicine.

“First Man” (2018)
Saturday Feb. 18 [2023], 1 p.m.
Block Cinema
40 Arts Circle Drive

A Science on Screen program featuring history researcher Jordan Bimm of the University of Chicago, who will discuss the military origins of “space medicine.”

Exhibition Conversation: Interstellar Aesthetics and Acts of Translation in Art and Science
Wednesday, Feb. 22 [2023], 6 p.m.
Block Museum

Joining artist Dario Robleto in conversation are Elizabeth Kessler, exhibition publication contributor and a lecturer in American Studies at Stanford University, and Shane Larson, research professor of physics and astronomy and associate director of CIERA (Center for Interdisciplinary Exploration and Research in Astrophysics) at Northwestern.

Gallery Talk: Stillness, Wonder and Gifts for Extraterrestrials
Thursday, Feb. 23 [2023], 12:30 p.m.
Block Museum

Elizabeth Kessler of Stanford University will discuss Robleto’s “gifts for extraterrestrials” series.

Online Conversation: Ann Druyan, The Golden Record and the Memory of Our Hearts
Wednesday, March 8 [2023], 6 p.m. [ET]
Block Cinema

Ann Druyan, creative director for NASA’s Voyager Interstellar Messaging Project and writer and producer of the PBS television series “Cosmos,” joins Robleto and art historian Jennifer Roberts for a conversation about the Golden Record and the heart’s memory.

Exhibition Publication

In conjunction with the exhibition, The Block Museum of Art and the McCormick School of Engineering are proud to announce the publication of “The Heart’s Knowledge: Science and Empathy in the Art of Dario Robleto,” (Artbook, D.A.P., 2023).

The publication is edited by Michael Metzger with contributions by Metzger, Robert M. Brain, Daniel K. L. Chua, Patrick Feaster, Stefan Helmreich, Elizabeth A. Kessler ,Julius B. Lucks, Elizabeth Kathleen Mitchell, Alexander Rehding, Jennifer L. Roberts, Claire Isabel Webb and Dario Robleto.

About Dario Robleto

Dario Robleto was born in San Antonio, Texas, in 1972 and received his BFA from the University of Texas at San Antonio in 1997. He lives and works in Houston, Texas. The artist has had numerous solo exhibitions since 1997, most recently at the Spencer Museum of Art, Lawrence, Kansas (2021); the Radcliffe Institute for Advanced Study at Harvard University (2019); the McNay Museum, San Antonio, Texas (2018); Menil Collection, Houston, Texas (2014); the Baltimore Museum of Art (2014); the New Orleans Museum of Art (2012); and the Museum of Contemporary Art, Denver (2011).

He is currently working on his first book, “Life Signs: The Tender Science of the Pulsewave,” co-authored with art historian Jennifer Roberts, the Elizabeth Cary Agassiz Professor of the Humanities at Harvard (University of Chicago Press).

Exhibition Credits

“The Heart’s Knowledge: Science and Empathy in the Art of Dario Robleto” exhibition is made possible through a partnership with the Robert R. McCormick School of Engineering and Applied Science at Northwestern University. Major support also was provided by the National Endowment for the Arts. Additional support is contributed by the Dorothy J. Speidel Fund; the Bernstein Family Contemporary Art Fund; the Barry and Mary Ann MacLean Fund for Art and Engineering; the Illinois Arts Council Agency; and the Alumnae of Northwestern University. The exhibition publication is made possible in part by the Sandra L. Riggs Publications Fund.

Should you be in the Chicago area and interested in the exhibit, you can find all the information for your visit here.

FrogHeart’s 2022 comes to an end as 2023 comes into view

Leave a reply

I look forward to 2023 and hope it will be as stimulating as 2022 proved to be. Here’s an overview of the year that was on this blog:

Sounds of science

It seems 2022 was the year that science discovered the importance of sound and the possibilities of data sonification. Neither is new but this year seemed to signal a surge of interest or maybe I just happened to stumble onto more of the stories than usual.

This is not an exhaustive list, you can check out my ‘Music’ category for more here. I have tried to include audio files with the postings but it all depends on how accessible the researchers have made them.

Aliens on earth: machinic biology and/or biological machinery?

When I first started following stories in 2008 (?) about technology or machinery being integrated with the human body, it was mostly about assistive technologies such as neuroprosthetics. You’ll find most of this year’s material in the ‘Human Enhancement’ category or you can search the tag ‘machine/flesh’.

However, the line between biology and machine became a bit more blurry for me this year. You can see what’s happening in the titles listed below (you may recognize the zenobot story; there was an earlier version of xenobots featured here in 2021):

This was the story that shook me,

Are the aliens going to come from outer space or are we becoming the aliens?

Brains (biological and otherwise), AI, & our latest age of anxiety

As we integrate machines into our bodies, including our brains, there are new issues to consider:

  • Going blind when your neural implant company flirts with bankruptcy (long read) April 5, 2022 posting
  • US National Academies Sept. 22-23, 2022 workshop on techno, legal & ethical issues of brain-machine interfaces (BMIs) September 21, 2022 posting

I hope the US National Academies issues a report on their “Brain-Machine and Related Neural Interface Technologies: Scientific, Technical, Ethical, and Regulatory Issues – A Workshop” for 2023.

Meanwhile the race to create brainlike computers continues and I have a number of posts which can be found under the category of ‘neuromorphic engineering’ or you can use these search terms ‘brainlike computing’ and ‘memristors’.

On the artificial intelligence (AI) side of things, I finally broke down and added an ‘artificial intelligence (AI) category to this blog sometime between May and August 2021. Previously, I had used the ‘robots’ category as a catchall. There are other stories but these ones feature public engagement and policy (btw, it’s a Canadian Science Policy Centre event), respectively,

  • “The “We are AI” series gives citizens a primer on AI” March 23, 2022 posting
  • “Age of AI and Big Data – Impact on Justice, Human Rights and Privacy Zoom event on September 28, 2022 at 12 – 1:30 pm EDT” September 16, 2022 posting

These stories feature problems, which aren’t new but seem to be getting more attention,

While there have been issues over AI, the arts, and creativity previously, this year they sprang into high relief. The list starts with my two-part review of the Vancouver Art Gallery’s AI show; I share most of my concerns in part two. The third post covers intellectual property issues (mostly visual arts but literary arts get a nod too). The fourth post upends the discussion,

  • “Mad, bad, and dangerous to know? Artificial Intelligence at the Vancouver (Canada) Art Gallery (1 of 2): The Objects” July 28, 2022 posting
  • “Mad, bad, and dangerous to know? Artificial Intelligence at the Vancouver (Canada) Art Gallery (2 of 2): Meditations” July 28, 2022 posting
  • “AI (artificial intelligence) and art ethics: a debate + a Botto (AI artist) October 2022 exhibition in the Uk” October 24, 2022 posting
  • Should AI algorithms get patents for their inventions and is anyone talking about copyright for texts written by AI algorithms? August 30, 2022 posting

Interestingly, most of the concerns seem to be coming from the visual and literary arts communities; I haven’t come across major concerns from the music community. (The curious can check out Vancouver’s Metacreation Lab for Artificial Intelligence [located on a Simon Fraser University campus]. I haven’t seen any cautionary or warning essays there; it’s run by an AI and creativity enthusiast [professor Philippe Pasquier]. The dominant but not sole focus is art, i.e., music and AI.)

There is a ‘new kid on the block’ which has been attracting a lot of attention this month. If you’re curious about the latest and greatest AI anxiety,

  • Peter Csathy’s December 21, 2022 Yahoo News article (originally published in The WRAP) makes this proclamation in the headline “Chat GPT Proves That AI Could Be a Major Threat to Hollywood Creatives – and Not Just Below the Line | PRO Insight”
  • Mouhamad Rachini’s December 15, 2022 article for the Canadian Broadcasting Corporation’s (CBC) online news overs a more generalized overview of the ‘new kid’ along with an embedded CBC Radio file which runs approximately 19 mins. 30 secs. It’s titled “ChatGPT a ‘landmark event’ for AI, but what does it mean for the future of human labour and disinformation?” The chat bot’s developer, OpenAI, has been mentioned here many times including the previously listed July 28, 2022 posting (part two of the VAG review) and the October 24, 2022 posting.

Opposite world (quantum physics in Canada)

Quantum computing made more of an impact here (my blog) than usual. it started in 2021 with the announcement of a National Quantum Strategy in the Canadian federal government budget for that year and gained some momentum in 2022:

  • “Quantum Mechanics & Gravity conference (August 15 – 19, 2022) launches Vancouver (Canada)-based Quantum Gravity Institute and more” July 26, 2022 posting Note: This turned into one of my ‘in depth’ pieces where I comment on the ‘Canadian quantum scene’ and highlight the appointment of an expert panel for the Council of Canada Academies’ report on Quantum Technologies.
  • “Bank of Canada and Multiverse Computing model complex networks & cryptocurrencies with quantum computing” July 25, 2022 posting
  • “Canada, quantum technology, and a public relations campaign?” December 29, 2022 posting

This one was a bit of a puzzle with regard to placement in this end-of-year review, it’s quantum but it’s also about brainlike computing

It’s getting hot in here

Fusion energy made some news this year.

There’s a Vancouver area company, General Fusion, highlighted in both postings and the October posting includes an embedded video of Canadian-born rapper Baba Brinkman’s “You Must LENR” [L ow E nergy N uclear R eactions or sometimes L attice E nabled N anoscale R eactions or Cold Fusion or CANR (C hemically A ssisted N uclear R eactions)].

BTW, fusion energy can generate temperatures up to 150 million degrees Celsius.

Ukraine, science, war, and unintended consequences

Here’s what you might expect,

These are the unintended consequences (from Rachel Kyte’s, Dean of the Fletcher School, Tufts University, December 26, 2022 essay on The Conversation [h/t December 27, 2022 news item on phys.org]), Note: Links have been removed,

…

Russian President Vladimir Putin’s war on Ukraine has reverberated through Europe and spread to other countries that have long been dependent on the region for natural gas. But while oil-producing countries and gas lobbyists are arguing for more drilling, global energy investments reflect a quickening transition to cleaner energy. [emphasis mine]

Call it the Putin effect – Russia’s war is speeding up the global shift away from fossil fuels.

In December [2022?], the International Energy Agency [IEA] published two important reports that point to the future of renewable energy.

First, the IEA revised its projection of renewable energy growth upward by 30%. It now expects the world to install as much solar and wind power in the next five years as it installed in the past 50 years.

The second report showed that energy use is becoming more efficient globally, with efficiency increasing by about 2% per year. As energy analyst Kingsmill Bond at the energy research group RMI noted, the two reports together suggest that fossil fuel demand may have peaked. While some low-income countries have been eager for deals to tap their fossil fuel resources, the IEA warns that new fossil fuel production risks becoming stranded, or uneconomic, in the next 20 years.

…

Kyte’s essay is not all ‘sweetness and light’ but it does provide a little optimism.

Kudos, nanotechnology, culture (pop & otherwise), fun, and a farewell in 2022

This one was a surprise for me,

Sometimes I like to know where the money comes from and I was delighted to learn of the Ărramăt Project funded through the federal government’s New Frontiers in Research Fund (NFRF). Here’s more about the Ărramăt Project from the February 14, 2022 posting,

…

“The Ărramăt Project is about respecting the inherent dignity and interconnectedness of peoples and Mother Earth, life and livelihood, identity and expression, biodiversity and sustainability, and stewardship and well-being. Arramăt is a word from the Tamasheq language spoken by the Tuareg people of the Sahel and Sahara regions which reflects this holistic worldview.” (Mariam Wallet Aboubakrine)

Over 150 Indigenous organizations, universities, and other partners will work together to highlight the complex problems of biodiversity loss and its implications for health and well-being. The project Team will take a broad approach and be inclusive of many different worldviews and methods for research (i.e., intersectionality, interdisciplinary, transdisciplinary). Activities will occur in 70 different kinds of ecosystems that are also spiritually, culturally, and economically important to Indigenous Peoples.

The project is led by Indigenous scholars and activists …

Kudos to the federal government and all those involved in the Salmon science camps, the Ărramăt Project, and other NFRF projects.

There are many other nanotechnology posts here but this appeals to my need for something lighter at this point,

  • “Say goodbye to crunchy (ice crystal-laden) in ice cream thanks to cellulose nanocrystals (CNC)” August 22, 2022 posting

The following posts tend to be culture-related, high and/or low but always with a science/nanotechnology edge,

Sadly, it looks like 2022 is the last year that Ada Lovelace Day is to be celebrated.

… this year’s Ada Lovelace Day is the final such event due to lack of financial backing. Suw Charman-Anderson told the BBC [British Broadcasting Corporation] the reason it was now coming to an end was:

You can read more about it here:

In the rearview mirror

A few things that didn’t fit under the previous heads but stood out for me this year. Science podcasts, which were a big feature in 2021, also proliferated in 2022. I think they might have peaked and now (in 2023) we’ll see what survives.

Nanotechnology, the main subject on this blog, continues to be investigated and increasingly integrated into products. You can search the ‘nanotechnology’ category here for posts of interest something I just tried. It surprises even me (I should know better) how broadly nanotechnology is researched and applied.

If you want a nice tidy list, Hamish Johnston in a December 29, 2022 posting on the Physics World Materials blog has this “Materials and nanotechnology: our favourite research in 2022,” Note: Links have been removed,

“Inherited nanobionics” makes its debut

The integration of nanomaterials with living organisms is a hot topic, which is why this research on “inherited nanobionics” is on our list. Ardemis Boghossian at EPFL [École polytechnique fédérale de Lausanne] in Switzerland and colleagues have shown that certain bacteria will take up single-walled carbon nanotubes (SWCNTs). What is more, when the bacteria cells split, the SWCNTs are distributed amongst the daughter cells. The team also found that bacteria containing SWCNTs produce a significantly more electricity when illuminated with light than do bacteria without nanotubes. As a result, the technique could be used to grow living solar cells, which as well as generating clean energy, also have a negative carbon footprint when it comes to manufacturing.

…

Getting to back to Canada, I’m finding Saskatchewan featured more prominently here. They do a good job of promoting their science, especially the folks at the Canadian Light Source (CLS), Canada’s synchrotron, in Saskatoon. Canadian live science outreach events seeming to be coming back (slowly). Cautious organizers (who have a few dollars to spare) are also enthusiastic about hybrid events which combine online and live outreach.

After what seems like a long pause, I’m stumbling across more international news, e.g. “Nigeria and its nanotechnology research” published December 19, 2022 and “China and nanotechnology” published September 6, 2022. I think there’s also an Iran piece here somewhere.

With that …

Making resolutions in the dark

Hopefully this year I will catch up with the Council of Canadian Academies (CCA) output and finally review a few of their 2021 reports such as Leaps and Boundaries; a report on artificial intelligence applied to science inquiry and, perhaps, Powering Discovery; a report on research funding and Natural Sciences and Engineering Research Council of Canada.

Given what appears to a renewed campaign to have germline editing (gene editing which affects all of your descendants) approved in Canada, I might even reach back to a late 2020 CCA report, Research to Reality; somatic gene and engineered cell therapies. it’s not the same as germline editing but gene editing exists on a continuum.

For anyone who wants to see the CCA reports for themselves they can be found here (both in progress and completed).

I’m also going to be paying more attention to how public relations and special interests influence what science is covered and how it’s covered. In doing this 2022 roundup, I noticed that I featured an overview of fusion energy not long before the breakthrough. Indirect influence on this blog?

My post was precipitated by an article by Alex Pasternak in Fast Company. I’m wondering what precipitated Alex Pasternack’s interest in fusion energy since his self-description on the Huffington Post website states this “… focus on the intersections of science, technology, media, politics, and culture. My writing about those and other topics—transportation, design, media, architecture, environment, psychology, art, music … .”

He might simply have received a press release that stimulated his imagination and/or been approached by a communications specialist or publicists with an idea. There’s a reason for why there are so many public relations/media relations jobs and agencies.

Que sera, sera (Whatever will be, will be)

I can confidently predict that 2023 has some surprises in store. I can also confidently predict that the European Union’s big research projects (1B Euros each in funding for the Graphene Flagship and Human Brain Project over a ten year period) will sunset in 2023, ten years after they were first announced in 2013. Unless, the powers that be extend the funding past 2023.

I expect the Canadian quantum community to provide more fodder for me in the form of a 2023 report on Quantum Technologies from the Council of Canadian academies, if nothing else otherwise.

I’ve already featured these 2023 science events but just in case you missed them,

  • 2023 Preview: Bill Nye the Science Guy’s live show and Marvel Avengers S.T.A.T.I.O.N. (Scientific Training And Tactical Intelligence Operative Network) coming to Vancouver (Canada) November 24, 2022 posting
  • September 2023: Auckland, Aotearoa New Zealand set to welcome women in STEM (science, technology, engineering, and mathematics) November 15, 2022 posting

Getting back to this blog, it may not seem like a new year during the first few weeks of 2023 as I have quite the stockpile of draft posts. At this point I have drafts that are dated from June 2022 and expect to be burning through them so as not to fall further behind but will be interspersing them, occasionally, with more current posts.

Most importantly: a big thank you to everyone who drops by and reads (and sometimes even comments) on my posts!!! it’s very much appreciated and on that note: I wish you all the best for 2023.

Classical music makes protein songs easier listening

Leave a reply

Caption: This audio is oxytocin receptor protein music using the Fantasy Impromptu guided algorithm. Credit: Chen et al. / Heliyon

A September 29, 2021 news item on ScienceDaily describes new research into music as a means of communicating science,

In recent years, scientists have created music based on the structure of proteins as a creative way to better popularize science to the general public, but the resulting songs haven’t always been pleasant to the ear. In a study appearing September 29 [2021] in the journal Heliyon, researchers use the style of existing music genres to guide the structure of protein song to make it more musical. Using the style of Frédéric Chopin’s Fantaisie-Impromptu and other classical pieces as a guide, the researchers succeeded in converting proteins into song with greater musicality.

…

Scientists (Peng Zhang, Postdoctoral Researcher in Computational Biology at The Rockefeller University, and Yuzong Chen, Professor of Pharmacy at National University of Singapore [NUS]) wrote a September 29, 2021 essay for The Conversation about their protein songs (Note: Links have been removed),

…

There are many surprising analogies between proteins, the basic building blocks of life, and musical notation. These analogies can be used not only to help advance research, but also to make the complexity of proteins accessible to the public.

We’re computational biologists who believe that hearing the sound of life at the molecular level could help inspire people to learn more about biology and the computational sciences. While creating music based on proteins isn’t new, different musical styles and composition algorithms had yet to be explored. So we led a team of high school students and other scholars to figure out how to create classical music from proteins.

The musical analogies of proteins

Proteins are structured like folded chains. These chains are composed of small units of 20 possible amino acids, each labeled by a letter of the alphabet.

A protein chain can be represented as a string of these alphabetic letters, very much like a string of music notes in alphabetical notation.

Protein chains can also fold into wavy and curved patterns with ups, downs, turns and loops. Likewise, music consists of sound waves of higher and lower pitches, with changing tempos and repeating motifs.

Protein-to-music algorithms can thus map the structural and physiochemical features of a string of amino acids onto the musical features of a string of notes.

Enhancing the musicality of protein mapping

Protein-to-music mapping can be fine-tuned by basing it on the features of a specific music style. This enhances musicality, or the melodiousness of the song, when converting amino acid properties, such as sequence patterns and variations, into analogous musical properties, like pitch, note lengths and chords.

For our study, we specifically selected 19th-century Romantic period classical piano music, which includes composers like Chopin and Schubert, as a guide because it typically spans a wide range of notes with more complex features such as chromaticism, like playing both white and black keys on a piano in order of pitch, and chords. Music from this period also tends to have lighter and more graceful and emotive melodies. Songs are usually homophonic, meaning they follow a central melody with accompaniment. These features allowed us to test out a greater range of notes in our protein-to-music mapping algorithm. In this case, we chose to analyze features of Chopin’s “Fantaisie-Impromptu” to guide our development of the program.

If you have the time, I recommend reading the essay in its entirety and listening to the embedded audio files.

The September 29, 2021 Cell Press news release on EurekAlert repeats some of the same material but is worth reading on its own merits,

In recent years, scientists have created music based on the structure of proteins as a creative way to better popularize science to the general public, but the resulting songs haven’t always been pleasant to the ear. In a study appearing September 29 [2021] in the journal Heliyon, researchers use the style of existing music genres to guide the structure of protein song to make it more musical. Using the style of Frédéric Chopin’s Fantaisie-Impromptu and other classical pieces as a guide, the researchers succeeded in converting proteins into song with greater musicality.

Creating unique melodies from proteins is achieved by using a protein-to-music algorithm. This algorithm incorporates specific elements of proteins—like the size and position of amino acids—and maps them to various musical elements to create an auditory “blueprint” of the proteins’ structure.

“Existing protein music has mostly been designed by simple mapping of certain amino acid patterns to fundamental musical features such as pitches and note lengths, but they do not map well to more complex musical features such as rhythm and harmony,” says senior author Yu Zong Chen, a professor in the Department of Pharmacy at National University of Singapore. “By focusing on a music style, we can guide more complex mappings of combinations of amino acid patterns with various musical features.”

For their experiment, researchers analyzed the pitch, length, octaves, chords, dynamics, and main theme of four pieces from the mid-1800s Romantic era of classical music. These pieces, including Fantasie-Impromptu from Chopin and Wanderer Fantasy from Franz Schubert, were selected to represent the notable Fantasy-Impromptu genre that emerged during that time.

“We chose the specific music style of a Fantasy-Impromptu as it is characterized by freedom of expression, which we felt would complement how proteins regulate much of our bodily functions, including our moods,” says co-author Peng Zhang (@zhangpeng1202), a post-doctoral fellow at the Rockefeller University

Likewise, several of the proteins in the study were chosen for their similarities to the key attributes of the Fantasy-Impromptu style. Most of the 18 proteins tested regulate functions including human emotion, cognition, sensation, or performance which the authors say connect to the emotional and expressive of the genre.

Then, they mapped 104 structural, physicochemical, and binding amino acid properties of those proteins to the six musical features. “We screened the quantitative profile of each amino acid property against the quantized values of the different musical features to find the optimal mapped pairings. For example, we mapped the size of amino acid to note length, so that having a larger amino acid size corresponds to a shorter note length,” says Chen.

Across all the proteins tested, the researchers found that the musicality of the proteins was significantly improved. In particular, the protein receptor for oxytocin (OXTR) was judged to have one of the greatest increases in musicality when using the genre-guided algorithm, compared to an earlier version of the protein-to-music algorithm.

“The oxytocin receptor protein generated our favorite song,” says Zhang. “This protein sequence produced an identifiable main theme that repeats in rhythm throughout the piece, as well as some interesting motifs and patterns that recur independent of our algorithm. There were also some pleasant harmonic progressions; for example, many of the seventh chords naturally resolve.”

The authors do note, however, that while the guided algorithm increased the overall musicality of the protein songs, there is still much progress to be made before it resembles true human music.

“We believe a next step is to explore more music styles and more complex combinations of amino acid properties for enhanced musicality and novel music pieces. Another next step, a very important step, is to apply artificial intelligence to jointly learn complex amino acid properties and their combinations with respect to the features of various music styles for creating protein music of enhanced musicality,” says Chen.

###

Research supported by the National Key R&D Program of China, the National Natural Science Foundation of China, and Singapore Academic Funds.

Here’s a link to and a citation for the paper,

Protein Music of Enhanced Musicality by Music Style Guided Exploration of Diverse Amino Acid Properties by Nicole WanNi Tay, Fanxi Liu, Chaoxin Wang, Hui Zhang, Peng Zhang, Yu Zong Chen. Heliyon, 2021 DOI: https:// doi.org/10.1016/j.heliyon.2021.e07933 Published; September 29, 2021

This paper appears to be open access.

Tree music

Leave a reply

Hidden Life Radio livestreams music generated from trees (their biodata, that is). Kristin Toussaint in her August 3, 2021 article for Fast Company describes the ‘radio station’, Note: Links have been removed,

Outside of a library in Cambridge, Massachusetts, an over-80-year-old copper beech tree is making music.

As the tree photosynthesizes and absorbs and evaporates water, a solar-powered sensor attached to a leaf measures the micro voltage of all that invisible activity. Sound designer and musician Skooby Laposky assigned a key and note range to those changes in this electric activity, turning the tree’s everyday biological processes into an ethereal song.

That music is available on Hidden Life Radio, an art project by Laposky, with assistance from the Cambridge Department of Public Works Urban Forestry, and funded in part by a grant from the Cambridge Arts Council. Hidden Life Radio also features the musical sounds of two other Cambridge trees: a honey locust and a red oak, both located outside of other Cambridge library branches. The sensors on these trees are solar-powered biodata sonification kits, a technology that has allowed people to turn all sorts of plant activity into music.

…

… Laposky has created a musical voice for these disappearing trees, and he hopes people tune into Hidden Life Radio and spend time listening to them over time. The music they produce occurs in real time, affected by the weather and whatever the tree is currently doing. Some days they might be silent, especially when there’s been several days without rain, and they’re dehydrated; Laposky is working on adding an archive that includes weather information, so people can go back and hear what the trees sound like on different days, under different conditions. The radio will play 24 hours a day until November, when the leaves will drop—a “natural cycle for the project to end,” Laposky says, “when there aren’t any leaves to connect to anymore.”

The 2021 season is over but you can find an archive of Hidden Life Radio livestreams here. Or, if you happen to be reading this page sometime after January 2022, you can try your luck and click here at Hidden Life Radio livestreams but remember, even if the project has started up again, the tree may not be making music when you check in. So, if you don’t hear anything the first time, try again.

Want to create your own biodata sonification project?

Toussaint’s article sent me on a search for more and I found a website where you can get biodata sonification kits. Sam Cusumano’s electricity for progress website offers lessons, as well as, kits and more.

Sophie Haigney’s February 21, 2020 article for NPR ([US] National Public Radio) highlights other plant music and more ways to tune in to and create it. (h/t Kristin Toussaint)