Tag Archives: University of Technology Sydney (UTS)

Portable and non-invasive (?) mind-reading AI (artificial intelligence) turns thoughts into text and some thoughts about the near future

First, here’s some of the latest research and if by ‘non-invasive,’ you mean that electrodes are not being planted in your brain, then this December 12, 2023 University of Technology Sydney (UTS) press release (also on EurekAlert) highlights non-invasive mind-reading AI via a brain-computer interface (BCI), Note: Links have been removed,

In a world-first, researchers from the GrapheneX-UTS Human-centric Artificial Intelligence Centre at the University of Technology Sydney (UTS) have developed a portable, non-invasive system that can decode silent thoughts and turn them into text. 

The technology could aid communication for people who are unable to speak due to illness or injury, including stroke or paralysis. It could also enable seamless communication between humans and machines, such as the operation of a bionic arm or robot.

The study has been selected as the spotlight paper at the NeurIPS conference, a top-tier annual meeting that showcases world-leading research on artificial intelligence and machine learning, held in New Orleans on 12 December 2023.

The research was led by Distinguished Professor CT Lin, Director of the GrapheneX-UTS HAI Centre, together with first author Yiqun Duan and fellow PhD candidate Jinzhou Zhou from the UTS Faculty of Engineering and IT.

In the study participants silently read passages of text while wearing a cap that recorded electrical brain activity through their scalp using an electroencephalogram (EEG). A demonstration of the technology can be seen in this video [See UTS press release].

The EEG wave is segmented into distinct units that capture specific characteristics and patterns from the human brain. This is done by an AI model called DeWave developed by the researchers. DeWave translates EEG signals into words and sentences by learning from large quantities of EEG data. 

“This research represents a pioneering effort in translating raw EEG waves directly into language, marking a significant breakthrough in the field,” said Distinguished Professor Lin.

“It is the first to incorporate discrete encoding techniques in the brain-to-text translation process, introducing an innovative approach to neural decoding. The integration with large language models is also opening new frontiers in neuroscience and AI,” he said.

Previous technology to translate brain signals to language has either required surgery to implant electrodes in the brain, such as Elon Musk’s Neuralink [emphasis mine], or scanning in an MRI machine, which is large, expensive, and difficult to use in daily life.

These methods also struggle to transform brain signals into word level segments without additional aids such as eye-tracking, which restrict the practical application of these systems. The new technology is able to be used either with or without eye-tracking.

The UTS research was carried out with 29 participants. This means it is likely to be more robust and adaptable than previous decoding technology that has only been tested on one or two individuals, because EEG waves differ between individuals. 

The use of EEG signals received through a cap, rather than from electrodes implanted in the brain, means that the signal is noisier. In terms of EEG translation however, the study reported state-of the art performance, surpassing previous benchmarks.

“The model is more adept at matching verbs than nouns. However, when it comes to nouns, we saw a tendency towards synonymous pairs rather than precise translations, such as ‘the man’ instead of ‘the author’,” said Duan. [emphases mine; synonymous, eh? what about ‘woman’ or ‘child’ instead of the ‘man’?]

“We think this is because when the brain processes these words, semantically similar words might produce similar brain wave patterns. Despite the challenges, our model yields meaningful results, aligning keywords and forming similar sentence structures,” he said.

The translation accuracy score is currently around 40% on BLEU-1. The BLEU score is a number between zero and one that measures the similarity of the machine-translated text to a set of high-quality reference translations. The researchers hope to see this improve to a level that is comparable to traditional language translation or speech recognition programs, which is closer to 90%.

The research follows on from previous brain-computer interface technology developed by UTS in association with the Australian Defence Force [ADF] that uses brainwaves to command a quadruped robot, which is demonstrated in this ADF video [See my June 13, 2023 posting, “Mind-controlled robots based on graphene: an Australian research story” for the story and embedded video].

About one month after the research announcement regarding the University of Technology Sydney’s ‘non-invasive’ brain-computer interface (BCI), I stumbled across an in-depth piece about the field of ‘non-invasive’ mind-reading research.

Neurotechnology and neurorights

Fletcher Reveley’s January 18, 2024 article on salon.com (originally published January 3, 2024 on Undark) shows how quickly the field is developing and raises concerns, Note: Links have been removed,

One afternoon in May 2020, Jerry Tang, a Ph.D. student in computer science at the University of Texas at Austin, sat staring at a cryptic string of words scrawled across his computer screen:

“I am not finished yet to start my career at twenty without having gotten my license I never have to pull out and run back to my parents to take me home.”

The sentence was jumbled and agrammatical. But to Tang, it represented a remarkable feat: A computer pulling a thought, however disjointed, from a person’s mind.

For weeks, ever since the pandemic had shuttered his university and forced his lab work online, Tang had been at home tweaking a semantic decoder — a brain-computer interface, or BCI, that generates text from brain scans. Prior to the university’s closure, study participants had been providing data to train the decoder for months, listening to hours of storytelling podcasts while a functional magnetic resonance imaging (fMRI) machine logged their brain responses. Then, the participants had listened to a new story — one that had not been used to train the algorithm — and those fMRI scans were fed into the decoder, which used GPT1, a predecessor to the ubiquitous AI chatbot ChatGPT, to spit out a text prediction of what it thought the participant had heard. For this snippet, Tang compared it to the original story:

“Although I’m twenty-three years old I don’t have my driver’s license yet and I just jumped out right when I needed to and she says well why don’t you come back to my house and I’ll give you a ride.”

The decoder was not only capturing the gist of the original, but also producing exact matches of specific words — twenty, license. When Tang shared the results with his adviser, a UT Austin neuroscientist named Alexander Huth who had been working towards building such a decoder for nearly a decade, Huth was floored. “Holy shit,” Huth recalled saying. “This is actually working.” By the fall of 2021, the scientists were testing the device with no external stimuli at all — participants simply imagined a story and the decoder spat out a recognizable, albeit somewhat hazy, description of it. “What both of those experiments kind of point to,” said Huth, “is the fact that what we’re able to read out here was really like the thoughts, like the idea.”

The scientists brimmed with excitement over the potentially life-altering medical applications of such a device — restoring communication to people with locked-in syndrome, for instance, whose near full-body paralysis made talking impossible. But just as the potential benefits of the decoder snapped into focus, so too did the thorny ethical questions posed by its use. Huth himself had been one of the three primary test subjects in the experiments, and the privacy implications of the device now seemed visceral: “Oh my god,” he recalled thinking. “We can look inside my brain.”

Huth’s reaction mirrored a longstanding concern in neuroscience and beyond: that machines might someday read people’s minds. And as BCI technology advances at a dizzying clip, that possibility and others like it — that computers of the future could alter human identities, for example, or hinder free will — have begun to seem less remote. “The loss of mental privacy, this is a fight we have to fight today,” said Rafael Yuste, a Columbia University neuroscientist. “That could be irreversible. If we lose our mental privacy, what else is there to lose? That’s it, we lose the essence of who we are.”

Spurred by these concerns, Yuste and several colleagues have launched an international movement advocating for “neurorights” — a set of five principles Yuste argues should be enshrined in law as a bulwark against potential misuse and abuse of neurotechnology. But he may be running out of time.

Reveley’s January 18, 2024 article provides fascinating context and is well worth reading if you have the time.

For my purposes, I’m focusing on ethics, Note: Links have been removed,

… as these and other advances propelled the field forward, and as his own research revealed the discomfiting vulnerability of the brain to external manipulation, Yuste found himself increasingly concerned by the scarce attention being paid to the ethics of these technologies. Even Obama’s multi-billion-dollar BRAIN Initiative, a government program designed to advance brain research, which Yuste had helped launch in 2013 and supported heartily, seemed to mostly ignore the ethical and societal consequences of the research it funded. “There was zero effort on the ethical side,” Yuste recalled.

Yuste was appointed to the rotating advisory group of the BRAIN Initiative in 2015, where he began to voice his concerns. That fall, he joined an informal working group to consider the issue. “We started to meet, and it became very evident to me that the situation was a complete disaster,” Yuste said. “There was no guidelines, no work done.” Yuste said he tried to get the group to generate a set of ethical guidelines for novel BCI technologies, but the effort soon became bogged down in bureaucracy. Frustrated, he stepped down from the committee and, together with a University of Washington bioethicist named Sara Goering, decided to independently pursue the issue. “Our aim here is not to contribute to or feed fear for doomsday scenarios,” the pair wrote in a 2016 article in Cell, “but to ensure that we are reflective and intentional as we prepare ourselves for the neurotechnological future.”

In the fall of 2017, Yuste and Goering called a meeting at the Morningside Campus of Columbia, inviting nearly 30 experts from all over the world in such fields as neurotechnology, artificial intelligence, medical ethics, and the law. By then, several other countries had launched their own versions of the BRAIN Initiative, and representatives from Australia, Canada [emphasis mine], China, Europe, Israel, South Korea, and Japan joined the Morningside gathering, along with veteran neuroethicists and prominent researchers. “We holed ourselves up for three days to study the ethical and societal consequences of neurotechnology,” Yuste said. “And we came to the conclusion that this is a human rights issue. These methods are going to be so powerful, that enable to access and manipulate mental activity, and they have to be regulated from the angle of human rights. That’s when we coined the term ‘neurorights.’”

The Morningside group, as it became known, identified four principal ethical priorities, which were later expanded by Yuste into five clearly defined neurorights: The right to mental privacy, which would ensure that brain data would be kept private and its use, sale, and commercial transfer would be strictly regulated; the right to personal identity, which would set boundaries on technologies that could disrupt one’s sense of self; the right to fair access to mental augmentation, which would ensure equality of access to mental enhancement neurotechnologies; the right of protection from bias in the development of neurotechnology algorithms; and the right to free will, which would protect an individual’s agency from manipulation by external neurotechnologies. The group published their findings in an often-cited paper in Nature.

But while Yuste and the others were focused on the ethical implications of these emerging technologies, the technologies themselves continued to barrel ahead at a feverish speed. In 2014, the first kick of the World Cup was made by a paraplegic man using a mind-controlled robotic exoskeleton. In 2016, a man fist bumped Obama using a robotic arm that allowed him to “feel” the gesture. The following year, scientists showed that electrical stimulation of the hippocampus could improve memory, paving the way for cognitive augmentation technologies. The military, long interested in BCI technologies, built a system that allowed operators to pilot three drones simultaneously, partially with their minds. Meanwhile, a confusing maelstrom of science, science-fiction, hype, innovation, and speculation swept the private sector. By 2020, over $33 billion had been invested in hundreds of neurotech companies — about seven times what the NIH [US National Institutes of Health] had envisioned for the 12-year span of the BRAIN Initiative itself.

Now back to Tang and Huth (from Reveley’s January 18, 2024 article), Note: Links have been removed,

Central to the ethical questions Huth and Tang grappled with was the fact that their decoder, unlike other language decoders developed around the same time, was non-invasive — it didn’t require its users to undergo surgery. Because of that, their technology was free from the strict regulatory oversight that governs the medical domain. (Yuste, for his part, said he believes non-invasive BCIs pose a far greater ethical challenge than invasive systems: “The non-invasive, the commercial, that’s where the battle is going to get fought.”) Huth and Tang’s decoder faced other hurdles to widespread use — namely that fMRI machines are enormous, expensive, and stationary. But perhaps, the researchers thought, there was a way to overcome that hurdle too.

The information measured by fMRI machines — blood oxygenation levels, which indicate where blood is flowing in the brain — can also be measured with another technology, functional Near-Infrared Spectroscopy, or fNIRS. Although lower resolution than fMRI, several expensive, research-grade, wearable fNIRS headsets do approach the resolution required to work with Huth and Tang’s decoder. In fact, the scientists were able to test whether their decoder would work with such devices by simply blurring their fMRI data to simulate the resolution of research-grade fNIRS. The decoded result “doesn’t get that much worse,” Huth said.

And while such research-grade devices are currently cost-prohibitive for the average consumer, more rudimentary fNIRS headsets have already hit the market. Although these devices provide far lower resolution than would be required for Huth and Tang’s decoder to work effectively, the technology is continually improving, and Huth believes it is likely that an affordable, wearable fNIRS device will someday provide high enough resolution to be used with the decoder. In fact, he is currently teaming up with scientists at Washington University to research the development of such a device.

Even comparatively primitive BCI headsets can raise pointed ethical questions when released to the public. Devices that rely on electroencephalography, or EEG, a commonplace method of measuring brain activity by detecting electrical signals, have now become widely available — and in some cases have raised alarm. In 2019, a school in Jinhua, China, drew criticism after trialing EEG headbands that monitored the concentration levels of its pupils. (The students were encouraged to compete to see who concentrated most effectively, and reports were sent to their parents.) Similarly, in 2018 the South China Morning Post reported that dozens of factories and businesses had begun using “brain surveillance devices” to monitor workers’ emotions, in the hopes of increasing productivity and improving safety. The devices “caused some discomfort and resistance in the beginning,” Jin Jia, then a brain scientist at Ningbo University, told the reporter. “After a while, they got used to the device.”

But the primary problem with even low-resolution devices is that scientists are only just beginning to understand how information is actually encoded in brain data. In the future, powerful new decoding algorithms could discover that even raw, low-resolution EEG data contains a wealth of information about a person’s mental state at the time of collection. Consequently, nobody can definitively know what they are giving away when they allow companies to collect information from their brains.

Huth and Tang concluded that brain data, therefore, should be closely guarded, especially in the realm of consumer products. In an article on Medium from last April, Tang wrote that “decoding technology is continually improving, and the information that could be decoded from a brain scan a year from now may be very different from what can be decoded today. It is crucial that companies are transparent about what they intend to do with brain data and take measures to ensure that brain data is carefully protected.” (Yuste said the Neurorights Foundation recently surveyed the user agreements of 30 neurotech companies and found that all of them claim ownership of users’ brain data — and most assert the right to sell that data to third parties. [emphases mine]) Despite these concerns, however, Huth and Tang maintained that the potential benefits of these technologies outweighed their risks, provided the proper guardrails [emphasis mine] were put in place.

It would seem the first guardrails are being set up in South America (from Reveley’s January 18, 2024 article), Note: Links have been removed,

On a hot summer night in 2019, Yuste sat in the courtyard of an adobe hotel in the north of Chile with his close friend, the prominent Chilean doctor and then-senator Guido Girardi, observing the vast, luminous skies of the Atacama Desert and discussing, as they often did, the world of tomorrow. Girardi, who every year organizes the Congreso Futuro, Latin America’s preeminent science and technology event, had long been intrigued by the accelerating advance of technology and its paradigm-shifting impact on society — “living in the world at the speed of light,” as he called it. Yuste had been a frequent speaker at the conference, and the two men shared a conviction that scientists were birthing technologies powerful enough to disrupt the very notion of what it meant to be human.

Around midnight, as Yuste finished his pisco sour, Girardi made an intriguing proposal: What if they worked together to pass an amendment to Chile’s constitution, one that would enshrine protections for mental privacy as an inviolable right of every Chilean? It was an ambitious idea, but Girardi had experience moving bold pieces of legislation through the senate; years earlier he had spearheaded Chile’s famous Food Labeling and Advertising Law, which required companies to affix health warning labels on junk food. (The law has since inspired dozens of countries to pursue similar legislation.) With BCI, here was another chance to be a trailblazer. “I said to Rafael, ‘Well, why don’t we create the first neuro data protection law?’” Girardi recalled. Yuste readily agreed.

… Girardi led the political push, promoting a piece of legislation that would amend Chile’s constitution to protect mental privacy. The effort found surprising purchase across the political spectrum, a remarkable feat in a country famous for its political polarization. In 2021, Chile’s congress unanimously passed the constitutional amendment, which Piñera [Sebastián Piñera] swiftly signed into law. (A second piece of legislation, which would establish a regulatory framework for neurotechnology, is currently under consideration by Chile’s congress.) “There was no divide between the left or right,” recalled Girardi. “This was maybe the only law in Chile that was approved by unanimous vote.” Chile, then, had become the first country in the world to enshrine “neurorights” in its legal code.

Even before the passage of the Chilean constitutional amendment, Yuste had begun meeting regularly with Jared Genser, an international human rights lawyer who had represented such high-profile clients as Desmond Tutu, Liu Xiaobo, and Aung San Suu Kyi. (The New York Times Magazine once referred to Genser as “the extractor” for his work with political prisoners.) Yuste was seeking guidance on how to develop an international legal framework to protect neurorights, and Genser, though he had just a cursory knowledge of neurotechnology, was immediately captivated by the topic. “It’s fair to say he blew my mind in the first hour of discussion,” recalled Genser. Soon thereafter, Yuste, Genser, and a private-sector entrepreneur named Jamie Daves launched the Neurorights Foundation, a nonprofit whose first goal, according to its website, is “to protect the human rights of all people from the potential misuse or abuse of neurotechnology.”

To accomplish this, the organization has sought to engage all levels of society, from the United Nations and regional governing bodies like the Organization of American States, down to national governments, the tech industry, scientists, and the public at large. Such a wide-ranging approach, said Genser, “is perhaps insanity on our part, or grandiosity. But nonetheless, you know, it’s definitely the Wild West as it comes to talking about these issues globally, because so few people know about where things are, where they’re heading, and what is necessary.”

This general lack of knowledge about neurotech, in all strata of society, has largely placed Yuste in the role of global educator — he has met several times with U.N. Secretary-General António Guterres, for example, to discuss the potential dangers of emerging neurotech. And these efforts are starting to yield results. Guterres’s 2021 report, “Our Common Agenda,” which sets forth goals for future international cooperation, urges “updating or clarifying our application of human rights frameworks and standards to address frontier issues,” such as “neuro-technology.” Genser attributes the inclusion of this language in the report to Yuste’s advocacy efforts.

But updating international human rights law is difficult, and even within the Neurorights Foundation there are differences of opinion regarding the most effective approach. For Yuste, the ideal solution would be the creation of a new international agency, akin to the International Atomic Energy Agency — but for neurorights. “My dream would be to have an international convention about neurotechnology, just like we had one about atomic energy and about certain things, with its own treaty,” he said. “And maybe an agency that would essentially supervise the world’s efforts in neurotechnology.”

Genser, however, believes that a new treaty is unnecessary, and that neurorights can be codified most effectively by extending interpretation of existing international human rights law to include them. The International Covenant of Civil and Political Rights, for example, already ensures the general right to privacy, and an updated interpretation of the law could conceivably clarify that that clause extends to mental privacy as well.

There is no need for immediate panic (from Reveley’s January 18, 2024 article),

… while Yuste and the others continue to grapple with the complexities of international and national law, Huth and Tang have found that, for their decoder at least, the greatest privacy guardrails come not from external institutions but rather from something much closer to home — the human mind itself. Following the initial success of their decoder, as the pair read widely about the ethical implications of such a technology, they began to think of ways to assess the boundaries of the decoder’s capabilities. “We wanted to test a couple kind of principles of mental privacy,” said Huth. Simply put, they wanted to know if the decoder could be resisted.

In late 2021, the scientists began to run new experiments. First, they were curious if an algorithm trained on one person could be used on another. They found that it could not — the decoder’s efficacy depended on many hours of individualized training. Next, they tested whether the decoder could be thrown off simply by refusing to cooperate with it. Instead of focusing on the story that was playing through their headphones while inside the fMRI machine, participants were asked to complete other mental tasks, such as naming random animals, or telling a different story in their head. “Both of those rendered it completely unusable,” Huth said. “We didn’t decode the story they were listening to, and we couldn’t decode anything about what they were thinking either.”

Given how quickly this field of research is progressing, it seems like a good idea to increase efforts to establish neurorights (from Reveley’s January 18, 2024 article),

For Yuste, however, technologies like Huth and Tang’s decoder may only mark the beginning of a mind-boggling new chapter in human history, one in which the line between human brains and computers will be radically redrawn — or erased completely. A future is conceivable, he said, where humans and computers fuse permanently, leading to the emergence of technologically augmented cyborgs. “When this tsunami hits us I would say it’s not likely it’s for sure that humans will end up transforming themselves — ourselves — into maybe a hybrid species,” Yuste said. He is now focused on preparing for this future.

In the last several years, Yuste has traveled to multiple countries, meeting with a wide assortment of politicians, supreme court justices, U.N. committee members, and heads of state. And his advocacy is beginning to yield results. In August, Mexico began considering a constitutional reform that would establish the right to mental privacy. Brazil is currently considering a similar proposal, while Spain, Argentina, and Uruguay have also expressed interest, as has the European Union. In September [2023], neurorights were officially incorporated into Mexico’s digital rights charter, while in Chile, a landmark Supreme Court ruling found that Emotiv Inc, a company that makes a wearable EEG headset, violated Chile’s newly minted mental privacy law. That suit was brought by Yuste’s friend and collaborator, Guido Girardi.

“This is something that we should take seriously,” he [Huth] said. “Because even if it’s rudimentary right now, where is that going to be in five years? What was possible five years ago? What’s possible now? Where’s it gonna be in five years? Where’s it gonna be in 10 years? I think the range of reasonable possibilities includes things that are — I don’t want to say like scary enough — but like dystopian enough that I think it’s certainly a time for us to think about this.”

You can find The Neurorights Foundation here and/or read Reveley’s January 18, 2024 article on salon.com or as originally published January 3, 2024 on Undark. Finally, thank you for the article, Fletcher Reveley!

Consciousness, energy, and matter

Credit: Rice University [downloaded from https://phys.org/news/2023-10-energy-consciousness-physics-thorny-topic.html]

There’s an intriguing approach tying together ideas about consciousness, artificial intelligence, and physics in an October 8, 2023 news item on phys.org,

With the rise of brain-interface technology and artificial intelligence that can imitate brain functions, understanding the nature of consciousness and how it interacts with reality is not just an age-old philosophical question but also a salient challenge for humanity.

An October 9, 2023 University of Technology Sydney (UTS) press release (also on EurekAlert but published on October 8, 2023), which originated the news item, delves further into the subject matter, Note: Links have been removed,

Can AI become conscious, and how would we know? Should we incorporate human or animal cells, such as neurons, into machines and robots? Would they be conscious and have subjective experiences? Does consciousness reduce to physicalism, or is it fundamental? And if machine-brain interaction influenced you to commit a crime, or caused a crime, would you be responsible beyond a reasonable doubt? Do we have a free will?

AI and computer science specialist Dr Mahendra Samarawickrama, winner of the Australian Computer Society’s Information and Communications Technology (ICT) Professional of the year, has applied his knowledge of physics and artificial neural networks to this thorny topic.

He presented a peer-reviewed paper on fundamental physics and consciousness at the 11th International Conference on Mathematical Modelling in Physical Sciences, Unifying Matter, Energy and Consciousness, which has just been published in the AIP (the American Institute of Physics) Conference Proceedings. 

“Consciousness is an evolving topic connected to physics, engineering, neuroscience and many other fields. Understanding the interplay between consciousness, energy and matter could bring important insights to our fundamental understanding of reality,” said Dr Samarawickrama.

“Einstein’s dream of a unified theory is a quest that occupies the minds of many theoretical physicists and engineers. Some solutions completely change existing frameworks, which increases complexity and creates more problems than it solves.

“My theory brings the notion of consciousness to fundamental physics such that it complements the current physics models and explains the time, causality, and interplay of consciousness, energy and matter.

“I propose that consciousness is a high-speed sequential flow of awareness subjected to relativity. The quantised energy of consciousness can interplay with matter creating reality while adhering to laws of physics, including quantum physics and relativity.

“Awareness can be seen in life, AI and even physical realities like entangled particles. Studying consciousness helps us be aware of and differentiate realities that exist in nature,” he said. 

Dr Samarawickrama is an honorary Visiting Scholar in the School of Computer Science at the University of Technology Sydney, where he has contributed to UTS research on data science and AI, focusing on social impact.

“Research in this field could pave the way towards the development of conscious AI, with robots that are aware and have the ability to think becoming a reality. We want to ensure that artificial intelligence is ethical and responsible in emerging solutions,” Dr Samarawickrama said.

Here’s a link to and a citation for the paper Samarawickrama presented at the 11th International Conference on Mathematical Modelling in Physical Sciences, Unifying Matter, Energy and Consciousness,

Unifying matter, energy and consciousness by Mahendra Samarawickrama. AIP Conf. Proc. Volume 2872, Issue 1, 28 September 2023, 110001 (2023) DOI: https://doi.org/10.1063/5.0162815

This paper is open access.

The researcher has made a video of his presentation and further information available,

It’s a little bit over my head but hopefully repeated viewings and readings will help me better understand Dr. Samarawickrama’s work.

Mind-controlled robots based on graphene: an Australian research story

As they keep saying these days, ‘it’s not science fiction anymore’.

It’s so fascinating I almost forgot what it’s like to make a video where it can take hours to get a few minutes (the video is a little over 3 mins.) and all the failures are edited out. Plus, I haven’t found any information about training both the human users and the robotic dogs/quadrupeds. Does it take minutes? hours? days? more? Can you work with any old robotic dog /quadruped or does it have to be the one you’ve ‘gotten to know’? Etc. Bottom line: I don’t know if I can take what I see in the video at face value.

A March 20, 2023 news item on Nanowerk announces the work from Australia,

The advanced brain-computer interface [BCI] was developed by Distinguished Professor Chin-Teng Lin and Professor Francesca Iacopi, from the UTS [University of Technology Sydney; Australia] Faculty of Engineering and IT, in collaboration with the Australian Army and Defence Innovation Hub.

As well as defence applications, the technology has significant potential in fields such as advanced manufacturing, aerospace and healthcare – for example allowing people with a disability to control a wheelchair or operate prosthetics.

“The hands-free, voice-free technology works outside laboratory settings, anytime, anywhere. It makes interfaces such as consoles, keyboards, touchscreens and hand-gesture recognition redundant,” said Professor Iacopi.

A March 20, 2023 University of Technology Sydney (UTS) press release, also on EurekAlert but published March 19, 2023, which originated the news item, describes the interface in more detail,

“By using cutting edge graphene material, combined with silicon, we were able to overcome issues of corrosion, durability and skin contact resistance, to develop the wearable dry sensors,” she said.

A new study outlining the technology has just been published in the peer-reviewed journal ACS Applied Nano Materials. It shows that the graphene sensors developed at UTS are very conductive, easy to use and robust.

The hexagon patterned sensors are positioned over the back of the scalp, to detect brainwaves from the visual cortex. The sensors are resilient to harsh conditions so they can be used in extreme operating environments.

The user wears a head-mounted augmented reality lens which displays white flickering squares. By concentrating on a particular square, the brainwaves of the operator are picked up by the biosensor, and a decoder translates the signal into commands.

The technology was recently demonstrated by the Australian Army, where soldiers operated a Ghost Robotics quadruped robot using the brain-machine interface [BMI]. The device allowed hands-free command of the robotic dog with up to 94% accuracy.

“Our technology can issue at least nine commands in two seconds. This means we have nine different kinds of commands and the operator can select one from those nine within that time period,” Professor Lin said.

“We have also explored how to minimise noise from the body and environment to get a clearer signal from an operator’s brain,” he said.

The researchers believe the technology will be of interest to the scientific community, industry and government, and hope to continue making advances in brain-computer interface systems.

Here’s a link to and a citation for the paper,

Noninvasive Sensors for Brain–Machine Interfaces Based on Micropatterned Epitaxial Graphene by Shaikh Nayeem Faisal, Tien-Thong Nguyen Do, Tasauf Torzo, Daniel Leong, Aiswarya Pradeepkumar, Chin-Teng Lin, and Francesca Iacopi. ACS Appl. Nano Mater. 2023, 6, 7, 5440–5447 DOI: https://doi.org/10.1021/acsanm.2c05546 Publication Date: March 16, 2023 Copyright © 2023 The Authors. Published by American Chemical Society

This paper is open access.

Comments

For anyone who’s bothered by this, the terminology is fluid. Sometimes you’ll see brain-computer interface (BCI), sometimes you’ll see human-computer interface, or brain-machine interface (BMI) and, as I’ve now found in the video although I notice the Australians are not hyphenating it, brain-robotic interface (BRI).

You can find Ghost Robotics here, the makers of the robotic ‘dog’.

There seems to be a movement to replace the word ‘soldiers’ with warfighters and, according to this video, military practitioners. I wonder how medical doctors and other practitioners feel about the use of ‘practitioners’ in a military context.

Sticky tape, hackers, and quantum communications

I always appreciate a low technology solution to a problem. In this case, it’s a piece of sticky tape which halts compute hackers in their tracks. Here’s more from an August 30, 2021 University of Technology Sydney press release (also on EurekAlert but published August 26, 2021), Note: Links have been removed,

Researchers from the University of Technology Sydney (UTS) and TMOS, an Australian Research Council Centre of Excellence [specifically, the Australian Research Council Centre of Excellence for Transformative Meta-Optical Systems (TMOS)], have taken the fight to online hackers with a giant leap towards realizing affordable, accessible quantum communications, a technology that would effectively prevent the decryption of online activity. Everything from private social media messaging to banking could become more secure due to new technology created with a humble piece of adhesive tape.

Quantum communication is still in its early development and is currently feasible only in very limited fields due to the costs associated with fabricating the required devices. The TMOS researches have developed new technology that integrates quantum sources and waveguides on chip in a manner that is both affordable and scalable, paving the way for future everyday use.

The development of fully functional quantum communication technologies has previously been hampered by the lack of reliable quantum light sources that can encode and transmit the information.

In a paper published today in ACS Photonics, the team describes a new platform to generate these quantum emitters based on hexagonal boron nitride, also known as white graphene. Where current quantum emitters are created using complex methods in expensive clean rooms, these new quantum emitters can be created using $20 worth of white graphene pressed on to a piece of adhesive tape.

These 2D materials can be pressed onto a sticky surface such as the [sic] adhesive tape [emphasis mine] and exfoliated, which is essentially peeling off the top layer to create a flex. Multiple layers of this flex can then be assembled in a Lego-like style, offering a new bottom up approach as a substitute for 3D systems.

TMOS Chief Investigator Igor Aharonovich said: “2D materials, like hexagonal boron nitride, are emerging materials for integrated quantum photonics, and are poised to impact the way we design and engineer future optical components for secured communication.”

In addition to this evolution in photon sources, the team has developed a high efficiency on-chip waveguide, a vital component for on-chip optical processing.

Lead author Chi Li said: “Low signal levels have been a significant barrier preventing quantum communications from evolving into practical, workable models. We hope that with this new development, quantum comms will become an everyday technology that improves people’s lives in new and exciting ways.”

Here’s a link to and a citation for the paper,

Integration of hBN Quantum Emitters in Monolithically Fabricated Waveguides by Chi Li, Johannes E. Fröch, Milad Nonahal, Thinh N. Tran, Milos Toth, Sejeong Kim, and Igor Aharonovich. ACS Photonics 2021, XXXX, XXX, XXX-XXX DOI: https://doi.org/10.1021/acsphotonics.1c00890 Publication Date:August 20, 2021 © 2021 American Chemical Society

This paper is behind a paywall.

Sticky or adhesive tape is part of graphene lore and seems to exert a great fascination for scientists as I note in my June 12, 2018 posting.

Replacing nanotechnology-enabled oil spill solutions with dog fur?

Coincidentally or not, this research from Australia was announced a little more than a month after reports of a major oil spill in the Russian Arctic. A July 10, 2020 news item on phys.org announces a new technology for mopping up oil spills (Note: Links have been removed),

Oil spill disasters on land cause long-term damage for communities and the natural environment, polluting soils and sediments and contaminating groundwater.

Current methods using synthetic sorbent materials can be effective for cleaning up oil spills, but these materials are often expensive and generate large volumes of non-biodegradable plastic wastes. Now the first comparison of natural-origin sorbent materials for land-based oil spills, including peat moss, recycled human hair, and dog fur, shows that sustainable, cheaper and biodegradable options can be developed.

The University of Technology Sydney (UTS) project found that dog fur and human hair products—recycled from salon wastes and dog groomers—can be just as good as synthetic fabrics at cleaning up crude oil spills on hard land surfaces like highway roads, pavement, and sealed concrete floors. Polypropylene, a plastic, is a widely-used fabric used to clean up oil spills in aquatic environments.

A July 9, 2020 Univesity of Technology Sydney press release on EurekAlert completes the story,

“Dog fur in particular was surprisingly good at oil spill clean-up, and felted mats from human hair and fur were very easy to apply and remove from the spills.” lead author of the study, UTS Environmental Scientist Dr Megan Murray, said. Dr Murray investigates environmentally-friendly solutions for contamination and leads The Phyto Lab research group at UTS School of Life Sciences.

“This is a very exciting finding for land managers who respond to spilled oil from trucks, storage tanks, or leaking oil pipelines. All of these land scenarios can be treated effectively with sustainable-origin sorbents,” she said.

The sorbents tested included two commercially-available products, propylene and loose peat moss, as well as sustainable-origin prototypes including felted mats made of dog fur and human hair. Prototype oil-spill sorbent booms filled with dog fur and human hair were also tested. Crude oil was used to replicate an oil spill. The results of the study are published in Environments.

The research team simulated three types of land surfaces; non-porous hard surfaces, semi-porous surfaces, and sand, to recreate common oil-spill scenarios.

“We found that loose peat moss is not as effective at cleaning up oil spills on land compared to dog fur and hair products, and it is not useful at all for sandy environments.” Dr Murray said.

“Based on this research, we recommend peat moss is no longer used for this purpose. Given that peat moss is a limited resource and harvesting it requires degrading wetland ecosystems, we think this is a very important finding.” she said.

The research concluded that, for now, sandy environments like coastal beaches can still benefit from the use of polypropylene sorbents, but further exploration of sustainable-origin sorbents is planned.

The researchers say that future applications from the research include investigating felted mats of sustainable-origin sorbents for river bank stabilisation, [emphases mine] as well as the removal of pollutants from flowing polluted waters, similar to existing membrane technology.

Here’s a link to and a citation for the study,

Decontaminating Terrestrial Oil Spills: A Comparative Assessment of Dog Fur, Human Hair, Peat Moss and Polypropylene Sorbents by Megan L. Murray, Soeren M. Poulsen and Brad R. Murray. Environments 2020, 7(7), 52; DOI: https://doi.org/10.3390/environments7070052 Published: 8 July 2020 (This article belongs to the Special Issue Pollution Prevention/Environmental Sustainability for Industry)

This paper is open access.

As for the Russian oil spill

A June 4, 2020 British Broadcasting Corporation (BBC) news online article outlines the situation regarding the oil spill and the steps being taken to deal with it,

Russia’s President Vladimir Putin has declared a state of emergency after 20,000 tonnes of diesel oil leaked into a river within the Arctic Circle.

The spill happened when a fuel tank at a power plant near the Siberian city of Norilsk collapsed last Friday [May 29, 2020].

The power plant’s director Vyacheslav Starostin has been taken into custody until 31 July, but not yet charged.

The plant is owned by a subsidiary of Norilsk Nickel, which is the world’s leading nickel and palladium producer.

The Russian Investigative Committee (SK) has launched a criminal case over the pollution and alleged negligence, as there was reportedly a two-day delay in informing the Moscow authorities about the spill.

Ground subsidence beneath the fuel storage tanks is believed to have caused the spill. Arctic permafrost has been melting in exceptionally warm weather [more information about the weather towards the end of this posting] for this time of year.

Russian Minister for Emergencies Yevgeny Zinichev told Mr Putin that the Norilsk plant had spent two days trying to contain the spill, before alerting his ministry.

The leaked oil drifted some 12km (7.5 miles) from the accident site, turning long stretches of the Ambarnaya river crimson red.

The leaked diesel oil drifted some 12km (7.5 miles) from the site of the accident [downloaded from https://www.bbc.com/news/world-europe-52915807]

Getting back to the June 4, 2020 British Broadcasting Corporation (BBC) news online article,

“Why did government agencies only find out about this two days [May 29, 2020?) after the fact?” he asked the subsidiary’s chief, Sergei Lipin. “Are we going to learn about emergency situations from social media?”

The region’s governor, Alexander Uss, had earlier told President Putin that he became aware of the oil spill on Sunday [May 31, 2020] after “alarming information appeared in social media”.

The spill has contaminated a 350 sq km (135 sq mile) area, state media report.

The state of emergency means extra forces are going to the area to assist with the clean-up operation.

The accident is believed to be the second largest in modern Russian history in terms of volume, an expert from the World Wildlife Fund, Alexei Knizhnikov, told the AFP [Agence France Presse] news agency.

The incident has prompted stark warnings from environmental groups, who say the scale of the spill and geography of the river mean it will be difficult to clean up.

Greenpeace has compared it to the 1989 Exxon Valdez disaster in Alaska.

Oleg Mitvol, former deputy head of Russia’s environmental watchdog Rosprirodnadzor, said there had “never been such an accident in the Arctic zone”.

He said the clean-up could cost 100bn roubles (£1.2bn; $1.5bn) and take between five and 10 years.

Minister of Natural Resources Dmitry Kobylkin warned against trying to burn off such a vast quantity of fuel oil.

He proposed trying to dilute the oil with reagents. Only the emergencies ministry with military support could deal with the pollution, he said.

Barges with booms could not contain the slick because the Ambarnaya river was too shallow, he warned.

He suggested pumping the oil on to the adjacent tundra, although President Putin added: “The soil there is probably saturated [with oil] already.”

An update of the situation can be found in a July 8, 2020 Canadian Broadcasting Corporation (CBC) article (issued by Thomson Reuters),

Russia’s environmental watchdog has asked a power subsidiary of Russian mining giant Norilsk Nickel to pay almost 148 billion rubles, or $2.8 billion Cdn, in damages over an Arctic fuel spill in Siberia.

Rosprirodnadzor, the Federal Service for Supervision of Use of Natural Resources, said in a statement on Monday [July 8, 2020] that it had already sent a request for “voluntary compensation” to the subsidiary, NTEK, after calculating the damage caused by the May 29 [2020] fuel spill.

Norilsk Nickel’s Moscow-listed shares fell by 3 per cent after the watchdog’s statement.

A fuel tank at the power plant lost pressure and released 21,000 tonnes of diesel into rivers and subsoil near the city of Norilsk, 2,900 kilometres northeast of Moscow. Russian President Vladimir Putin subsequently declared a state of emergency in the region, and investigators detained three staff at the power plant.

Norilsk, a remote city of 180,000 people situated 300 kilometres inside the Arctic Circle, is built around Norilsk Nickel, the world’s leading nickel and palladium producer, and has a reputation for its pollution.

Rosprirodnadzor said the damages included the cost for nearby water bodies, estimated at 147.05 billion rubles, $2.8 billion Cdn, and for subsoil, estimated at 738.62 million roubles, $14 million Cdn.

I can’t find any August 2020 updates for the oil spill situation in Russia. (Note: There is now an oil spill in a ecologically sensitive region near Mauritius; see August 13, 2020 news item on CBC news online website.)

Exceptionally warm weather

The oil spill isn’t the only problem in the Arctic.Here’s more from a June 23, 2020 article by Matt Simon for Wired magazine (Note: A link has been removed),

On Saturday [June 20, 2020], the residents of Verkhoyansk, Russia, marked the first day of summer with 100 degree Fahrenheit temperatures. Not that they could enjoy it, really, as Verkhoyansk is in Siberia, hundreds of miles from the nearest beach. That’s much, much hotter than towns inside the Arctic Circle usually get. That 100 degrees appears to be a record, well above the average June high temperature of 68 degrees. Yet it’s likely the people of Verkhoyansk will see that record broken again in their lifetimes: The Arctic is warming twice as fast as the rest of the planet—if not faster—creating ecological chaos for the plants and animals that populate the north.

“The events over the weekend—in the last few weeks, really—with the heatwave in Siberia, all are unprecedented in terms of the magnitude of the extremes in temperature,” says Sophie Wilkinson, a wildfire scientist at McMaster University who studies northern peat fires, which themselves have grown unusually frequent in recent years as temperatures climb.

The Arctic’s extreme warming, known as Arctic amplification or polar amplification, may be due to three factors. One, the region’s reflectivity, or albedo—how much light it bounces back into space—is changing as the world warms. “What we’ve been seeing over the last 30 years is some relatively dramatic declines in sea ice in the summertime,” says University of Edinburgh global change ecologist Isla Myers-Smith, who studies the Arctic.

Since ice is white, it reflects the sun’s energy, something you’re already probably familiar with when it comes to staying cool in the summer. If you had to pick the color of T-shirt to wear when going hiking on a hot day, she says, “most of us would pick the white T-shirt, because that’s going to reflect the sun’s heat off of our back.” Similarly, Myers-Smith says, “If the sea ice melts in the Arctic, that will remove that white surface off of the ocean, and what will be exposed is this darker ocean surface that will absorb more of the sun’s heat.”

If you’re interested in the environmental consequences of the warming of the Arctic, this is a very good article.

Finishing up, I wish the clean-up crews (in Russia and near Mauritius) all the best as they work in the midst of a pandemic, as well as, an environmental disaster (both the oil spill and the warming of the Arctic).

Is there a risk of resistance to nanosilver?

Anyone who’s noticed how popular silver has become as an antibacterial, antifungal, or antiviral agent may have wondered if resistance might occur as its use becomes more common. I have two bits on the topic, one from Australia and the other from Canada.

Australia

Researchers in Australia don’t have a definitive statement on the issue but are suggesting more caution (from a March 31, 2017 news item on Nanowerk),

Researchers at the University of Technology Sydney [UTS] warn that the broad-spectrum antimicrobial effectiveness of silver is being put at risk by the widespread and inappropriate expansion of nanosilver use in medical and consumer goods.

As well as their use in medical items such as wound dressings and catheters, silver nanoparticles are becoming ubiquitous in everyday items, including toothbrushes and toothpaste, baby bottles and teats, bedding, clothing and household appliances, because of their antibacterial potency and the incorrect assumption that ordinary items should be kept “clean” of microbes.

Nanobiologist Dr Cindy Gunawan, from the ithree institute at UTS and lead researcher on the investigation, said alarm bells should be ringing at the commercialisation of nanosilver use because of a “real threat” that resistance to nanosilver will develop and spread through microorganisms in the human body and the environment.

A March 31 (?), 2017 University of Technology Sydney press release by Fiona McGill, which originated the news item, expands on the theme,

Dr Gunawan and ithree institute director Professor Liz Harry, in collaboration with researchers at UNSW [University of New South Wales] and abroad, investigated more than 140 commercially available medical devices, including wound dressings and tracheal and urinary catheters, and dietary supplements, which are promoted as immunity boosters and consumed by throat or nasal spray.

Their perspective article in the journal ACS Nano concluded that the use of nanosilver in these items could lead to prolonged exposure to bioactive silver in the human body. Such exposure creates the conditions for microbial resistance to develop.

E. coli bacteria. Photo: Flickr/NIAID

 

The use of silver as an antimicrobial agent dates back centuries. Its ability to destroy pathogens while seemingly having low toxicity on human cells has seen it widely employed, in treating burns or purifying water, for example. More recently, ultra-small (less than 10,000th of a millimetre) silver nanoparticles have been engineered for antimicrobial purposes.  Their commercial appeal lies in superior potency at lower concentrations than “bulk” silver.

“Nanosilver is a proven antimicrobial agent whose reliability is being jeopardised by the commercialisation of people’s fear of bacteria,” Dr Gunawan said.

“Our use of it needs to be far more judicious, in the same way we need to approach antibiotic usage. Nanosilver is a useful tool but we need to be careful, use it wisely and only when the benefit outweighs the risk.

“People need to be made aware of just how widely it is used, but more importantly they need to be made aware that the presence of nanosilver has been shown to cause antimicrobial resistance.”

What is also needed, Dr Gunawan said, is a targeted surveillance strategy to monitor for any occurrence of resistance.

Professor Harry said the findings were a significant contribution to addressing the global antimicrobial resistance crisis.

“This research emphasises the threat posed to our health and that of the environment by the inappropriate use of nanosilver as an antibacterial, particularly in ordinary household and consumer items,” she said.

Here’s a link to and a citation for the paper,

Widespread and Indiscriminate Nanosilver Use: Genuine Potential for Microbial Resistance by Cindy Gunawan, Christopher P. Marquis, Rose Amal, Georgios A. Sotiriou, Scott A. Rice⊥, and Elizabeth J. Harry. ACS Nano, Article ASAP DOI: 10.1021/acsnano.7b01166 Publication Date (Web): March 24, 2017

Copyright © 2017 American Chemical Society

This paper is behind a paywall.

Meanwhile, researchers at the University Calgary (Alberta, Canada) may have discovered what could cause resistance to silver.

Canada

This April 25, 2017 news release on EurekAlert is from the Experimental Biology Annual Meeting 2017,

Silver and other metals have been used to fight infections since ancient times. Today, researchers are using sophisticated techniques such as the gene-editing platform Crispr-Cas9 to take a closer look at precisely how silver poisons pathogenic microbes–and when it fails. The work is yielding new insights on how to create effective antimicrobials and avoid the pitfalls of antimicrobial resistance.

Joe Lemire, a postdoctoral fellow at the University of Calgary, will present his work in this area at the American Society for Biochemistry and Molecular Biology annual meeting during the Experimental Biology 2017 meeting, to be held April 22-26 in Chicago.

“Our overarching goal is to deliver the relevant scientific evidence that would aid policymakers in developing guidelines for when and how silver could be used in the clinic to combat and control infectious pathogens,” said Lemire. “With our enhanced mechanistic understanding of silver toxicity, we also aim to develop novel silver-based antimicrobial therapies, and potentially rejuvenate other antibiotic therapies that bacteria have come to resist, via silver-based co-treatment strategies.”

Lemire and his colleagues are using Crispr-Cas9 genome editing to screen for and delete genes that allow certain bacterial species to resist silver’s antimicrobial properties. [emphasis mine] Although previous methods allowed researchers to identify genes that confer antibiotic resistance or tolerance, Crispr-Cas9 is the first technology to allow researchers to cleanly delete these genes from the genome without leaving behind any biochemical markers or “scars.”

The team has discovered many biological pathways involved in silver toxicity and some surprising ways that bacteria avoid succumbing to silver poisoning, Lemire said. While silver is used to control bacteria in many clinical settings and has been incorporated into hundreds of commercial products, gaining a more complete understanding of silver’s antimicrobial properties is necessary if we are to make the most of this ancient remedy for years to come.

###

Joe Lemire will present this research at 12-2:30 p.m. Tuesday, April 25, [2017] in Hall F, McCormick Place Convention Center (poster B379 939.2) (abstract). Contact the media team for more information or to obtain a free press pass to attend the meeting.

About Experimental Biology 2017

Experimental Biology is an annual meeting comprised of more than 14,000 scientists and exhibitors from six host societies and multiple guest societies. With a mission to share the newest scientific concepts and research findings shaping clinical advances, the meeting offers an unparalleled opportunity for exchange among scientists from across the U.S. and the world who represent dozens of scientific areas, from laboratory to translational to clinical research. http://www.experimentalbiology.org #expbio

About the American Society for Biochemistry and Molecular Biology (ASBMB)

ASBMB is a nonprofit scientific and educational organization with more than 12,000 members worldwide. Founded in 1906 to advance the science of biochemistry and molecular biology, the society publishes three peer-reviewed journals, advocates for funding of basic research and education, supports science education at all levels, and promotes the diversity of individuals entering the scientific workforce. http://www.asbmb.org

Lemire’s co-authors for the work presented at the 2017 annual meeting are: Kate Chatfield-Reed (The University of Calgary), Lindsay Kalan (Perelman School of Medicine), Natalie Gugala (The University of Calgary), Connor Westersund (The University of Calgary), Henrik Almblad (The University of Calgary), Gordon Chua (The University of Calgary), Raymond Turner (The University of Calgary).

For anyone who wants to pursue this research a little further, the most recent paper I can find is this one from 2015,

Silver oxynitrate: An Unexplored Silver Compound with Antimicrobial and Antibiofilm Activity by Joe A. Lemire, Lindsay Kalan, Alexandru Bradu, and Raymond J. Turner. Antimicrobial Agents and Chemotherapy 05177-14, doi: 10.1128/AAC.05177-14 Accepted manuscript posted online 27 April 2015

This paper appears to be open access.