Category Archives: intellectual property

Brain-inspired (neuromrophic) computing with twisted magnets and a patent for manufacturing permanent magnets without rare earths

I have two news bits both of them concerned with magnets.

Patent for magnets that can be made without rare earths

I’m starting with the patent news first since this is (as the company notes in its news release) a “Landmark Patent Issued for Technology Critically Needed to Combat Chinese Monopoly.”

For those who don’t know, China supplies most of the rare earths used in computers, smart phones, and other devices. On general principles, having a single supplier dominate production of and access to a necessary material for devices that most of us rely on can raise tensions. Plus, you can’t mine for resources forever.

This December 19, 2023 Nanocrystal Technology LP news release heralds an exciting development (for the impatient, further down the page I have highlighted the salient sections),

Nanotechnology Discovery by 2023 Nobel Prize Winner Became Launch Pad to Create Permanent Magnets without Rare Earths from China

NEW YORK, NY, UNITED STATES, December 19, 2023 /EINPresswire.com/ — Integrated Nano-Magnetics Corp, a wholly owned subsidiary of Nanocrystal Technology LP, was awarded a patent for technology built upon a fundamental nanoscience discovery made by Aleksey Yekimov, its former Chief Scientific Officer.

This patent will enable the creation of strong permanent magnets which are critically needed for both industrial and military applications but cannot be manufactured without certain “rare earth” elements available mostly from China.

At a glittering awards ceremony held in Stockholm on December10, 2023, three scientists, Aleksey Yekimov, Louis Brus (Professor at Columbia University) and Moungi Bawendi (Professor at MIT) were honored with the Nobel Prize in Chemistry for their discovery of the “quantum dot” which is now fueling practical applications in tuning the colors of LEDs, increasing the resolution of TV screens, and improving MRI imaging.

As stated by the Royal Swedish Academy of Sciences, “Quantum dots are … bringing the greatest benefits to humankind. Researchers believe that in the future they could contribute to flexible electronics, tiny sensors, thinner solar cells, and encrypted quantum communications – so we have just started exploring the potential of these tiny particles.”

Aleksey Yekimov worked for over 19 years until his retirement as Chief Scientific Officer of Nanocrystals Technology LP, an R & D company in New York founded by two Indian-American entrepreneurs, Rameshwar Bhargava and Rajan Pillai.

Yekimov, who was born in Russia, had already received the highest scientific honors for his work before he immigrated to USA in 1999. Yekimov was greatly intrigued by Nanocrystal Technology’s research project and chose to join the company as its Chief Scientific Officer.

During its early years, the company worked on efficient light generation by doping host nanoparticles about the same size as a quantum dot with an additional impurity atom. Bhargava came up with the novel idea of incorporating a single impurity atom, a dopant, into a quantum dot sized host, and thus achieve an extraordinary change in the host material’s properties such as inducing strong permanent magnetism in weak, readily available paramagnetic materials. To get a sense of the scale at which nanotechnology works, and as vividly illustrated by the Nobel Foundation, the difference in size between a quantum dot and a soccer ball is about the same as the difference between a soccer ball and planet Earth.

Currently, strong permanent magnets are manufactured from “rare earths” available mostly in China which has established a near monopoly on the supply of rare-earth based strong permanent magnets. Permanent magnets are a fundamental building block for electro-mechanical devices such as motors found in all automobiles including electric vehicles, trucks and tractors, military tanks, wind turbines, aircraft engines, missiles, etc. They are also required for the efficient functioning of audio equipment such as speakers and cell phones as well as certain magnetic storage media.

The existing market for permanent magnets is $28 billion and is projected to reach $50 billion by 2030 in view of the huge increase in usage of electric vehicles. China’s overwhelming dominance in this field has become a matter of great concern to governments of all Western and other industrialized nations. As the Wall St. Journal put it, China’s now has a “stranglehold” on the economies and security of other countries.

The possibility of making permanent magnets without the use of any rare earths mined in China has intrigued leading physicists and chemists for nearly 30 years. On December 19, 2023, a U.S. patent with the title ‘’Strong Non Rare Earth Permanent Magnets from Double Doped Magnetic Nanoparticles” was granted to Integrated Nano-Magnetics Corp. [emphasis mine] Referring to this major accomplishment Bhargava said, “The pioneering work done by Yekimov, Brus and Bawendi has provided the foundation for us to make other discoveries in nanotechnology which will be of great benefit to the world.”

I was not able to find any company websites. The best I could find is a Nanocrystals Technology LinkedIn webpage and some limited corporate data for Integrated Nano-Magnetics on opencorporates.com.

Twisted magnets and brain-inspired computing

This research offers a pathway to neuromorphic (brainlike) computing with chiral (or twisted) magnets, which, as best as I understand it, do not require rare earths. From a November13, 2023 news item on ScienceDaily,

A form of brain-inspired computing that exploits the intrinsic physical properties of a material to dramatically reduce energy use is now a step closer to reality, thanks to a new study led by UCL [University College London] and Imperial College London [ICL] researchers.

In the new study, published in the journal Nature Materials, an international team of researchers used chiral (twisted) magnets as their computational medium and found that, by applying an external magnetic field and changing temperature, the physical properties of these materials could be adapted to suit different machine-learning tasks.

A November 9, 2023 UCL press release (also on EurekAlert but published November 13, 2023), which originated the news item, fill s in a few more details about the research,

Dr Oscar Lee (London Centre for Nanotechnology at UCL and UCL Department of Electronic & Electrical Engineering), the lead author of the paper, said: “This work brings us a step closer to realising the full potential of physical reservoirs to create computers that not only require significantly less energy, but also adapt their computational properties to perform optimally across various tasks, just like our brains.

“The next step is to identify materials and device architectures that are commercially viable and scalable.”

Traditional computing consumes large amounts of electricity. This is partly because it has separate units for data storage and processing, meaning information has to be shuffled constantly between the two, wasting energy and producing heat. This is particularly a problem for machine learning, which requires vast datasets for processing. Training one large AI model can generate hundreds of tonnes of carbon dioxide.

Physical reservoir computing is one of several neuromorphic (or brain inspired) approaches that aims to remove the need for distinct memory and processing units, facilitating more efficient ways to process data. In addition to being a more sustainable alternative to conventional computing, physical reservoir computing could be integrated into existing circuitry to provide additional capabilities that are also energy efficient.

In the study, involving researchers in Japan and Germany, the team used a vector network analyser to determine the energy absorption of chiral magnets at different magnetic field strengths and temperatures ranging from -269 °C to room temperature.

They found that different magnetic phases of chiral magnets excelled at different types of computing task. The skyrmion phase, where magnetised particles are swirling in a vortex-like pattern, had a potent memory capacity apt for forecasting tasks. The conical phase, meanwhile, had little memory, but its non-linearity was ideal for transformation tasks and classification – for instance, identifying if an animal is a cat or dog.

Co-author Dr Jack Gartside, of Imperial College London, said: “Our collaborators at UCL in the group of Professor Hidekazu Kurebayashi recently identified a promising set of materials for powering unconventional computing. These materials are special as they can support an especially rich and varied range of magnetic textures. Working with the lead author Dr Oscar Lee, the Imperial College London group [led by Dr Gartside, Kilian Stenning and Professor Will Branford] designed a neuromorphic computing architecture to leverage the complex material properties to match the demands of a diverse set of challenging tasks. This gave great results, and showed how reconfiguring physical phases can directly tailor neuromorphic computing performance.”

The work also involved researchers at the University of Tokyo and Technische Universität München and was supported by the Leverhulme Trust, Engineering and Physical Sciences Research Council (EPSRC), Imperial College London President’s Excellence Fund for Frontier Research, Royal Academy of Engineering, the Japan Science and Technology Agency, Katsu Research Encouragement Award, Asahi Glass Foundation, and the DFG (German Research Foundation).

Here’s a link to and a citation for the paper,

Task-adaptive physical reservoir computing by Oscar Lee, Tianyi Wei, Kilian D. Stenning, Jack C. Gartside, Dan Prestwood, Shinichiro Seki, Aisha Aqeel, Kosuke Karube, Naoya Kanazawa, Yasujiro Taguchi, Christian Back, Yoshinori Tokura, Will R. Branford & Hidekazu Kurebayashi. Nature Materials volume 23, pages 79–87 (2024) DOI: https://doi.org/10.1038/s41563-023-01698-8 Published online: 13 November 2023 Issue Date: January 2024

This paper is open access.

FrogHeart’s 2023 comes to an end as 2024 comes into view

My personal theme for this last year (2023) and for the coming year was and is: catching up. On the plus side, my 2023 backlog (roughly six months) to be published was whittled down considerably. On the minus side, I start 2024 with a backlog of two to three months.

2023 on this blog had a lot in common with 2022 (see my December 31, 2022 posting), which may be due to what’s going on in the world of emerging science and technology or to my personal interests or possibly a bit of both. On to 2023 and a further blurring of boundaries:

Energy, computing and the environment

The argument against paper is that it uses up resources, it’s polluting, it’s affecting the environment, etc. Somehow the part where electricity which underpins so much of our ‘smart’ society does the same thing is left out of the discussion.

Neuromorphic (brainlike) computing and lower energy

Before launching into the stories about lowering energy usage, here’s an October 16, 2023 posting “The cost of building ChatGPT” that gives you some idea of the consequences of our insatiable desire for more computing and more ‘smart’ devices,

In its latest environmental report, Microsoft disclosed that its global water consumption spiked 34% from 2021 to 2022 (to nearly 1.7 billion gallons , or more than 2,500 Olympic-sized swimming pools), a sharp increase compared to previous years that outside researchers tie to its AI research. [emphases mine]

“It’s fair to say the majority of the growth is due to AI,” including “its heavy investment in generative AI and partnership with OpenAI,” said Shaolei Ren, [emphasis mine] a researcher at the University of California, Riverside who has been trying to calculate the environmental impact of generative AI products such as ChatGPT.

Why it matters: Microsoft’s five WDM [West Des Moines in Iowa] data centers — the “epicenter for advancing AI” — represent more than $5 billion in investments in the last 15 years.

Yes, but: They consumed as much as 11.5 million gallons of water a month for cooling, or about 6% of WDM’s total usage during peak summer usage during the last two years, according to information from West Des Moines Water Works.

The focus is AI but it doesn’t take long to realize that all computing has energy and environmental costs. I have more about Ren’s work and about water shortages in the “The cost of building ChatGPT” posting.

This next posting would usually be included with my other art/sci postings but it touches on the issues. My October 13, 2023 posting about Toronto’s Art/Sci Salon events, in particular, there’s the Streaming Carbon Footprint event (just scroll down to the appropriate subhead). For the interested, I also found this 2022 paper “The Carbon Footprint of Streaming Media:; Problems, Calculations, Solutions” co-authored by one of the artist/researchers (Laura U. Marks, philosopher and scholar of new media and film at Simon Fraser University) who presented at the Toronto event.

I’m late to the party; Thomas Daigle posted a January 2, 2020 article about energy use and our appetite for computing and ‘smart’ devices for the Canadian Broadcasting Corporation’s online news,

For those of us binge-watching TV shows, installing new smartphone apps or sharing family photos on social media over the holidays, it may seem like an abstract predicament.

The gigabytes of data we’re using — although invisible — come at a significant cost to the environment. Some experts say it rivals that of the airline industry. 

And as more smart devices rely on data to operate (think internet-connected refrigerators or self-driving cars), their electricity demands are set to skyrocket.

“We are using an immense amount of energy to drive this data revolution,” said Jane Kearns, an environment and technology expert at MaRS Discovery District, an innovation hub in Toronto.

“It has real implications for our climate.”

Some good news

Researchers are working on ways to lower the energy and environmental costs, here’s a sampling of 2023 posts with an emphasis on brainlike computing that attest to it,

If there’s an industry that can make neuromorphic computing and energy savings sexy, it’s the automotive indusry,

On the energy front,

Most people are familiar with nuclear fission and some its attendant issues. There is an alternative nuclear energy, fusion, which is considered ‘green’ or greener anyway. General Fusion is a local (Vancouver area) company focused on developing fusion energy, alongside competitors from all over the planet.

Part of what makes fusion energy attractive is that salt water or sea water can be used in its production and, according to that December posting, there are other applications for salt water power,

More encouraging developments in environmental science

Again, this is a selection. You’ll find a number of nano cellulose research projects and a couple of seaweed projects (seaweed research seems to be of increasing interest).

All by myself (neuromorphic engineering)

Neuromorphic computing is a subset of neuromorphic engineering and I stumbled across an article that outlines the similarities and differences. My ‘summary’ of the main points and a link to the original article can be found here,

Oops! I did it again. More AI panic

I included an overview of the various ‘recent’ panics (in my May 25, 2023 posting below) along with a few other posts about concerning developments but it’s not all doom and gloom..

Governments have realized that regulation might be a good idea. The European Union has a n AI act, the UK held an AI Safety Summit in November 2023, the US has been discussing AI regulation with its various hearings, and there’s impending legislation in Canada (see professor and lawyer Michael Geist’s blog for more).

A long time coming, a nanomedicine comeuppance

Paolo Macchiarini is now infamous for his untested, dangerous approach to medicine. Like a lot of people, I was fooled too as you can see in my August 2, 2011 posting, “Body parts nano style,”

In early July 2011, there were reports of a new kind of transplant involving a body part made of a biocomposite. Andemariam Teklesenbet Beyene underwent a trachea transplant that required an artificial windpipe crafted by UK experts then flown to Sweden where Beyene’s stem cells were used to coat the windpipe before being transplanted into his body.

It is an extraordinary story not least because Beyene, a patient in a Swedish hospital planning to return to Eritrea after his PhD studies in Iceland, illustrates the international cooperation that made the transplant possible.

The scaffolding material for the artificial windpipe was developed by Professor Alex Seifalian at the University College London in a landmark piece of nanotechnology-enabled tissue engineering. …

Five years later I stumbled across problems with Macchiarini’s work as outlined in my April 19, 2016 posting, “Macchiarini controversy and synthetic trachea transplants (part 1 of 2)” and my other April 19, 2016 posting, “Macchiarini controversy and synthetic trachea transplants (part 2 of 2)“.

This year, Gretchen Vogel (whose work was featured in my 2016 posts) has written a June 21, 2023 update about the Macchiarini affair for Science magazine, Note: Links have been removed,

Surgeon Paolo Macchiarini, who was once hailed as a pioneer of stem cell medicine, was found guilty of gross assault against three of his patients today and sentenced to 2 years and 6 months in prison by an appeals court in Stockholm. The ruling comes a year after a Swedish district court found Macchiarini guilty of bodily harm in two of the cases and gave him a suspended sentence. After both the prosecution and Macchiarini appealed that ruling, the Svea Court of Appeal heard the case in April and May. Today’s ruling from the five-judge panel is largely a win for the prosecution—it had asked for a 5-year sentence whereas Macchiarini’s lawyer urged the appeals court to acquit him of all charges.

Macchiarini performed experimental surgeries on the three patients in 2011 and 2012 while working at the renowned Karolinska Institute. He implanted synthetic windpipes seeded with stem cells from the patients’ own bone marrow, with the hope the cells would multiply over time and provide an enduring replacement. All three patients died when the implants failed. One patient died suddenly when the implant caused massive bleeding just 4 months after it was implanted; the two others survived for 2.5 and nearly 5 years, respectively, but suffered painful and debilitating complications before their deaths.

In the ruling released today, the appeals judges disagreed with the district court’s decision that the first two patients were treated under “emergency” conditions. Both patients could have survived for a significant length of time without the surgeries, they said. The third case was an “emergency,” the court ruled, but the treatment was still indefensible because by then Macchiarini was well aware of the problems with the technique. (One patient had already died and the other had suffered severe complications.)

A fictionalized tv series ( part of the Dr. Death anthology series) based on Macchiarini’s deceptions and a Dr. Death documentary are being broadcast/streamed in the US during January 2024. These come on the heels of a November 2023 Macchiarini documentary also broadcast/streamed on US television.

Dr. Death (anthology), based on the previews I’ve seen, is heavily US-centric, which is to be expected since Adam Ciralsky is involved in the production. Ciralsky wrote an exposé about Macchiarini for Vanity Fair published in 2016 (also featured in my 2016 postings). From a December 20, 2023 article by Julie Miller for Vanity Fair, Note: A link has been removed,

Seven years ago [2016], world-renowned surgeon Paolo Macchiarini was the subject of an ongoing Vanity Fair investigation. He had seduced award-winning NBC producer Benita Alexander while she was making a special about him, proposed, and promised her a wedding officiated by Pope Francis and attended by political A-listers. It was only after her designer wedding gown was made that Alexander learned Macchiarini was still married to his wife, and seemingly had no association with the famous names on their guest list.

Vanity Fair contributor Adam Ciralsky was in the midst of reporting the story for this magazine in the fall of 2015 when he turned to Dr. Ronald Schouten, a Harvard psychiatry professor. Ciralsky sought expert insight into the kind of fabulist who would invent and engage in such an audacious lie.

“I laid out the story to him, and he said, ‘Anybody who does this in their private life engages in the same conduct in their professional life,” recalls Ciralsky, in a phone call with Vanity Fair. “I think you ought to take a hard look at his CVs.”

That was the turning point in the story for Ciralsky, a former CIA lawyer who soon learned that Macchiarini was more dangerous as a surgeon than a suitor. …

Here’s a link to Ciralsky’s original article, which I described this way, from my April 19, 2016 posting (part 2 of the Macchiarini controversy),

For some bizarre frosting on this disturbing cake (see part 1 of the Macchiarini controversy and synthetic trachea transplants for the medical science aspects), a January 5, 2016 Vanity Fair article by Adam Ciralsky documents Macchiarini’s courtship of an NBC ([US] National Broadcasting Corporation) news producer who was preparing a documentary about him and his work.

[from Ciralsky’s article]

“Macchiarini, 57, is a magnet for superlatives. He is commonly referred to as “world-renowned” and a “super-surgeon.” He is credited with medical miracles, including the world’s first synthetic organ transplant, which involved fashioning a trachea, or windpipe, out of plastic and then coating it with a patient’s own stem cells. That feat, in 2011, appeared to solve two of medicine’s more intractable problems—organ rejection and the lack of donor organs—and brought with it major media exposure for Macchiarini and his employer, Stockholm’s Karolinska Institute, home of the Nobel Prize in Physiology or Medicine. Macchiarini was now planning another first: a synthetic-trachea transplant on a child, a two-year-old Korean-Canadian girl named Hannah Warren, who had spent her entire life in a Seoul hospital. … “

Other players in the Macchiarini story

Pierre Delaere, a trachea expert and professor of head and neck surgery at KU Leuven (a university in Belgium) was one of the first to draw attention to Macchiarini’s dangerous and unethical practices. To give you an idea of how difficult it was to get attention for this issue, there’s a September 1, 2017 article by John Rasko and Carl Power for the Guardian illustrating the issue. Here’s what they had to say about Delaere and other early critics of the work, Note: Links have been removed,

Delaere was one of the earliest and harshest critics of Macchiarini’s engineered airways. Reports of their success always seemed like “hot air” to him. He could see no real evidence that the windpipe scaffolds were becoming living, functioning airways – in which case, they were destined to fail. The only question was how long it would take – weeks, months or a few years.

Delaere’s damning criticisms appeared in major medical journals, including the Lancet, but weren’t taken seriously by Karolinska’s leadership. Nor did they impress the institute’s ethics council when Delaere lodged a formal complaint. [emphases mine]

Support for Macchiarini remained strong, even as his patients began to die. In part, this is because the field of windpipe repair is a niche area. Few people at Karolinska, especially among those in power, knew enough about it to appreciate Delaere’s claims. Also, in such a highly competitive environment, people are keen to show allegiance to their superiors and wary of criticising them. The official report into the matter dubbed this the “bandwagon effect”.

With Macchiarini’s exploits endorsed by management and breathlessly reported in the media, it was all too easy to jump on that bandwagon.

And difficult to jump off. In early 2014, four Karolinska doctors defied the reigning culture of silence [emphasis mine] by complaining about Macchiarini. In their view, he was grossly misrepresenting his results and the health of his patients. An independent investigator agreed. But the vice-chancellor of Karolinska Institute, Anders Hamsten, wasn’t bound by this judgement. He officially cleared Macchiarini of scientific misconduct, allowing merely that he’d sometimes acted “without due care”.

For their efforts, the whistleblowers were punished. [emphasis mine] When Macchiarini accused one of them, Karl-Henrik Grinnemo, of stealing his work in a grant application, Hamsten found him guilty. As Grinnemo recalls, it nearly destroyed his career: “I didn’t receive any new grants. No one wanted to collaborate with me. We were doing good research, but it didn’t matter … I thought I was going to lose my lab, my staff – everything.”

This went on for three years until, just recently [2017], Grinnemo was cleared of all wrongdoing.

It is fitting that Macchiarini’s career unravelled at the Karolinska Institute. As the home of the Nobel prize in physiology or medicine, one of its ambitions is to create scientific celebrities. Every year, it gives science a show-business makeover, picking out from the mass of medical researchers those individuals deserving of superstardom. The idea is that scientific progress is driven by the genius of a few.

It’s a problematic idea with unfortunate side effects. A genius is a revolutionary by definition, a risk-taker and a law-breaker. Wasn’t something of this idea behind the special treatment Karolinska gave Macchiarini? Surely, he got away with so much because he was considered an exception to the rules with more than a whiff of the Nobel about him. At any rate, some of his most powerful friends were themselves Nobel judges until, with his fall from grace, they fell too.

The September 1, 2017 article by Rasko and Power is worth the read if you have the interest and the time. And, Delaere has written up a comprehensive analysis, which includes basic information about tracheas and more, “The Biggest Lie in Medical History” 2020, PDF, 164 pp., Creative Commons Licence).

I also want to mention Leonid Schneider, science journalist and molecular cell biologist, whose work the Macchiarini scandal on his ‘For Better Science’ website was also featured in my 2016 pieces. Schneider’s site has a page titled, ‘Macchiarini’s trachea transplant patients: the full list‘ started in 2017 and which he continues to update with new information about the patients. The latest update was made on December 20, 2023.

Promising nanomedicine research but no promises and a caveat

Most of the research mentioned here is still in the laboratory. i don’t often come across work that has made its way to clinical trials since the focus of this blog is emerging science and technology,

*If you’re interested in the business of neurotechnology, the July 17, 2023 posting highlights a very good UNESCO report on the topic.

Funky music (sound and noise)

I have couple of stories about using sound for wound healing, bioinspiration for soundproofing applications, detecting seismic activity, more data sonification, etc.

Same old, same old CRISPR

2023 was relatively quiet (no panics) where CRISPR developments are concerned but still quite active.

Art/Sci: a pretty active year

I didn’t realize how active the year was art/sciwise including events and other projects until I reviewed this year’s postings. This is a selection from 2023 but there’s a lot more on the blog, just use the search term, “art/sci,” or “art/science,” or “sciart.”

While I often feature events and projects from these groups (e.g., June 2, 2023 posting, “Metacreation Lab’s greatest hits of Summer 2023“), it’s possible for me to miss a few. So, you can check out Toronto’s Art/Sci Salon’s website (strong focus on visual art) and Simon Fraser University’s Metacreation Lab for Creative Artificial Intelligence website (strong focus on music).

My selection of this year’s postings is more heavily weighted to the ‘writing’ end of things.

Boundaries: life/nonlife

Last year I subtitled this section, ‘Aliens on earth: machinic biology and/or biological machinery?” Here’s this year’s selection,

Canada’s 2023 budget … military

2023 featured an unusual budget where military expenditures were going to be increased, something which could have implications for our science and technology research.

Then things changed as Murray Brewster’s November 21, 2023 article for the Canadian Broadcasting Corporation’s (CBC) news online website comments, Note: A link has been removed,

There was a revelatory moment on the weekend as Defence Minister Bill Blair attempted to bridge the gap between rhetoric and reality in the Liberal government’s spending plans for his department and the Canadian military.

Asked about an anticipated (and long overdue) update to the country’s defence policy (supposedly made urgent two years ago by Russia’s full-on invasion of Ukraine), Blair acknowledged that the reset is now being viewed through a fiscal lens.

“We said we’re going to bring forward a new defence policy update. We’ve been working through that,” Blair told CBC’s Rosemary Barton Live on Sunday.

“The current fiscal environment that the country faces itself does require (that) that defence policy update … recognize (the) fiscal challenges. And so it’ll be part of … our future budget processes.”

One policy goal of the existing defence plan, Strong, Secure and Engaged, was to require that the military be able to concurrently deliver “two sustained deployments of 500 [to] 1,500 personnel in two different theaters of operation, including one as a lead nation.”

In a footnote, the recent estimates said the Canadian military is “currently unable to conduct multiple operations concurrently per the requirements laid out in the 2017 Defence Policy. Readiness of CAF force elements has continued to decrease over the course of the last year, aggravated by decreasing number of personnel and issues with equipment and vehicles.”

Some analysts say they believe that even if the federal government hits its overall budget reduction targets, what has been taken away from defence — and what’s about to be taken away — won’t be coming back, the minister’s public assurances notwithstanding.

10 years: Graphene Flagship Project and Human Brain Project

Graphene and Human Brain Project win biggest research award in history (& this is the 2000th post)” on January 28, 2013 was how I announced the results of what had been a a European Union (EU) competition that stretched out over several years and many stages as projects were evaluated and fell to the wayside or were allowed onto the next stage. The two finalists received €1B each to be paid out over ten years.

Future or not

As you can see, there was plenty of interesting stuff going on in 2023 but no watershed moments in the areas I follow. (Please do let me know in the Comments should you disagree with this or any other part of this posting.) Nanotechnology seems less and less an emerging science/technology in itself and more like a foundational element of our science and technology sectors. On that note, you may find my upcoming (in 2024) post about a report concerning the economic impact of its National Nanotechnology Initiative (NNI) from 2002 to 2022 of interest.

Following on the commercialization theme, I have noticed an increase of interest in commercializing brain and brainlike engineering technologies, as well as, more discussion about ethics.

Colonizing the brain?

UNESCO held events such as, this noted in my July 17, 2023 posting, “Unveiling the Neurotechnology Landscape: Scientific Advancements, Innovations and Major Trends—a UNESCO report” and this noted in my July 7, 2023 posting “Global dialogue on the ethics of neurotechnology on July 13, 2023 led by UNESCO.” An August 21, 2023 posting, “Ethical nanobiotechnology” adds to the discussion.

Meanwhile, Australia has been producing some very interesting mind/robot research, my June 13, 2023 posting, “Mind-controlled robots based on graphene: an Australian research story.” I have more of this kind of research (mind control or mind reading) from Australia to be published in early 2024. The Australians are not alone, there’s also this April 12, 2023 posting, “Mind-reading prosthetic limbs” from Germany.

My May 12, 2023 posting, “Virtual panel discussion: Canadian Strategies for Responsible Neurotechnology Innovation on May 16, 2023” shows Canada is entering the discussion. Unfortunately, the Canadian Science Policy Centre (CSPC), which held the event, has not posted a video online even though they have a youtube channel featuring other of their events.

As for neurmorphic engineering, China has produced a roadmap for its research in this area as noted in my March 20, 2023 posting, “A nontraditional artificial synaptic device and roadmap for Chinese research into neuromorphic devices.”

Quantum anybody?

I haven’t singled it out in this end-of-year posting but there is a great deal of interest in quantum computer both here in Canada and elsewhere. There is a 2023 report from the Council of Canadian Academies on the topic of quantum computing in Canada, which I hope to comment on soon.

Final words

I have a shout out for the Canadian Science Policy Centre, which celebrated its 15th anniversary in 2023. Congratulations!

For everyone, I wish peace on earth and all the best for you and yours in 2024!

Canadian Science Policy Centre panel on Sept. 6, 2023 [date changed to October 4, 2023]: Science, technology and innovation (STI) between Brazil and Canada plus a quantum panel on Sept. 13, 2023

In an August 17, 2023 Canadian Science Policy Centre (CSPC) newsletter (received via email), they’ve announced a panel about science and technology opportunities with a country we don’t usually talk about much in that context (nice to see a broader, not the US and not a European or Commonwealth country, approach being taken),

Canada-Brazil Cooperation and Collaboration in STI [Science, Technology, and Innovation]

This virtual panel aims to discuss the ongoing Science, Technology, and Innovation (STI) cooperation between Brazil and Canada, along with the potential for furthering this relationship. The focus will encompass strategic areas of contact, ongoing projects, and scholarship opportunities. It is pertinent to reflect on the science diplomacy efforts of each country and their reciprocal influence. Additionally, the panel aims to explore how Canada engages with developing countries in terms of STI.

Click the button below to register for the upcoming virtual panel!

Register Here

Date: Sept. 6 [2023] October 4, 2023
Time: 1:00 pm EDT

Here are the speakers (from the CSPC’s Canada-Brazil Cooperation and Collaboration in STI event page),

Fernanda de Negri
Moderator
Director of Studies and Sectoral Policies of Innovation, Regulation and Infrastructure at the Institute for Applied Economic Research (IPEA), Brazil
See Bio

Alejandro Adem
President of Natural Sciences and Engineering Research Council of Canada – NSERC
See Bio

Ambassador Emmanuel Kamarianakis
Canadian Embassy in Canada
See Bio

Ambassador Ademar Seabra da Cruz Jr.
Ministry of Foreign Affairs, Brazil
See Bio

If you haven’t gotten your fill of virtual science policy panels yet, there’s this one on quantum technologies, from the August 17, 2023 Canadian Science Policy Centre (CSPC) newsletter,

Canada’s Quantum Strategy and International Collaboration

Countries are investing heavily in quantum computing and other quantum technologies. As Canada has recently released its Quantum Strategy [Note: There is also report on Quantum Technologies expected from the Canadian Council of Academies, no release date yet], this is an opportunity to foster further international collaborations. Panelists will discuss the opportunities and challenges Canada will be facing and what this could mean for Canada’s leadership in quantum research and the development of quantum technologies.

Click the button below to register for the upcoming virtual panel!

Register Here

Date: Sep 13 [2023]
Time: 1:00 pm EDT

Here’s some information about the panel participants, from the CSPC’s Canada’s Quantum Strategy and International Collaboration event page,

Dr. Sarah Burke
Associate Professor, University of British Columbia
See Bio

Dr. Aimee K. Gunther
Deputy Director, Quantum Sensors Challenge Program, National Research Council Canada
See Bio

Prof. Andrea Damascelli
Scientific Director, Stewart Blusson Quantum Matter Institute | Professor, Physics and Astronomy | Canada Research Chair in the Electronic Structure of Quantum Materials
See Bio

Nick Werstiuk
CEO, Quantum Valley Ideas Lab
See Bio

Eric Miller
Fellow, Canadian Global Affairs Institute
See Bio

Ms. Alexandra Daoud
Moderator
Vice President, Intellectual Property at Anyon Systems
See Bio

Interestingly, the moderator, Alexandra Daoud, is a patent agent.

As for the Council of Canadian Academies, you can find out about the proposed report on Quantum Technologies here.

Unveiling the Neurotechnology Landscape: Scientific Advancements, Innovations and Major Trends—a UNESCO report

Launched on Thursday, July 13, 2023 during UNESCO’s (United Nations Educational, Scientific, and Cultural Organization) “Global dialogue on the ethics of neurotechnology,” is a report tying together the usual measures of national scientific supremacy (number of papers published and number of patents filed) with information on corporate investment in the field. Consequently, “Unveiling the Neurotechnology Landscape: Scientific Advancements, Innovations and Major Trends” by Daniel S. Hain, Roman Jurowetzki, Mariagrazia Squicciarini, and Lihui Xu provides better insight into the international neurotechnology scene than is sometimes found in these kinds of reports. By the way, the report is open access.

Here’s what I mean, from the report‘s short summary,

Since 2013, government investments in this field have exceeded $6 billion. Private investment has also seen significant growth, with annual funding experiencing a 22-fold increase from 2010 to 2020, reaching $7.3 billion and totaling $33.2 billion.

This investment has translated into a 35-fold growth in neuroscience publications between 2000-2021 and 20-fold growth in innovations between 2022-2020, as proxied by patents. However, not all are poised to benefit from such developments, as big divides emerge.

Over 80% of high-impact neuroscience publications are produced by only ten countries, while 70% of countries contributed fewer than 10 such papers over the period considered. Similarly, five countries only hold 87% of IP5 neurotech patents.

This report sheds light on the neurotechnology ecosystem, that is, what is being developed, where and by whom, and informs about how neurotechnology interacts with other technological trajectories, especially Artificial Intelligence [emphasis mine]. [p. 2]

The money aspect is eye-opening even when you already have your suspicions. Also, it’s not entirely unexpected to learn that only ten countries produce over 80% of the high impact neurotech papers and that only five countries hold 87% of the IP5 neurotech patents but it is stunning to see it in context. (If you’re not familiar with the term ‘IP5 patents’, scroll down in this post to the relevant subhead. Hint: It means the patent was filed in one of the top five jurisdictions; I’ll leave you to guess which ones those might be.)

“Since 2013 …” isn’t quite as informative as the authors may have hoped. I wish they had given a time frame for government investments similar to what they did for corporate investments (e.g., 2010 – 2020). Also, is the $6B (likely in USD) government investment cumulative or an estimated annual number? To sum up, I would have appreciated parallel structure and specificity.

Nitpicks aside, there’s some very good material intended for policy makers. On that note, some of the analysis is beyond me. I haven’t used anything even somewhat close to their analytical tools in years and years. This commentaries reflects my interests and a very rapid reading. One last thing, this is being written from a Canadian perspective. With those caveats in mind, here’s some of what I found.

A definition, social issues, country statistics, and more

There’s a definition for neurotechnology and a second mention of artificial intelligence being used in concert with neurotechnology. From the report‘s executive summary,

Neurotechnology consists of devices and procedures used to access, monitor, investigate, assess, manipulate, and/or emulate the structure and function of the neural systems of animals or human beings. It is poised to revolutionize our understanding of the brain and to unlock innovative solutions to treat a wide range of diseases and disorders.

Similarly to Artificial Intelligence (AI), and also due to its convergence with AI, neurotechnology may have profound societal and economic impact, beyond the medical realm. As neurotechnology directly relates to the brain, it triggers ethical considerations about fundamental aspects of human existence, including mental integrity, human dignity, personal identity, freedom of thought, autonomy, and privacy [emphases mine]. Its potential for enhancement purposes and its accessibility further amplifies its prospect social and societal implications.

The recent discussions held at UNESCO’s Executive Board further shows Member States’ desire to address the ethics and governance of neurotechnology through the elaboration of a new standard-setting instrument on the ethics of neurotechnology, to be adopted in 2025. To this end, it is important to explore the neurotechnology landscape, delineate its boundaries, key players, and trends, and shed light on neurotech’s scientific and technological developments. [p. 7]

Here’s how they sourced the data for the report,

The present report addresses such a need for evidence in support of policy making in
relation to neurotechnology by devising and implementing a novel methodology on data from scientific articles and patents:

● We detect topics over time and extract relevant keywords using a transformer-
based language models fine-tuned for scientific text. Publication data for the period
2000-2021 are sourced from the Scopus database and encompass journal articles
and conference proceedings in English. The 2,000 most cited publications per year
are further used in in-depth content analysis.
● Keywords are identified through Named Entity Recognition and used to generate
search queries for conducting a semantic search on patents’ titles and abstracts,
using another language model developed for patent text. This allows us to identify
patents associated with the identified neuroscience publications and their topics.
The patent data used in the present analysis are sourced from the European
Patent Office’s Worldwide Patent Statistical Database (PATSTAT). We consider
IP5 patents filed between 2000-2020 having an English language abstract and
exclude patents solely related to pharmaceuticals.

This approach allows mapping the advancements detailed in scientific literature to the technological applications contained in patent applications, allowing for an analysis of the linkages between science and technology. This almost fully automated novel approach allows repeating the analysis as neurotechnology evolves. [pp. 8-9[

Findings in bullet points,

Key stylized facts are:
● The field of neuroscience has witnessed a remarkable surge in the overall number
of publications since 2000, exhibiting a nearly 35-fold increase over the period
considered, reaching 1.2 million in 2021. The annual number of publications in
neuroscience has nearly tripled since 2000, exceeding 90,000 publications a year
in 2021. This increase became even more pronounced since 2019.
● The United States leads in terms of neuroscience publication output (40%),
followed by the United Kingdom (9%), Germany (7%), China (5%), Canada (4%),
Japan (4%), Italy (4%), France (4%), the Netherlands (3%), and Australia (3%).
These countries account for over 80% of neuroscience publications from 2000 to
2021.
● Big divides emerge, with 70% of countries in the world having less than 10 high-
impact neuroscience publications between 2000 to 2021.
● Specific neurotechnology-related research trends between 2000 and 2021 include:
○ An increase in Brain-Computer Interface (BCI) research around 2010,
maintaining a consistent presence ever since.
○ A significant surge in Epilepsy Detection research in 2017 and 2018,
reflecting the increased use of AI and machine learning in healthcare.
○ Consistent interest in Neuroimaging Analysis, which peaks around 2004,
likely because of its importance in brain activity and language
comprehension studies.
○ While peaking in 2016 and 2017, Deep Brain Stimulation (DBS) remains a
persistent area of research, underlining its potential in treating conditions
like Parkinson’s disease and essential tremor.
● Between 2000 and 2020, the total number of patent applications in this field
increased significantly, experiencing a 20-fold increase from less than 500 to over
12,000. In terms of annual figures, a consistent upward trend in neurotechnology-10
related patent applications emerges, with a notable doubling observed between
2015 and 2020.
• The United States account for nearly half of all worldwide patent applications (47%).
Other major contributors include South Korea (11%), China (10%), Japan (7%),
Germany (7%), and France (5%). These five countries together account for 87%
of IP5 neurotech patents applied between 2000 and 2020.
○ The United States has historically led the field, with a peak around 2010, a
decline towards 2015, and a recovery up to 2020.
○ South Korea emerged as a significant contributor after 1990, overtaking
Germany in the late 2000s to become the second-largest developer of
neurotechnology. By the late 2010s, South Korea’s annual neurotechnology
patent applications approximated those of the United States.
○ China exhibits a sharp increase in neurotechnology patent applications in
the mid-2010s, bringing it on par with the United States in terms of
application numbers.
● The United States ranks highest in both scientific publications and patents,
indicating their strong ability to transform knowledge into marketable inventions.
China, France, and Korea excel in leveraging knowledge to develop patented
innovations. Conversely, countries such as the United Kingdom, Germany, Italy,
Canada, Brazil, and Australia lag behind in effectively translating neurotech
knowledge into patentable innovations.
● In terms of patent quality measured by forward citations, the leading countries are
Germany, US, China, Japan, and Korea.
● A breakdown of patents by technology field reveals that Computer Technology is
the most important field in neurotechnology, exceeding Medical Technology,
Biotechnology, and Pharmaceuticals. The growing importance of algorithmic
applications, including neural computing techniques, also emerges by looking at
the increase in patent applications in these fields between 2015-2020. Compared
to the reference year, computer technologies-related patents in neurotech
increased by 355% and by 92% in medical technology.
● An analysis of the specialization patterns of the top-5 countries developing
neurotechnologies reveals that Germany has been specializing in chemistry-
related technology fields, whereas Asian countries, particularly South Korea and
China, focus on computer science and electrical engineering-related fields. The
United States exhibits a balanced configuration with specializations in both
chemistry and computer science-related fields.
● The entities – i.e. both companies and other institutions – leading worldwide
innovation in the neurotech space are: IBM (126 IP5 patents, US), Ping An
Technology (105 IP5 patents, CH), Fujitsu (78 IP5 patents, JP), Microsoft (76 IP511
patents, US)1, Samsung (72 IP5 patents, KR), Sony (69 IP5 patents JP) and Intel
(64 IP5 patents US)

This report further proposes a pioneering taxonomy of neurotechnologies based on International Patent Classification (IPC) codes.

• 67 distinct patent clusters in neurotechnology are identified, which mirror the diverse research and development landscape of the field. The 20 most prominent neurotechnology groups, particularly in areas like multimodal neuromodulation, seizure prediction, neuromorphic computing [emphasis mine], and brain-computer interfaces, point to potential strategic areas for research and commercialization.
• The variety of patent clusters identified mirrors the breadth of neurotechnology’s potential applications, from medical imaging and limb rehabilitation to sleep optimization and assistive exoskeletons.
• The development of a baseline IPC-based taxonomy for neurotechnology offers a structured framework that enriches our understanding of this technological space, and can facilitate research, development and analysis. The identified key groups mirror the interdisciplinary nature of neurotechnology and underscores the potential impact of neurotechnology, not only in healthcare but also in areas like information technology and biomaterials, with non-negligible effects over societies and economies.

1 If we consider Microsoft Technology Licensing LLM and Microsoft Corporation as being under the same umbrella, Microsoft leads worldwide developments with 127 IP5 patents. Similarly, if we were to consider that Siemens AG and Siemens Healthcare GmbH belong to the same conglomerate, Siemens would appear much higher in the ranking, in third position, with 84 IP5 patents. The distribution of intellectual property assets across companies belonging to the same conglomerate is frequent and mirrors strategic as well as operational needs and features, among others. [pp. 9-11]

Surprises and comments

Interesting and helpful to learn that “neurotechnology interacts with other technological trajectories, especially Artificial Intelligence;” this has changed and improved my understanding of neurotechnology.

It was unexpected to find Canada in the top ten countries producing neuroscience papers. However, finding out that the country lags in translating its ‘neuro’ knowledge into patentable innovation is not entirely a surprise.

It can’t be an accident that countries with major ‘electronics and computing’ companies lead in patents. These companies do have researchers but they also buy startups to acquire patents. They (and ‘patent trolls’) will also file patents preemptively. For the patent trolls, it’s a moneymaking proposition and for the large companies, it’s a way of protecting their own interests and/or (I imagine) forcing a sale.

The mention of neuromorphic (brainlike) computing in the taxonomy section was surprising and puzzling. Up to this point, I’ve thought of neuromorphic computing as a kind of alternative or addition to standard computing but the authors have blurred the lines as per UNESCO’s definition of neurotechnology (specifically, “… emulate the structure and function of the neural systems of animals or human beings”) . Again, this report is broadening my understanding of neurotechnology. Of course, it required two instances before I quite grasped it, the definition and the taxonomy.

What’s puzzling is that neuromorphic engineering, a broader term that includes neuromorphic computing, isn’t used or mentioned. (For an explanation of the terms neuromorphic computing and neuromorphic engineering, there’s my June 23, 2023 posting, “Neuromorphic engineering: an overview.” )

The report

I won’t have time for everything. Here are some of the highlights from my admittedly personal perspective.

It’s not only about curing disease

From the report,

Neurotechnology’s applications however extend well beyond medicine [emphasis mine], and span from research, to education, to the workplace, and even people’s everyday life. Neurotechnology-based solutions may enhance learning and skill acquisition and boost focus through brain stimulation techniques. For instance, early research finds that brain- zapping caps appear to boost memory for at least one month (Berkeley, 2022). This could one day be used at home to enhance memory functions [emphasis mine]. They can further enable new ways to interact with the many digital devices we use in everyday life, transforming the way we work, live and interact. One example is the Sound Awareness wristband developed by a Stanford team (Neosensory, 2022) which enables individuals to “hear” by converting sound into tactile feedback, so that sound impaired individuals can perceive spoken words through their skin. Takagi and Nishimoto (2023) analyzed the brain scans taken through Magnetic Resonance Imaging (MRI) as individuals were shown thousands of images. They then trained a generative AI tool called Stable Diffusion2 on the brain scan data of the study’s participants, thus creating images that roughly corresponded to the real images shown. While this does not correspond to reading the mind of people, at least not yet, and some limitations of the study have been highlighted (Parshall, 2023), it nevertheless represents an important step towards developing the capability to interface human thoughts with computers [emphasis mine], via brain data interpretation.

While the above examples may sound somewhat like science fiction, the recent uptake of generative Artificial Intelligence applications and of large language models such as ChatGPT or Bard, demonstrates that the seemingly impossible can quickly become an everyday reality. At present, anyone can purchase online electroencephalogram (EEG) devices for a few hundred dollars [emphasis mine], to measure the electrical activity of their brain for meditation, gaming, or other purposes. [pp. 14-15]

This is very impressive achievement. Some of the research cited was published earlier this year (2023). The extraordinary speed is a testament to the efforts by the authors and their teams. It’s also a testament to how quickly the field is moving.

I’m glad to see the mention of and focus on consumer neurotechnology. (While the authors don’t speculate, I am free to do so.) Consumer neurotechnology could be viewed as one of the steps toward normalizing a cyborg future for all of us. Yes, we have books, television programmes, movies, and video games, which all normalize the idea but the people depicted have been severely injured and require the augmentation. With consumer neurotechnology, you have easily accessible devices being used to enhance people who aren’t injured, they just want to be ‘better’.

This phrase seemed particularly striking “… an important step towards developing the capability to interface human thoughts with computers” in light of some claims made by the Australian military in my June 13, 2023 posting “Mind-controlled robots based on graphene: an Australian research story.” (My posting has an embedded video demonstrating the Brain Robotic Interface (BRI) in action. Also, see the paragraph below the video for my ‘measured’ response.)

There’s no mention of the military in the report which seems more like a deliberate rather than inadvertent omission given the importance of military innovation where technology is concerned.

This section gives a good overview of government initiatives (in the report it’s followed by a table of the programmes),

Thanks to the promises it holds, neurotechnology has garnered significant attention from both governments and the private sector and is considered by many as an investment priority. According to the International Brain Initiative (IBI), brain research funding has become increasingly important over the past ten years, leading to a rise in large-scale state-led programs aimed at advancing brain intervention technologies(International Brain Initiative, 2021). Since 2013, initiatives such as the United States’ Brain Research Through Advancing Innovative Neurotechnologies (BRAIN) Initiative and the European Union’s Human Brain Project (HBP), as well as major national initiatives in China, Japan and South Korea have been launched with significant funding support from the respective governments. The Canadian Brain Research Strategy, initially operated as a multi- stakeholder coalition on brain research, is also actively seeking funding support from the government to transform itself into a national research initiative (Canadian Brain Research Strategy, 2022). A similar proposal is also seen in the case of the Australian Brain Alliance, calling for the establishment of an Australian Brain Initiative (Australian Academy of Science, n.d.). [pp. 15-16]

Privacy

There are some concerns such as these,

Beyond the medical realm, research suggests that emotional responses of consumers
related to preferences and risks can be concurrently tracked by neurotechnology, such
as neuroimaging and that neural data can better predict market-level outcomes than
traditional behavioral data (Karmarkar and Yoon, 2016). As such, neural data is
increasingly sought after in the consumer market for purposes such as digital
phenotyping4, neurogaming 5,and neuromarketing6 (UNESCO, 2021). This surge in demand gives rise to risks like hacking, unauthorized data reuse, extraction of privacy-sensitive information, digital surveillance, criminal exploitation of data, and other forms of abuse. These risks prompt the question of whether neural data needs distinct definition and safeguarding measures.

These issues are particularly relevant today as a wide range of electroencephalogram (EEG) headsets that can be used at home are now available in consumer markets for purposes that range from meditation assistance to controlling electronic devices through the mind. Imagine an individual is using one of these devices to play a neurofeedback game, which records the person’s brain waves during the game. Without the person being aware, the system can also identify the patterns associated with an undiagnosed mental health condition, such as anxiety. If the game company sells this data to third parties, e.g. health insurance providers, this may lead to an increase of insurance fees based on undisclosed information. This hypothetical situation would represent a clear violation of mental privacy and of unethical use of neural data.

Another example is in the field of advertising, where companies are increasingly interested in using neuroimaging to better understand consumers’ responses to their products or advertisements, a practice known as neuromarketing. For instance, a company might use neural data to determine which advertisements elicit the most positive emotional responses in consumers. While this can help companies improve their marketing strategies, it raises significant concerns about mental privacy. Questions arise in relation to consumers being aware or not that their neural data is being used, and in the extent to which this can lead to manipulative advertising practices that unfairly exploit unconscious preferences. Such potential abuses underscore the need for explicit consent and rigorous data protection measures in the use of neurotechnology for neuromarketing purposes. [pp. 21-22]

Legalities

Some countries already have laws and regulations regarding neurotechnology data,

At the national level, only a few countries have enacted laws and regulations to protect mental integrity or have included neuro-data in personal data protection laws (UNESCO, University of Milan-Bicocca (Italy) and State University of New York – Downstate Health Sciences University, 2023). Examples are the constitutional reform undertaken by Chile (Republic of Chile, 2021), the Charter for the responsible development of neurotechnologies of the Government of France (Government of France, 2022), and the Digital Rights Charter of the Government of Spain (Government of Spain, 2021). They propose different approaches to the regulation and protection of human rights in relation to neurotechnology. Countries such as the UK are also examining under which circumstances neural data may be considered as a special category of data under the general data protection framework (i.e. UK’s GDPR) (UK’s Information Commissioner’s Office, 2023) [p. 24]

As you can see, these are recent laws. There doesn’t seem to be any attempt here in Canada even though there is an act being reviewed in Parliament that could conceivably include neural data. This is from my May 1, 2023 posting,

Bill C-27 (Digital Charter Implementation Act, 2022) is what I believe is called an omnibus bill as it includes three different pieces of proposed legislation (the Consumer Privacy Protection Act [CPPA], the Artificial Intelligence and Data Act [AIDA], and the Personal Information and Data Protection Tribunal Act [PIDPTA]). [emphasis added July 11, 2023] You can read the Innovation, Science and Economic Development (ISED) Canada summary here or a detailed series of descriptions of the act here on the ISED’s Canada’s Digital Charter webpage.

My focus at the time was artificial intelligence and, now, after reading this UNESCO report and briefly looking at the Innovation, Science and Economic Development (ISED) Canada summary and a detailed series of descriptions of the act on ISED’s Canada’s Digital Charter webpage, I don’t see anything that specifies neural data but it’s not excluded either.

IP5 patents

Here’s the explanation (the footnote is included at the end of the excerpt),

IP5 patents represent a subset of overall patents filed worldwide, which have the
characteristic of having been filed in at least one top intellectual property offices (IPO)
worldwide (the so called IP5, namely the Chinese National Intellectual Property
Administration, CNIPA (formerly SIPO); the European Patent Office, EPO; the Japan
Patent Office, JPO; the Korean Intellectual Property Office, KIPO; and the United States
Patent and Trademark Office, USPTO) as well as another country, which may or may not be an IP5. This signals their potential applicability worldwide, as their inventiveness and industrial viability have been validated by at least two leading IPOs. This gives these patents a sort of “quality” check, also since patenting inventions is costly and if applicants try to protect the same invention in several parts of the world, this normally mirrors that the applicant has expectations about their importance and expected value. If we were to conduct the same analysis using information about individually considered patent applied worldwide, i.e. without filtering for quality nor considering patent families, we would risk conducting a biased analysis based on duplicated data. Also, as patentability standards vary across countries and IPOs, and what matters for patentability is the existence (or not) of prior art in the IPO considered, we would risk mixing real innovations with patents related to catching up phenomena in countries that are not at the forefront of the technology considered.

9 The five IP offices (IP5) is a forum of the five largest intellectual property offices in the world that was set up to improve the efficiency of the examination process for patents worldwide. The IP5 Offices together handle about 80% of the world’s patent applications, and 95% of all work carried out under the Patent Cooperation Treaty (PCT), see http://www.fiveipoffices.org. (Dernis et al., 2015) [p. 31]

AI assistance on this report

As noted earlier I have next to no experience with the analytical tools having not attempted this kind of work in several years. Here’s an example of what they were doing,

We utilize a combination of text embeddings based on Bidirectional Encoder
Representations from Transformer (BERT), dimensionality reduction, and hierarchical
clustering inspired by the BERTopic methodology 12 to identify latent themes within
research literature. Latent themes or topics in the context of topic modeling represent
clusters of words that frequently appear together within a collection of documents (Blei, 2012). These groupings are not explicitly labeled but are inferred through computational analysis examining patterns in word usage. These themes are ‘hidden’ within the text, only to be revealed through this analysis. …

We further utilize OpenAI’s GPT-4 model to enrich our understanding of topics’ keywords and to generate topic labels (OpenAI, 2023), thus supplementing expert review of the broad interdisciplinary corpus. Recently, GPT-4 has shown impressive results in medical contexts across various evaluations (Nori et al., 2023), making it a useful tool to enhance the information obtained from prior analysis stages, and to complement them. The automated process enhances the evaluation workflow, effectively emphasizing neuroscience themes pertinent to potential neurotechnology patents. Notwithstanding existing concerns about hallucinations (Lee, Bubeck and Petro, 2023) and errors in generative AI models, this methodology employs the GPT-4 model for summarization and interpretation tasks, which significantly mitigates the likelihood of hallucinations. Since the model is constrained to the context provided by the keyword collections, it limits the potential for fabricating information outside of the specified boundaries, thereby enhancing the accuracy and reliability of the output. [pp. 33-34]

I couldn’t resist adding the ChatGPT paragraph given all of the recent hoopla about it.

Multimodal neuromodulation and neuromorphic computing patents

I think this gives a pretty good indication of the activity on the patent front,

The largest, coherent topic, termed “multimodal neuromodulation,” comprises 535
patents detailing methodologies for deep or superficial brain stimulation designed to
address neurological and psychiatric ailments. These patented technologies interact with various points in neural circuits to induce either Long-Term Potentiation (LTP) or Long-Term Depression (LTD), offering treatment for conditions such as obsession, compulsion, anxiety, depression, Parkinson’s disease, and other movement disorders. The modalities encompass implanted deep-brain stimulators (DBS), Transcranial Magnetic Stimulation (TMS), and transcranial Direct Current Stimulation (tDCS). Among the most representative documents for this cluster are patents with titles: Electrical stimulation of structures within the brain or Systems and methods for enhancing or optimizing neural stimulation therapy for treating symptoms of Parkinson’s disease and or other movement disorders. [p.65]

Given my longstanding interest in memristors, which (I believe) have to a large extent helped to stimulate research into neuromorphic computing, this had to be included. Then, there was the brain-computer interfaces cluster,

A cluster identified as “Neuromorphic Computing” consists of 366 patents primarily
focused on devices designed to mimic human neural networks for efficient and adaptable computation. The principal elements of these inventions are resistive memory cells and artificial synapses. They exhibit properties similar to the neurons and synapses in biological brains, thus granting these devices the ability to learn and modulate responses based on rewards, akin to the adaptive cognitive capabilities of the human brain.

The primary technology classes associated with these patents fall under specific IPC
codes, representing the fields of neural network models, analog computers, and static
storage structures. Essentially, these classifications correspond to technologies that are key to the construction of computers and exhibit cognitive functions similar to human brain processes.

Examples for this cluster include neuromorphic processing devices that leverage
variations in resistance to store and process information, artificial synapses exhibiting
spike-timing dependent plasticity, and systems that allow event-driven learning and
reward modulation within neuromorphic computers.

In relation to neurotechnology as a whole, the “neuromorphic computing” cluster holds significant importance. It embodies the fusion of neuroscience and technology, thereby laying the basis for the development of adaptive and cognitive computational systems. Understanding this specific cluster provides a valuable insight into the progressing domain of neurotechnology, promising potential advancements across diverse fields, including artificial intelligence and healthcare.

The “Brain-Computer Interfaces” cluster, consisting of 146 patents, embodies a key aspect of neurotechnology that focuses on improving the interface between the brain and external devices. The technology classification codes associated with these patents primarily refer to methods or devices for treatment or protection of eyes and ears, devices for introducing media into, or onto, the body, and electric communication techniques, which are foundational elements of brain-computer interface (BCI) technologies.

Key patents within this cluster include a brain-computer interface apparatus adaptable to use environment and method of operating thereof, a double closed circuit brain-machine interface system, and an apparatus and method of brain-computer interface for device controlling based on brain signal. These inventions mainly revolve around the concept of using brain signals to control external devices, such as robotic arms, and improving the classification performance of these interfaces, even after long periods of non-use.

The inventions described in these patents improve the accuracy of device control, maintain performance over time, and accommodate multiple commands, thus significantly enhancing the functionality of BCIs.

Other identified technologies include systems for medical image analysis, limb rehabilitation, tinnitus treatment, sleep optimization, assistive exoskeletons, and advanced imaging techniques, among others. [pp. 66-67]

Having sections on neuromorphic computing and brain-computer interface patents in immediate proximity led to more speculation on my part. Imagine how much easier it would be to initiate a BCI connection if it’s powered with a neuromorphic (brainlike) computer/device. [ETA July 21, 2023: Following on from that thought, it might be more than just easier to initiate a BCI connection. Could a brainlike computer become part of your brain? Why not? it’s been successfully argued that a robotic wheelchair was part of someone’s body, see my January 30, 2013 posting and scroll down about 40% of the way.)]

Neurotech policy debates

The report concludes with this,

Neurotechnology is a complex and rapidly evolving technological paradigm whose
trajectories have the power to shape people’s identity, autonomy, privacy, sentiments,
behaviors and overall well-being, i.e. the very essence of what it means to be human.

Designing and implementing careful and effective norms and regulations ensuring that neurotechnology is developed and deployed in an ethical manner, for the good of
individuals and for society as a whole, call for a careful identification and characterization of the issues at stake. This entails shedding light on the whole neurotechnology ecosystem, that is what is being developed, where and by whom, and also understanding how neurotechnology interacts with other developments and technological trajectories, especially AI. Failing to do so may result in ineffective (at best) or distorted policies and policy decisions, which may harm human rights and human dignity.

Addressing the need for evidence in support of policy making, the present report offers first time robust data and analysis shedding light on the neurotechnology landscape worldwide. To this end, its proposes and implements an innovative approach that leverages artificial intelligence and deep learning on data from scientific publications and paten[t]s to identify scientific and technological developments in the neurotech space. The methodology proposed represents a scientific advance in itself, as it constitutes a quasi- automated replicable strategy for the detection and documentation of neurotechnology- related breakthroughs in science and innovation, to be repeated over time to account for the evolution of the sector. Leveraging this approach, the report further proposes an IPC-based taxonomy for neurotechnology which allows for a structured framework to the exploration of neurotechnology, to enable future research, development and analysis. The innovative methodology proposed is very flexible and can in fact be leveraged to investigate different emerging technologies, as they arise.

In terms of technological trajectories, we uncover a shift in the neurotechnology industry, with greater emphasis being put on computer and medical technologies in recent years, compared to traditionally dominant trajectories related to biotechnology and pharmaceuticals. This shift warrants close attention from policymakers, and calls for attention in relation to the latest (converging) developments in the field, especially AI and related methods and applications and neurotechnology.

This is all the more important and the observed growth and specialization patterns are unfolding in the context of regulatory environments that, generally, are either not existent or not fit for purpose. Given the sheer implications and impact of neurotechnology on the very essence of human beings, this lack of regulation poses key challenges related to the possible infringement of mental integrity, human dignity, personal identity, privacy, freedom of thought, and autonomy, among others. Furthermore, issues surrounding accessibility and the potential for neurotech enhancement applications triggers significant concerns, with far-reaching implications for individuals and societies. [pp. 72-73]

Last words about the report

Informative, readable, and thought-provoking. And, it helped broaden my understanding of neurotechnology.

Future endeavours?

I’m hopeful that one of these days one of these groups (UNESCO, Canadian Science Policy Centre, or ???) will tackle the issue of business bankruptcy in the neurotechnology sector. It has already occurred as noted in my ““Going blind when your neural implant company flirts with bankruptcy [long read]” April 5, 2022 posting. That story opens with a woman going blind in a New York subway when her neural implant fails. It’s how she found out the company, which supplied her implant was going out of business.

In my July 7, 2023 posting about the UNESCO July 2023 dialogue on neurotechnology, I’ve included information on Neuralink (one of Elon Musk’s companies) and its approval (despite some investigations) by the US Food and Drug Administration to start human clinical trials. Scroll down about 75% of the way to the “Food for thought” subhead where you will find stories about allegations made against Neuralink.

The end

If you want to know more about the field, the report offers a seven-page bibliography and there’s a lot of material here where you can start with this December 3, 2019 posting “Neural and technological inequalities” which features an article mentioning a discussion between two scientists. Surprisingly (to me), the source article is in Fast Company (a leading progressive business media brand), according to their tagline)..

I have two categories you may want to check: Human Enhancement and Neuromorphic Engineering. There are also a number of tags: neuromorphic computing, machine/flesh, brainlike computing, cyborgs, neural implants, neuroprosthetics, memristors, and more.

Should you have any observations or corrections, please feel free to leave them in the Comments section of this posting.

The 2023 Canadian federal budget: science & technology of health, the clean economy, reconciliation, and more (1 of 2)

The Canadian federal government released its 2023 budget on Tuesday, March 28, 2023. There were no flashy science research announcements in the budget. Trudeau and his team like to trumpet science initiatives and grand plans (even if they’re reannouncing something from a previous budget) but like last year—this year—not so much.

Consequently, this posting about the annual federal budget should have been shorter than usual. What happened?

Partly, it’s the military spending (chapter 5 of the budget in part 2 of this 2023 budget post). For those who are unfamiliar with the link between military scientific research and their impact on the general population, there are a number of inventions and innovations directly due to military research, e.g., plastic surgery, television, and the internet. (You can check a November 6, 2018 essay for The Conversation by Robert Kirby, Professor of Clinical Education and Surgery at Keele University, for more about the impact of World War 1 and medical research, “World War I: the birth of plastic surgery and modern anaesthesia.”)

So, there’s a lot to be found by inference. Consequently, I found Chapter 3 to also be unexpectedly rich in science and technology efforts.

Throughout both parts of this 2023 Canadian federal budget post, you will find excerpts from individual chapters of the federal budget followed my commentary directly after. My general commentary is reserved for the end.

Sometimes, I have included an item because it piqued my interest. E.g., Canadian agriculture is dependent on Russian fertilizer!!! News to me and I imagine many others. BTW, this budget aims to wean us from this dependency.

Chapter 2: Investing in Public Health Care and Affordable Dental Care

Here goes: from https://www.budget.canada.ca/2023/report-rapport/toc-tdm-en.html,

2.1 Investing in Public Health Care

Improving Canada’s Readiness for Health Emergencies

Vaccines and other cutting-edge life-science innovations have helped us to take control of the COVID-19 pandemic. To support these efforts, the federal government has committed significant funding towards the revitalization of Canada’s biomanufacturing sector through a Biomanufacturing and Life Sciences Strategy [emphasis mine]. To date, the government has invested more than $1.8 billion in 32 vaccine, therapeutic, and biomanufacturing projects across Canada, alongside $127 million for upgrades to specialized labs at universities across the country. Canada is building a life sciences ecosystem that is attracting major investments from leading global companies, including Moderna, AstraZeneca, and Sanofi.

To build upon the progress of the past three years, the government will explore new ways to be more efficient and effective in the development and production of the vaccines, therapies, and diagnostic tools that would be required for future health emergencies. As a first step, the government will further consult Canadian and international experts on how to best organize our readiness efforts for years to come. …

Gold rush in them thar life sciences

I have covered the rush to capitalize on Canadian life sciences research (with a special emphasis on British Columbia) in various posts including (amongst others): my December 30, 2020 posting “Avo Media, Science Telephone, and a Canadian COVID-19 billionaire scientist,” and my August 23, 2021 posting “Who’s running the life science companies’ public relations campaign in British Columbia (Vancouver, Canada)?” There’s also my August 20, 2021 posting “Getting erased from the mRNA/COVID-19 story,” highlighting how brutal the competition amongst these Canadian researchers can be.

Getting back to the 2023 budget, ‘The Biomanufacturing and Life Sciences Strategy’ mentioned in this latest budget was announced in a July 28, 2021 Innovation, Science and Economic Development Canada news release. You can find the strategy here and an overview of the strategy here. You may want to check out the overview as it features links to,

What We Heard Report: Results of the consultation on biomanufacturing and life sciences capacity in Canada

Ontario’s Strategy: Taking life sciences to the next level

Quebec’s Strategy: 2022–2025 Québec Life Sciences Strategy

Nova Scotia’s Strategy: BioFuture2030 Prince Edward Island’s Strategy:

The Prince Edward Island Bioscience Cluster [emphases mine]

2022 saw one government announcement concerning the strategy, from a March 3, 2022 Innovation, Science and Economic Development Canada news release, Note: Links have been removed,

Protecting the health and safety of Canadians and making sure we have the domestic capacity to respond to future health crises are top priorities of the Government of Canada. With the guidance of Canada’s Biomanufacturing and Life Sciences Strategy, the government is actively supporting the growth of a strong, competitive domestic life sciences sector, with cutting-edge biomanufacturing capabilities.

Today [March 3, 2022], the Honourable François-Philippe Champagne, Minister of Innovation, Science and Industry, announced a $92 million investment in adMare BioInnovations to drive company innovation, scale-up and training activities in Canada’s life sciences sector. This investment will help translate commercially promising health research into innovative new therapies and will see Canadian anchor companies provide the training required and drive the growth of Canada’s life science companies.

The real action took place earlier this month (March 2023) just prior to the budget. Oddly, I can’t find any mention of these initiatives in the budget document. (Confession: I have not given the 2023 budget a close reading although I have been through the whole budget once and viewed individual chapters more closely a few times.)

This March 2, 2023 (?) Tri-agency Institutional Programs Secretariat news release kicked things off, Note 1: I found the date at the bottom of their webpage; Note 2: Links have been removed,

The Government of Canada’s main priority continues to be protecting the health and safety of Canadians. Throughout the pandemic, the quick and decisive actions taken by the government meant that Canada was able to scale up domestic biomanufacturing capacity, which had been in decline for over 40 years. Since then, the government is rebuilding a strong and competitive biomanufacturing and life sciences sector brick by brick. This includes strengthening the foundations of the life sciences ecosystem through the research and talent of Canada’s world-class postsecondary institutions and research hospitals, as well as fostering increased collaboration with innovative companies.

Today [March 2, 2023?], the Honourable François-Philippe Champagne, Minister of Innovation, Science and Industry, and the Honourable Jean-Yves Duclos, Minister of Health, announced an investment of $10 million in support of the creation of five research hubs [emphasis mine]:

  • CBRF PRAIRIE Hub, led by the University of Alberta
  • Canada’s Immuno-Engineering and Biomanufacturing Hub, led by The University of British Columbia
  • Eastern Canada Pandemic Preparedness Hub, led by the Université de Montréal
  • Canadian Pandemic Preparedness Hub, led by the University of Ottawa and McMaster University
  • Canadian Hub for Health Intelligence & Innovation in Infectious Diseases, led by the University of Toronto

This investment, made through Stage 1 of the integrated Canada Biomedical Research Fund (CBRF) and Biosciences Research Infrastructure Fund (BRIF) competition, will bolster research and talent development efforts led by the institutions, working in collaboration with their partners. The hubs combine the strengths of academia, industry and the public and not-for-profit sectors to jointly improve pandemic readiness and the overall health and well-being of Canadians.

The multidisciplinary research hubs will accelerate the research and development of next-generation vaccines and therapeutics and diagnostics, while supporting training and development to expand the pipeline of skilled talent. The hubs will also accelerate the translation of promising research into commercially viable products and processes. This investment helps to strengthen the resilience of Canada’s life sciences sector by supporting leading Canadian research in innovative technologies that keep us safe and boost our economy.

Today’s [March 2, 2023?] announcement also launched Stage 2 of the CBRF-BRIF competition. This is a national competition that includes $570 million in available funding for proposals, aimed at cutting-edge research, talent development and research infrastructure projects associated with the selected research hubs. By strengthening research and talent capacity and leveraging collaborations across the entire biomanufacturing ecosystem, Canada will be better prepared to face future pandemics, in order to protect Canadian’s health and safety. 

Then, the Innovation, Science and Economic Development Canada’s March 9, 2023 news release made this announcement, Note: Links have been removed,

Since March 2020, major achievements have been made to rebuild a vibrant domestic life sciences ecosystem to protect Canadians against future health threats. The growth of the sector is a top priority for the Government of Canada, and with over $1.8 billion committed to 33 projects to boost our domestic biomanufacturing, vaccine and therapeutics capacity, we are strengthening our resiliency for current health emergencies and our readiness for future ones.

The COVID-19 Vaccine Task Force played a critical role in guiding and supporting the Government of Canada’s COVID-19 vaccine response. Today [March 9, 2023], recognizing the importance of science-based decisions, the Honourable François-Philippe Champagne, Minister of Innovation, Science and Industry, and the Honourable Jean-Yves Duclos, Minister of Health, are pleased to announce the creation of the Council of Expert Advisors (CEA). The 14 members of the CEA, who held their first official meeting earlier this week, will advise the Government of Canada on the long-term, sustainable growth of Canada’s biomanufacturing and life sciences sector, and on how to enhance our preparedness and capacity to protect the health and safety of Canadians.

The membership of the CEA comprises leaders with in-depth scientific, industrial, academic and public health expertise. The CEA co-chairs are Joanne Langley, Professor of Pediatrics and of Community Health and Epidemiology at the Dalhousie University Faculty of Medicine, and Division Head of Infectious Diseases at the IWK Health Centre; and Marco Marra, Professor in Medical Genetics at the University of British Columbia (UBC), UBC Canada Research Chair in Genome Science and distinguished scientist at the BC Cancer Foundation.

The CEA’s first meeting focused on the previous steps taken under Canada’s Biomanufacturing and Life Sciences Strategy and on its path forward. The creation of the CEA is an important milestone in the strategy, as it continues to evolve and adapt to new technologies and changing conditions in the marketplace and life sciences ecosystem. The CEA will also inform on investments that enhance capacity across Canada to support end-to-end production of critical vaccines, therapeutics and essential medical countermeasures, and to ensure that Canadians can reap the full economic benefits of the innovations developed, including well-paying jobs.

As I’m from British Columbia, I’m highlighting this University of British Columbia (UBC) March 17, 2023 news release about their involvement, Note: Links have been removed,

Canada’s biotech ecosystem is poised for a major boost with the federal government announcement today that B.C. will be home to Canada’s Immuno-Engineering and Biomanufacturing Hub (CIEBH).

The B.C.-based research and innovation hub, led by UBC, brings together a coalition of provincial, national and international partners to position Canada as a global epicentre for the development and manufacturing of next-generation immune-based therapeutics.

A primary goal of CIEBH is to establish a seamless drug development pipeline that will enable Canada to respond to future pandemics and other health challenges in fewer than 100 days.

This hub will build on the strengths of B.C.’s biotech and life sciences industry, and those of our national and global partners, to make Canada a world leader in the development of lifesaving medicines,” said Dr. Deborah Buszard, interim president and vice-chancellor of UBC. “It’s about creating a healthier future for all Canadians. Together with our outstanding alliance of partners, we will ensure Canada is prepared to respond rapidly to future health challenges with homegrown solutions.”

CIEBH is one of five new research hubs announced by the federal government that will work together to improve pandemic readiness and the overall health and well-being of Canadians. Federal funding of $570 million is available over the next four years to support project proposals associated with these hubs in order to advance Canada’s Biomanufacturing and Life Sciences Strategy.

More than 50 organizations representing the private, public, not-for-profit and academic sectors have come together to form the hub, creating a rich environment that will bolster biomedical innovation in Canada. Among these partners are leading B.C. biotech companies that played a key role in Canada’s COVID-19 pandemic response and are developing cutting-edge treatments for a range of human diseases.

CIEBH, led by UBC, will further align the critical mass of biomedical research strengths concentrated at B.C. academic institutions, including the B.C. Institute of Technology, Simon Fraser University and the University of Victoria, as well as the clinical expertise of B.C. research hospitals and health authorities. With linkages to key partners across Canada, including Dalhousie University, the University of Waterloo, and the Vaccine and Infectious Disease Organization, the hub will create a national network to address gaps in Canada’s drug development pipeline.

In recent decades, B.C. has emerged as a global leader in immuno-engineering, a field that is transforming how society treats disease by harnessing and modulating the immune system.

B.C. academic institutions and prominent Canadian companies like Precision NanoSystems, Acuitas Therapeutics and AbCellera have developed significant expertise in advanced immune-based therapeutics such as lipid nanoparticle- and mRNA-based vaccines, engineered antibodies, cell therapies and treatments for antimicrobial resistant infections. UBC professor Dr. Pieter Cullis, a member of CIEBH’s core scientific team, has been widely recognized for his pioneering work developing the lipid nanoparticle delivery technology that enables mRNA therapeutics such as the highly effective COVID-19 mRNA vaccines.

As noted previously, I’m a little puzzled that the federal government didn’t mention the investment in these hubs in their budget. They usually trumpet these kinds of initiatives.

On a related track, I’m even more puzzled that the province of British Columbia does not have its own life sciences research strategy in light of that sector’s success. Certainly it seems that Ontario, Quebec, Nova Scotia, and Prince Edward are all eager to get a piece of the action. Still, there is a Life Sciences in British Columbia: Sector Profile dated June 2020 and an undated (likely from some time between July 2017 to January 2020 when Bruce Ralston whose name is on the document was the relevant cabinet minister) British Columbia Technology and Innovation Policy Framework.

In case you missed the link earlier, see my August 23, 2021 posting “Who’s running the life science companies’ public relations campaign in British Columbia (Vancouver, Canada)?” which includes additional information about the BC life sciences sector, federal and provincial funding, the City of Vancouver’s involvement, and other related matters.

Chapter 3: A Made-In-Canada Plan: Affordable Energy, Good Jobs, and a Growing Clean Economy

The most science-focused information is in Chapter 3, from https://www.budget.canada.ca/2023/report-rapport/toc-tdm-en.html,

3.2 A Growing, Clean Economy

More than US$100 trillion in private capital is projected to be spent between now and 2050 to build the global clean economy.

Canada is currently competing with the United States, the European Union, and countries around the world for our share of this investment. To secure our share of this global investment, we must capitalize on Canada’s competitive advantages, including our skilled and diverse workforce, and our abundance of critical resources that the world needs.

The federal government has taken significant action over the past seven years to support Canada’s net-zero economic future. To build on this progress and support the growth of Canada’s clean economy, Budget 2023 proposes a range of measures that will encourage businesses to invest in Canada and create good-paying jobs for Canadian workers.

This made-in-Canada plan follows the federal tiered structure to incent the development of Canada’s clean economy and provide additional support for projects that need it. This plan includes:

  • Clear and predictable investment tax credits to provide foundational support for clean technology manufacturing, clean hydrogen, zero-emission technologies, and carbon capture and storage;
  • The deployment of financial instruments through the Canada Growth Fund, such as contracts for difference, to absorb certain risks and encourage private sector investment in low-carbon projects, technologies, businesses, and supply chains; and,
  • Targeted clean technology and sector supports delivered by Innovation, Science and Economic Development Canada to support battery manufacturing and further advance the development, application, and manufacturing of clean technologies.

Canada’s Potential in Critical Minerals

As a global leader in mining, Canada is in a prime position to provide a stable resource base for critical minerals [emphasis mine] that are central to major global industries such as clean technology, auto manufacturing, health care, aerospace, and the digital economy. For nickel and copper alone, the known reserves in Canada are more than 10 million tonnes, with many other potential sources at the exploration stage.

The Buy North American provisions for critical minerals and electric vehicles in the U.S. Inflation Reduction Act will create opportunities for Canada. In particular, U.S. acceleration of clean technology manufacturing will require robust supply chains of critical minerals that Canada has in abundance. However, to fully unleash Canada’s potential in critical minerals, we need to ensure a framework is in place to accelerate private investment.

Budget 2022 committed $3.8 billion for Canada’s Critical Minerals Strategy to provide foundational support to Canada’s mining sector to take advantage of these new opportunities. The Strategy was published in December 2022.

On March 24, 2023, the government launched the Critical Minerals Infrastructure Fund [emphasis mine; I cannot find a government announcement/news release for this fund]—a new fund announced in Budget 2022 that will allocate $1.5 billion towards energy and transportation projects needed to unlock priority mineral deposits. The new fund will complement other clean energy and transportation supports, such as the Canada Infrastructure Bank and the National Trade Corridors Fund, as well as other federal programs that invest in critical minerals projects, such as the Strategic Innovation Fund.

The new Investment Tax Credit for Clean Technology Manufacturing proposed in Budget 2023 will also provide a significant incentive to boost private investment in Canadian critical minerals projects and create new opportunities and middle class jobs in communities across the country.

An Investment Tax Credit for Clean Technology Manufacturing

Supporting Canadian companies in the manufacturing and processing of clean technologies, and in the extraction and processing of critical minerals, will create good middle class jobs for Canadians, ensure our businesses remain competitive in major global industries, and support the supply chains of our allies around the world.

While the Clean Technology Investment Tax Credit, first announced in Budget 2022, will provide support to Canadian companies adopting clean technologies, the Clean Technology Manufacturing Investment Tax Credit will provide support to Canadian companies that are manufacturing or processing clean technologies and their precursors.

  • Budget 2023 proposes a refundable tax credit equal to 30 per cent of the cost of investments in new machinery and equipment used to manufacture or process key clean technologies, and extract, process, or recycle key critical minerals, including:
    • Extraction, processing, or recycling of critical minerals essential for clean technology supply chains, specifically: lithium, cobalt, nickel, graphite, copper, and rare earth elements;
    • Manufacturing of renewable or nuclear energy equipment;
    • Processing or recycling of nuclear fuels and heavy water; [emphases mine]
    • Manufacturing of grid-scale electrical energy storage equipment;
    • Manufacturing of zero-emission vehicles; and,
    • Manufacturing or processing of certain upstream components and materials for the above activities, such as cathode materials and batteries used in electric vehicles.

The investment tax credit is expected to cost $4.5 billion over five years, starting in 2023-24, and an additional $6.6 billion from 2028-29 to 2034-35. The credit would apply to property that is acquired and becomes available for use on or after January 1, 2024, and would no longer be in effect after 2034, subject to a phase-out starting in 2032.

3.4 Reliable Transportation and Resilient Infrastructure

Supporting Resilient Infrastructure Through Innovation

The Smart Cities Challenge [emphasis mine] was launched in 2017 to encourage cities to adopt new and innovative approaches to improve the quality of life for their residents. The first round of the Challenge resulted in $75 million in prizes across four winning applicants: Montreal, Quebec; Guelph, Ontario; communities of Nunavut; and Bridgewater, Nova Scotia.

New and innovative solutions are required to help communities reduce the risks and impacts posed by weather-related events and disasters triggered by climate change. To help address this issue, the government will be launching a new round of the Smart Cities Challenge later this year, which will focus on using connected technologies, data, and innovative approaches to improve climate resiliency.

3.5 Investing in Tomorrow’s Technology

With the best-educated workforce on earth, world-class academic and research institutions, and robust start-up ecosystems across the country, Canada’s economy is fast becoming a global technology leader – building on its strengths in areas like artificial intelligence. Canada is already home to some of the top markets for high-tech careers in North America, including the three fastest growing markets between 2016 and 2021: Vancouver, Toronto, and Quebec City.

However, more can be done to help the Canadian economy reach its full potential. Reversing a longstanding trend of underinvestment in research and development by Canadian business [emphasis mine] is essential our long-term economic growth.

Budget 2023 proposes new measures to encourage business innovation in Canada, as well as new investments in college research and the forestry industry that will help to build a stronger and more innovative Canadian economy.

Attracting High-Tech Investment to Canada

In recent months, Canada has attracted several new digital and high-tech projects that will support our innovative economy, including:

  • Nokia: a $340 million project that will strengthen Canada’s position as a leader in 5G and digital innovation;
  • Xanadu Quantum Technologies: a $178 million project that will support Canada’s leadership in quantum computing;
  • Sanctuary Cognitive Systems Corporation: a $121 million project that will boost Canada’s leadership in the global Artificial Intelligence market; and,
  • EXFO: a $77 million project to create a 5G Centre of Excellence that aims to develop one of the world’s first Artificial Intelligence-based automated network solutions.

Review of the Scientific Research and Experimental Development Tax Incentive Program

The Scientific Research and Experimental Development (SR&ED) tax incentive program continues to be a cornerstone of Canada’s innovation strategy by supporting research and development with the goal of encouraging Canadian businesses of all sizes to invest in innovation that drives economic growth.

In Budget 2022, the federal government announced its intention to review the SR&ED program to ensure it is providing adequate support and improving the development, retention, and commercialization of intellectual property, including the consideration of adopting a patent box regime. [emphasis mine] The Department of Finance will continue to engage with stakeholders on the next steps in the coming months.

Modernizing Canada’s Research Ecosystem

Canada’s research community and world-class researchers solve some of the world’s toughest problems, and Canada’s spending on higher education research and development, as a share of GDP, has exceeded all other G7 countries. 

Since 2016, the federal government has committed more than $16 billion of additional funding to support research and science across Canada. This includes:

  • Nearly $4 billion in Budget 2018 for Canada’s research system, including $2.4 billion for the Canada Foundation for Innovation and the granting councils—the Natural Sciences and Engineering Research Council of Canada, the Social Sciences and Humanities Research Council of Canada and the Canadian Institutes of Health Research; [emphases mine]
  • More than $500 million in Budget 2019 in total additional support to third-party research and science organizations, in addition to the creation of the Strategic Science Fund, which will announce successful recipients later this year;
  • $1.2 billion in Budget 2021 for Pan-Canadian Genomics and Artificial Intelligence Strategies, and a National Quantum Strategy;
  • $1 billion in Budget 2021 to the granting councils and the Canada Foundation for Innovation for life sciences researchers and infrastructure; and,
  • The January 2023 announcement of Canada’s intention to become a full member in the Square Kilometre Array Observatory, which will provide Canadian astronomers with access to its ground-breaking data. The government is providing up to $269.3 million to support this collaboration.

In order to maintain Canada’s research strength—and the knowledge, innovations, and talent it fosters—our systems to support science and research must evolve. The government has been consulting with stakeholders, including through the independent Advisory Panel on the Federal Research Support System, to seek advice from research leaders on how to further strengthen Canada’s research support system.

The government is carefully considering the Advisory Panel’s advice, with more detail to follow in the coming months on further efforts to modernize the system.

Using College Research to Help Businesses Grow

Canada’s colleges, CEGEPs, and polytechnic institutes use their facilities, equipment, and expertise to solve applied research problems every day. Students at these institutions are developing the skills they need to start good careers when they leave school, and by partnering with these institutions, businesses can access the talent and the tools they need to innovate and grow.

  • To help more Canadian businesses access the expertise and research and development facilities they need, Budget 2023 proposes to provide $108.6 million over three years, starting in 2023-24, to expand the College and Community Innovation Program, administered by the Natural Sciences and Engineering Research Council.

Supporting Canadian Leadership in Space

For decades, Canada’s participation in the International Space Station has helped to fuel important scientific advances, and showcased Canada’s ability to create leading-edge space technologies, such as Canadarm2. Canadian space technologies have inspired advances in other fields, such as the NeuroArm, the world’s first robot capable of operating inside an MRI, making previously impossible surgeries possible.

  • Budget 2023 proposes to provide $1.1 billion [emphasis mine] over 14 years, starting in 2023-24, on a cash basis, to the Canadian Space Agency [emphasis mine] to continue Canada’s participation in the International Space Station until 2030.

Looking forward, humanity is returning to the moon [emphasis mine]. Canada intends to join these efforts by contributing a robotic lunar utility vehicle to perform key activities in support of human lunar exploration. Canadian participation in the NASA-led Lunar Gateway station—a space station that will orbit the moon—also presents new opportunities for innovative advances in science and technology. Canada is providing Canadarm3 to the Lunar Gateway, and a Canadian astronaut will join Artemis II, the first crewed mission to the moon since 1972. In Budget 2023, the government is providing further support to assist these missions.

  • Budget 2023 proposes to provide $1.2 billion [emphasis mine] over 13 years, starting in 2024-25, to the Canadian Space Agency to develop and contribute a lunar utility vehicle to assist astronauts on the moon.
  • Budget 2023 proposes to provide $150 million [emphasis mine[ over five years, starting in 2023-24, to the Canadian Space Agency for the next phase of the Lunar Exploration Accelerator Program to support the Canada’s world-class space industry and help accelerate the development of new technologies.
  • Budget 2023 also proposes to provide $76.5 million [emphasis mine] over eight years, starting in 2023-24, on a cash basis, to the Canadian Space Agency in support of Canadian science on the Lunar Gateway station.

Investing in Canada’s Forest Economy

The forestry sector plays an important role in Canada’s natural resource economy [emphasis mine], and is a source of good careers in many rural communities across Canada, including Indigenous communities. As global demand for sustainable forest products grows, continued support for Canada’s forestry sector will help it innovate, grow, and support good middle class jobs for Canadians.

  • Budget 2023 proposes to provide $368.4 million over three years, starting in 2023-24, with $3.1 million in remaining amortization, to Natural Resources Canada to renew and update forest sector support, including for research and development, Indigenous and international leadership, and data. Of this amount, $30.1 million would be sourced from existing departmental resources.

Establishing the Dairy Innovation and Investment Fund

The dairy sector is facing a growing surplus of solids non-fat (SNF) [emphasis mine], a by-product of dairy processing. Limited processing capacity for SNF results in lost opportunities for dairy processors and farmers.

  • Budget 2023 proposes to provide $333 million over ten years, starting in 2023-24, for Agriculture and Agri-Food Canada to support investments in research and development of new products based on SNF, market development for these products, and processing capacity for SNF-based products more broadly.

Supporting Farmers for Diversifying Away from Russian Fertilizers

Russia’s illegal invasion of Ukraine has resulted in higher prices for nitrogen fertilizers, which has had a notable impact on Eastern Canadian farmers who rely heavily on imported fertilizer.

  • Budget 2023 proposes to provide $34.1 million over three years, starting in 2023-24, to Agriculture and Agri-Food Canada’s On-Farm Climate Action Fund to support adoption of nitrogen management practices by Eastern Canadian farmers, that will help optimize the use and reduce the need for fertilizer.

Providing Interest Relief for Agricultural Producers

Farm production costs have increased in Canada and around the world, including as a result Russia’s illegal invasion of Ukraine and global supply chain disruptions. It is important that Canada’s agricultural producers have access to the cash flow they need to cover these costs until they sell their products.

  • Budget 2023 proposes to provide $13 million in 2023-24 to Agriculture and Agri-Food Canada to increase the interest-free limit for loans under the Advance Payments Program from $250,000 to $350,000 for the 2023 program year.

Additionally, the government will consult with provincial and territorial counterparts to explore ways to extend help to small agricultural producers who demonstrate urgent financial need.

Maintaining Livestock Sector Exports with a Foot-and-Mouth Disease Vaccine Bank

Foot-and-Mouth Disease (FMD) is a highly transmissible illness that can affect cattle, pigs, and other cloven-hoofed animals. Recent outbreaks in Asia and Africa have increased the risk of global spread, and a FMD outbreak in Canada would cut off exports for all livestock sectors, with major economic implications. However, the impact of a potential outbreak would be significantly reduced with the early vaccination of livestock. 

  • Budget 2023 proposes to provide $57.5 million over five years, starting in 2023-24, with $5.6 million ongoing, to the Canadian Food Inspection Agency to establish a FMD vaccine bank for Canada, and to develop FMD response plans. The government will seek a cost-sharing arrangement with provinces and territories.

Canadian economic theory (the staples theory), mining, nuclear energy, quantum science, and more

Critical minerals are getting a lot of attention these days. (They were featured in the 2022 budget, see my April 19, 2022 posting, scroll down to the Mining subhead.) This year, US President Joe Biden, in his first visit to Canada as President, singled out critical minerals at the end of his 28 hour state visit (from a March 24, 2023 CBC news online article by Alexander Panetta; Note: Links have been removed),

There was a pot of gold at the end of President Joe Biden’s jaunt to Canada. It’s going to Canada’s mining sector.

The U.S. military will deliver funds this spring to critical minerals projects in both the U.S. and Canada. The goal is to accelerate the development of a critical minerals industry on this continent.

The context is the United States’ intensifying rivalry with China.

The U.S. is desperate to reduce its reliance on its adversary for materials needed to power electric vehicles, electronics and many other products, and has set aside hundreds of millions of dollars under a program called the Defence Production Act.

The Pentagon already has told Canadian companies they would be eligible to apply. It has said the cash would arrive as grants, not loans.

On Friday [March 24, 2023], before Biden left Ottawa, he promised they’ll get some.

The White House and the Prime Minister’s Office announced that companies from both countries will be eligible this spring for money from a $250 million US fund.

Which Canadian companies? The leaders didn’t say. Canadian officials have provided the U.S. with a list of at least 70 projects that could warrant U.S. funding.

“Our nations are blessed with incredible natural resources,” Biden told Canadian parliamentarians during his speech in the House of Commons.

Canada in particular has large quantities of critical minerals [emphasis mine] that are essential for our clean energy future, for the world’s clean energy future.

I don’t believe that Joe Biden has ever heard of the Canadian academic Harold Innis (neither have most Canadians) but Biden is echoing a rather well known theory, in some circles, about Canada’s economy (from the Harold Innis Wikipedia entry),

Harold Adams Innis FRSC (November 5, 1894 – November 9, 1952) was a Canadian professor of political economy at the University of Toronto and the author of seminal works on media, communication theory, and Canadian economic history. He helped develop the staples thesis, which holds that Canada’s culture, political history, and economy have been decisively influenced by the exploitation and export of a series of “staples” such as fur, fish, lumber, wheat, mined metals, and coal. The staple thesis dominated economic history in Canada from the 1930s to 1960s, and continues to be a fundamental part of the Canadian political economic tradition.[8] [all emphases mine]

The staples theory is referred to informally as “hewers of wood and drawers of water.”

Critical Minerals Infrastructure Fund

I cannot find an announcement for this fund (perhaps it’s a US government fund?) but there is a March 7, 2023 Natural Resources Canada news release, Note: A link has been removed,

Simply put, our future depends on critical minerals. The Government of Canada is committed to investing in this future, which is why the Canadian Critical Minerals Strategy — launched by the Honourable Jonathan Wilkinson, Minister of Natural Resources, in December 2022 — is backed by up to $3.8 billion in federal funding. [emphases mine] Today [March 7, 2023], Minister Wilkinson announced more details on the implementation of this Strategy. Over $344 million in funding is supporting the following five new programs and initiatives:

  • Critical Minerals Technology and Innovation Program – $144.4 million for the research, development, demonstration, commercialization and adoption of new technologies and processes that support sustainable growth in Canadian critical minerals value chains and associated innovation ecosystems. 
  • Critical Minerals Geoscience and Data Initiative – $79.2 million to enhance the quality and availability of data and digital technologies to support geoscience and mapping that will accelerate the efficient and effective development of Canadian critical minerals value chains, including by identifying critical minerals reserves and developing pathways for sustainable mineral development. 
  • Global Partnerships Program – $70 million to strengthen Canada’s global leadership role in enhancing critical minerals supply chain resiliency through international collaborations related to critical minerals. 
  • Northern Regulatory Initiative – $40 million to advance Canada’s northern and territorial critical minerals agenda by supporting regulatory dialogue, regional studies, land-use planning, impact assessments and Indigenous consultation.
  • Renewal of the Critical Minerals Centre of Excellence (CMCE) – $10.6 million so the CMCE can continue the ongoing development and implementation of the Canadian Critical Minerals Strategy.

Commentary from the mining community

Mariaan Webb wrote a March 29,2023 article about the budget and the response from the mining community for miningweekly.com, Note: Links have been removed,

The 2023 Budget, delivered by Finance Minister Chrystia Freeland on Tuesday, bolsters the ability of the Canadian mining sector to deliver for the country, recognising the industry’s central role in enabling the transition to a net-zero economy, says Mining Association of Canada (MAC) president and CEO Pierre Gratton.

“Without mining, there are no electric vehicles, no clean power from wind farms, solar panels or nuclear energy, [emphasis mine] and no transmission lines,” said Gratton.

What kind of nuclear energy?

There are two kinds of nuclear energy: fission and fusion. (Fission is the one where the atom is split and requires minerals. Fusion energy is how stars are formed. Much less polluting than fission energy, at this time it is not a commercially viable option nor is it close to being so.)

As far as I’m aware, fusion energy does not require any mined materials. So, Gratton appears to be referring to fission nuclear energy when he’s talking about the mining sector and critical minerals.

I have an October 28, 2022 posting, which provides an overview of fusion energy and the various projects designed to capitalize on it.

Smart Cities in Canada

I was happy to be updated on the Smart Cities Challenge. When I last wrote about it (a March 20, 2018 posting; scroll down to the “Smart Cities, the rest of the country, and Vancouver” subhead). I notice that the successful applicants are from Montreal, Quebec; Guelph, Ontario; communities of Nunavut; and Bridgewater, Nova Scotia. It’s about time northern communities got some attention. It’s hard not to notice that central Canada (i.e., Ontario and Quebec) again dominates.

I look forward to hearing more about the new, upcoming challenge.

The quantum crew

I first made note of what appears to be a fracture in the Canadian quantum community in a May 4, 2021 posting (scroll down to the National Quantum Strategy subhead) about the 2021 budget. I made note of it again in a July 26, 2022 posting (scroll down to the Canadian quantum scene subhead).

In my excerpts from the 3.5 Investing in Tomorrow’s Technology section of the 2023 budget, Xanadu Quantum Technologies, headquartered in Toronto, Ontario is singled out with three other companies (none of which are in the quantum computing field). Oddly, D-Wave Systems (located in British Columbia), which as far as I’m aware is the star of Canada’s quantum computing sector, has yet to be singled out in any budget I’ve seen yet. (I’m estimating I’ve reviewed about 10 budgets.)

Canadians in space

Shortly after the 2023 budget was presented, Canadian astronaut Jeremy Hansen was revealed as one of four astronauts to go on a mission to orbit the moon. From a Canadian Broadcasting (CBC) April 3, 2023 news online article by Nicole Mortillaro (Note: A link has been removed),

Jeremy Hansen is heading to the moon.

The 47-year old Canadian astronaut was announced today as one of four astronauts — along with Christina Koch, Victor Glover and Reid Wiseman — who will be part of NASA’s [US National Aeronautics and Space Administration] Artemis II mission.

Hansen was one of four active Canadian astronauts that included Jennifer Sidey-Gibbons, Joshua Kutryk and David Saint-Jacques vying for a seat on the Orion spacecraft set to orbit the moon.

Artemis II is the second step in NASA’s mission to return astronauts to the surface of the moon. 

The astronauts won’t be landing, but rather they will orbit for 10 days in the Orion spacecraft, testing key components to prepare for Artemis III that will place humans back on the moon some time in 2025 for the first time since 1972.

Canada gets a seat on Artemis II due to its contributions to Lunar Gateway, a space station that will orbit the moon. But Canada is also building a lunar rover provided by Canadensys Aerospace.

On Monday [April 3, 2023], Hansen noted there are two reasons a Canadian is going to the moon, adding that it “makes me smile when I say that.”

The first, he said, is American leadership, and the decision to curate an international team.

“The second reason is Canada’s can-do attitude,” he said proudly.

In addition to our ‘can-do attitude,” we’re also spending some big money, i.e., the Canadian government has proposed in its 2023 budget some $2.5B to various space and lunar efforts over the next several years.

Chapter 3 odds and sods

First seen in the 2022 budget, the patent box regime makes a second appearance in the 2023 budget where apparently ‘stakeholders will be engaged’ later this year. At least, they’re not rushing into this. (For the original announcement and an explanation of a patent box regime, see my April 19, 2022 budget review; scroll down to the Review of Tax Support to R&D and Intellectual Property subhead.)

I’m happy to see the Dairy Innovation and Investment Fund. I’m particularly happy to see a focus on finding uses for solids non-fat (SNF) by providing “$333 million over ten years, starting in 2023-24, … research and development of new products based on SNF [emphasis mine], market development for these products, and processing capacity for SNF-based products more broadly.”

This investment contrasts with the approach to cellulose nanocrystals (CNC) derived from wood (i.e., the forest economy), where the Canadian government invested heavily in research and even opened a production facility under the auspices of a company, CelluForce. It was a little problematic.

By 2013, the facility had a stockpile of CNC and nowhere to sell it. That’s right, no market for CNC as there had been no product development. (See my May 8, 2012 posting where that lack is mentioned, specifically there’s a quote from Tim Harper in an excerpted Globe and Mail article. My August 17, 2016 posting notes that the stockpile was diminishing. The CelluForce website makes no mention of it now in 2023.)

It’s good to see the government emphasis on research into developing products for SNFs especially after the CelluForce stockpile and in light of US President Joe Biden’s recent enthusiasm over our critical minerals.

Chapter 4: Advancing Reconciliation and Building a Canada That Works for Everyone

Chapter 4: Advancing Reconciliation and Building a Canada That Works for Everyone offers this, from https://www.budget.canada.ca/2023/report-rapport/toc-tdm-en.html,

4.3 Clean Air and Clean Water

Progress on Biodiversity

Montreal recently hosted the Fifteenth Conference of the Parties (COP15) to the United Nations Convention on Biological Diversity, which led to a new Post-2020 Global Biodiversity Framework. During COP15, Canada announced new funding for biodiversity and conservation measures at home and abroad that will support the implementation of the Global Biodiversity Framework, including $800 million to support Indigenous-led conservation within Canada through the innovative Project Finance for Permanence model.

Protecting Our Freshwater

Canada is home to 20 per cent of the world’s freshwater supply. Healthy lakes and rivers are essential to Canadians, communities, and businesses across the country. Recognizing the threat to freshwater caused by climate change and pollution, the federal government is moving forward to establish a new Canada Water Agency and make major investments in a strengthened Freshwater Action Plan.

  • Budget 2023 proposes to provide $650 million over ten years, starting in 2023-24, to support monitoring, assessment, and restoration work in the Great Lakes, Lake Winnipeg, Lake of the Woods, St. Lawrence River, Fraser River, Saint John River, Mackenzie River, and Lake Simcoe. Budget 2023 also proposes to provide $22.6 million over three years, starting in 2023-24, to support better coordination of efforts to protect freshwater across Canada.
  • Budget 2023 also proposes to provide $85.1 million over five years, starting in 2023-24, with $0.4 million in remaining amortization and $21 million ongoing thereafter to support the creation of the Canada Water Agency [emphasis mine], which will be headquartered in Winnipeg. By the end of 2023, the government will introduce legislation that will fully establish the Canada Water Agency as a standalone entity.

Cleaner and Healthier Ports

Canada’s ports are at the heart of our supply chains, delivering goods to Canadians and allowing our businesses to reach global markets. As rising shipping levels enable and create economic growth and good jobs, the federal government is taking action to protect Canada’s coastal ecosystems and communities.

  • Budget 2023 proposes to provide $165.4 million over seven years, starting in 2023-24, to Transport Canada to establish a Green Shipping Corridor Program to reduce the impact of marine shipping on surrounding communities and ecosystems. The program will help spur the launch of the next generation of clean ships, invest in shore power technology, and prioritize low-emission and low-noise vessels at ports.

Water, water everywhere

I wasn’t expecting to find mention of establishing a Canada Water Agency and details are sketchy other than, It will be in Winnipeg, Manitoba and there will be government funding. Fingers crossed that this agency will do some good work (whatever that might be). Personally, I’d like to see some action with regard to droughts.

In British Columbia (BC) where I live and which most of us think of as ‘water rich’, is suffering under conditions such that our rivers and lakes are at very low levels according to an April 6, 2023 article by Glenda Luymes for the Vancouver Sun (print version, p. A4),

On the North American WaterWatch map, which codes river flows using a series of coloured dots, high flows are represented in various shades of blue while low flows are represented in red hues. On Wednesday [April 5, 2023], most of BC was speckled red, brown and orange, with the majority of the province’s rivers flowing “much below normal.”

“It does not bode well for the fish populations,” said Marvin Rosenau, a fisheries and ecosystems instructor at BCIT [British Columbia Institute of Technology]. …

Rosenau said low water last fall [2022], when much of BC was in the grip of drought, decreased salmon habitat during spawning season. …

BC has already seen small early season wildfires, including one near Merritt last weekend [April 1/2, 2023]. …

Getting back to the Canada Water Agency, there’s this March 29, 2023 CBC news online article by Bartley Kives,

The 2023 federal budget calls for a new national water agency to be based in Winnipeg, provided Justin Trudeau’s Liberal government remains in power long enough to see it established [emphasis mine] in the Manitoba capital.

The budget announced on Tuesday [March 28, 2023] calls for the creation of the Canada Water Agency, a new federal entity with a headquarters in Winnipeg.

While the federal government is still determining precisely what the new agency will do, one Winnipeg-based environmental organization expects it to become a one-stop shop for water science, water quality assessment and water management [emphasis mine].

“This is something that we don’t actually have in this country at the moment,” said Matt McCandless, a vice-president for the non-profit International Institute for Sustainable Development.

Right now, municipalities, provinces and Indigenous authorities take different approaches to managing water quality, water science, flooding and droughts, said McCandless, adding a national water agency could provide more co-ordination.

For now, it’s unknown how many employees will be based at the Canada Water Agency’s Winnipeg headquarters. According to the budget, legislation to create the agency won’t be introduced until later this year [emphasis mine].

That means the Winnipeg headquarters likely won’t materialize before 2024, one year before the Trudeau minority government faces re-election, assuming it doesn’t lose the confidence of the House of Commons beforehand [emphasis mine].

Nonetheless, several Canadian cities and provinces were vying for the Canada Water Agency’s headquarters, including Manitoba.

The budget also calls for $65 million worth of annual spending on lake science and restoration, with an unstated fraction of that cash devoted to Lake Winnipeg.

McCandless calls the spending on water science an improvement over previous budgets.

Kives seems a tad jaundiced but you get that way (confession: I have too) when covering government spending promises.

Part 2 (military spending and general comments) will be posted sometime during the week of April 24-28, 2023.

Canadian copyright quietly extended

As of December 30, 2022, Canadian copyright (one of the three elements of intellectual property; the other two: patents and trademarks) will be extended for another 20 years.

Mike Masnick in his November 29, 2022 posting on Techdirt explains why this is contrary to the intentions for establishing copyright in the first place, Note: Links have been removed,

… it cannot make sense to extend copyright terms retroactively. The entire point of copyright law is to provide a limited monopoly on making copies of the work as an incentive to get the work produced. Assuming the work was produced, that says that the bargain that was struck was clearly enough of an incentive for the creator. They were told they’d receive that period of exclusivity and thus they created the work.

Going back and retroactively extending copyright then serves no purpose. Creators need no incentive for works already created. The only thing it does is steal from the public. That’s because the “deal” setup by governments creating copyright terms is between the public (who is temporarily stripped of their right to share knowledge freely) and the creator. But if we extend copyright term retroactively, the public then has their end of the bargain (“you will be free to share these works freely after such-and-such a date”) changed, with no recourse or compensation.

Canada has quietly done it: extending copyrights on literary, dramatic or musical works and engravings from life of the author plus 50 years year to life of the author plus 70 years. [emphasis mine]

Masnick pointed to a November 23, 2022 posting by Andrea on the Internet Archive Canada blog for how this will affect the Canadian public,

… we now know that this date has been fixed as December 30, 2022, meaning that no new works will enter the Canadian public domain for the next 20 years.

A whole generation of creative works will remain under copyright. This might seem like a win for the estates of popular, internationally known authors, but what about more obscure Canadian works and creators? With circulation over time often being the indicator of ‘value’, many 20th century works are being deselected from physical library collections. …

Edward A. McCourt (1907-1972) is an example of just one of these Canadian creators. Raised in Alberta and a graduate of the University of Alberta, Edward went on to be a Rhodes Scholar in 1932. In 1980, Winnifred Bogaards wrote that:

“[H]e recorded over a period of thirty years his particular vision of the prairies, the region of Canada which had irrevocably shaped his own life. In that time he published five novels and forty-three short stories set (with some exceptions among the earliest stories) in Western Canada, three juvenile works based on the Riel Rebellion, a travel book on Saskatchewan, several radio plays adapted from his western stories, The Canadian West in Fiction (the first critical study of the literature of the prairies), and a biography of the 19th century English soldier and adventurer, Sir William F. Butler… “

In Bogaards’ analysis of his work, “Edward McCourt: A Reassessment” published in the journal Studies in Canadian Literature, she notes that while McCourt has suffered in obscurity, he is often cited along with his contemporaries Hugh MacLennan, Robertson Davies and Irving Layton; Canadian literary stars. Incidentally, we will also wait an additional 20 years for their works to enter the public domain. The work of Rebecca Giblin, Jacob Flynn, and Francois Petitjean, looking at ‘What Happens When Books Enter the Public Domain?’ is relevant here. Their study shows concretely and empirically that extending copyright has no benefit to the public at all, and only benefits a very few wealthy, well known estates and companies. This term extension will not encourage the publishers of McCourt’s works to invest in making his writing available to a new generation of readers.

This 20 year extension can trace its roots to the trade agreement between the US, Mexico, and Canada (USMCA) that replaced the previous North American Free Trade Agreement (NAFTA), as of July 1, 2020. This is made clear in Michael Geist’s May 2, 2022 Law Bytes podcast where he discusses with Lucie Guibault the (then proposed) Canadian extension in the context of international standards,

Lucie Guibault is an internationally renowned expert on international copyright law, a Professor of Law and Associate Dean at Schulich School of Law at Dalhousie University, and the Associate Director of the school’s Law and Technology Institute.

It’s always good to get some context and in that spirit, here’s more from Michael Geist’s May 2, 2022 Law Bytes podcast,

… Despite recommendations from its own copyright review, students, teachers, librarians, and copyright experts to include a registration requirement [emphasis mine] for the additional 20 years of protection, the government chose to extend term without including protection to mitigate against the harms.

Geist’s podcast discussion with Guibault, where she explains what a ‘registration requirement’ is and how it would work plus more, runs for almost 27 mins. (May 2, 2022 Law Bytes podcast). One final comment, visual artists and musicians are also affected by copyright rules.

FrogHeart’s 2022 comes to an end as 2023 comes into view

I look forward to 2023 and hope it will be as stimulating as 2022 proved to be. Here’s an overview of the year that was on this blog:

Sounds of science

It seems 2022 was the year that science discovered the importance of sound and the possibilities of data sonification. Neither is new but this year seemed to signal a surge of interest or maybe I just happened to stumble onto more of the stories than usual.

This is not an exhaustive list, you can check out my ‘Music’ category for more here. I have tried to include audio files with the postings but it all depends on how accessible the researchers have made them.

Aliens on earth: machinic biology and/or biological machinery?

When I first started following stories in 2008 (?) about technology or machinery being integrated with the human body, it was mostly about assistive technologies such as neuroprosthetics. You’ll find most of this year’s material in the ‘Human Enhancement’ category or you can search the tag ‘machine/flesh’.

However, the line between biology and machine became a bit more blurry for me this year. You can see what’s happening in the titles listed below (you may recognize the zenobot story; there was an earlier version of xenobots featured here in 2021):

This was the story that shook me,

Are the aliens going to come from outer space or are we becoming the aliens?

Brains (biological and otherwise), AI, & our latest age of anxiety

As we integrate machines into our bodies, including our brains, there are new issues to consider:

  • Going blind when your neural implant company flirts with bankruptcy (long read) April 5, 2022 posting
  • US National Academies Sept. 22-23, 2022 workshop on techno, legal & ethical issues of brain-machine interfaces (BMIs) September 21, 2022 posting

I hope the US National Academies issues a report on their “Brain-Machine and Related Neural Interface Technologies: Scientific, Technical, Ethical, and Regulatory Issues – A Workshop” for 2023.

Meanwhile the race to create brainlike computers continues and I have a number of posts which can be found under the category of ‘neuromorphic engineering’ or you can use these search terms ‘brainlike computing’ and ‘memristors’.

On the artificial intelligence (AI) side of things, I finally broke down and added an ‘artificial intelligence (AI) category to this blog sometime between May and August 2021. Previously, I had used the ‘robots’ category as a catchall. There are other stories but these ones feature public engagement and policy (btw, it’s a Canadian Science Policy Centre event), respectively,

  • “The “We are AI” series gives citizens a primer on AI” March 23, 2022 posting
  • “Age of AI and Big Data – Impact on Justice, Human Rights and Privacy Zoom event on September 28, 2022 at 12 – 1:30 pm EDT” September 16, 2022 posting

These stories feature problems, which aren’t new but seem to be getting more attention,

While there have been issues over AI, the arts, and creativity previously, this year they sprang into high relief. The list starts with my two-part review of the Vancouver Art Gallery’s AI show; I share most of my concerns in part two. The third post covers intellectual property issues (mostly visual arts but literary arts get a nod too). The fourth post upends the discussion,

  • “Mad, bad, and dangerous to know? Artificial Intelligence at the Vancouver (Canada) Art Gallery (1 of 2): The Objects” July 28, 2022 posting
  • “Mad, bad, and dangerous to know? Artificial Intelligence at the Vancouver (Canada) Art Gallery (2 of 2): Meditations” July 28, 2022 posting
  • “AI (artificial intelligence) and art ethics: a debate + a Botto (AI artist) October 2022 exhibition in the Uk” October 24, 2022 posting
  • Should AI algorithms get patents for their inventions and is anyone talking about copyright for texts written by AI algorithms? August 30, 2022 posting

Interestingly, most of the concerns seem to be coming from the visual and literary arts communities; I haven’t come across major concerns from the music community. (The curious can check out Vancouver’s Metacreation Lab for Artificial Intelligence [located on a Simon Fraser University campus]. I haven’t seen any cautionary or warning essays there; it’s run by an AI and creativity enthusiast [professor Philippe Pasquier]. The dominant but not sole focus is art, i.e., music and AI.)

There is a ‘new kid on the block’ which has been attracting a lot of attention this month. If you’re curious about the latest and greatest AI anxiety,

  • Peter Csathy’s December 21, 2022 Yahoo News article (originally published in The WRAP) makes this proclamation in the headline “Chat GPT Proves That AI Could Be a Major Threat to Hollywood Creatives – and Not Just Below the Line | PRO Insight”
  • Mouhamad Rachini’s December 15, 2022 article for the Canadian Broadcasting Corporation’s (CBC) online news overs a more generalized overview of the ‘new kid’ along with an embedded CBC Radio file which runs approximately 19 mins. 30 secs. It’s titled “ChatGPT a ‘landmark event’ for AI, but what does it mean for the future of human labour and disinformation?” The chat bot’s developer, OpenAI, has been mentioned here many times including the previously listed July 28, 2022 posting (part two of the VAG review) and the October 24, 2022 posting.

Opposite world (quantum physics in Canada)

Quantum computing made more of an impact here (my blog) than usual. it started in 2021 with the announcement of a National Quantum Strategy in the Canadian federal government budget for that year and gained some momentum in 2022:

  • “Quantum Mechanics & Gravity conference (August 15 – 19, 2022) launches Vancouver (Canada)-based Quantum Gravity Institute and more” July 26, 2022 posting Note: This turned into one of my ‘in depth’ pieces where I comment on the ‘Canadian quantum scene’ and highlight the appointment of an expert panel for the Council of Canada Academies’ report on Quantum Technologies.
  • “Bank of Canada and Multiverse Computing model complex networks & cryptocurrencies with quantum computing” July 25, 2022 posting
  • “Canada, quantum technology, and a public relations campaign?” December 29, 2022 posting

This one was a bit of a puzzle with regard to placement in this end-of-year review, it’s quantum but it’s also about brainlike computing

It’s getting hot in here

Fusion energy made some news this year.

There’s a Vancouver area company, General Fusion, highlighted in both postings and the October posting includes an embedded video of Canadian-born rapper Baba Brinkman’s “You Must LENR” [L ow E nergy N uclear R eactions or sometimes L attice E nabled N anoscale R eactions or Cold Fusion or CANR (C hemically A ssisted N uclear R eactions)].

BTW, fusion energy can generate temperatures up to 150 million degrees Celsius.

Ukraine, science, war, and unintended consequences

Here’s what you might expect,

These are the unintended consequences (from Rachel Kyte’s, Dean of the Fletcher School, Tufts University, December 26, 2022 essay on The Conversation [h/t December 27, 2022 news item on phys.org]), Note: Links have been removed,

Russian President Vladimir Putin’s war on Ukraine has reverberated through Europe and spread to other countries that have long been dependent on the region for natural gas. But while oil-producing countries and gas lobbyists are arguing for more drilling, global energy investments reflect a quickening transition to cleaner energy. [emphasis mine]

Call it the Putin effect – Russia’s war is speeding up the global shift away from fossil fuels.

In December [2022?], the International Energy Agency [IEA] published two important reports that point to the future of renewable energy.

First, the IEA revised its projection of renewable energy growth upward by 30%. It now expects the world to install as much solar and wind power in the next five years as it installed in the past 50 years.

The second report showed that energy use is becoming more efficient globally, with efficiency increasing by about 2% per year. As energy analyst Kingsmill Bond at the energy research group RMI noted, the two reports together suggest that fossil fuel demand may have peaked. While some low-income countries have been eager for deals to tap their fossil fuel resources, the IEA warns that new fossil fuel production risks becoming stranded, or uneconomic, in the next 20 years.

Kyte’s essay is not all ‘sweetness and light’ but it does provide a little optimism.

Kudos, nanotechnology, culture (pop & otherwise), fun, and a farewell in 2022

This one was a surprise for me,

Sometimes I like to know where the money comes from and I was delighted to learn of the Ărramăt Project funded through the federal government’s New Frontiers in Research Fund (NFRF). Here’s more about the Ărramăt Project from the February 14, 2022 posting,

“The Ărramăt Project is about respecting the inherent dignity and interconnectedness of peoples and Mother Earth, life and livelihood, identity and expression, biodiversity and sustainability, and stewardship and well-being. Arramăt is a word from the Tamasheq language spoken by the Tuareg people of the Sahel and Sahara regions which reflects this holistic worldview.” (Mariam Wallet Aboubakrine)

Over 150 Indigenous organizations, universities, and other partners will work together to highlight the complex problems of biodiversity loss and its implications for health and well-being. The project Team will take a broad approach and be inclusive of many different worldviews and methods for research (i.e., intersectionality, interdisciplinary, transdisciplinary). Activities will occur in 70 different kinds of ecosystems that are also spiritually, culturally, and economically important to Indigenous Peoples.

The project is led by Indigenous scholars and activists …

Kudos to the federal government and all those involved in the Salmon science camps, the Ărramăt Project, and other NFRF projects.

There are many other nanotechnology posts here but this appeals to my need for something lighter at this point,

  • “Say goodbye to crunchy (ice crystal-laden) in ice cream thanks to cellulose nanocrystals (CNC)” August 22, 2022 posting

The following posts tend to be culture-related, high and/or low but always with a science/nanotechnology edge,

Sadly, it looks like 2022 is the last year that Ada Lovelace Day is to be celebrated.

… this year’s Ada Lovelace Day is the final such event due to lack of financial backing. Suw Charman-Anderson told the BBC [British Broadcasting Corporation] the reason it was now coming to an end was:

You can read more about it here:

In the rearview mirror

A few things that didn’t fit under the previous heads but stood out for me this year. Science podcasts, which were a big feature in 2021, also proliferated in 2022. I think they might have peaked and now (in 2023) we’ll see what survives.

Nanotechnology, the main subject on this blog, continues to be investigated and increasingly integrated into products. You can search the ‘nanotechnology’ category here for posts of interest something I just tried. It surprises even me (I should know better) how broadly nanotechnology is researched and applied.

If you want a nice tidy list, Hamish Johnston in a December 29, 2022 posting on the Physics World Materials blog has this “Materials and nanotechnology: our favourite research in 2022,” Note: Links have been removed,

“Inherited nanobionics” makes its debut

The integration of nanomaterials with living organisms is a hot topic, which is why this research on “inherited nanobionics” is on our list. Ardemis Boghossian at EPFL [École polytechnique fédérale de Lausanne] in Switzerland and colleagues have shown that certain bacteria will take up single-walled carbon nanotubes (SWCNTs). What is more, when the bacteria cells split, the SWCNTs are distributed amongst the daughter cells. The team also found that bacteria containing SWCNTs produce a significantly more electricity when illuminated with light than do bacteria without nanotubes. As a result, the technique could be used to grow living solar cells, which as well as generating clean energy, also have a negative carbon footprint when it comes to manufacturing.

Getting to back to Canada, I’m finding Saskatchewan featured more prominently here. They do a good job of promoting their science, especially the folks at the Canadian Light Source (CLS), Canada’s synchrotron, in Saskatoon. Canadian live science outreach events seeming to be coming back (slowly). Cautious organizers (who have a few dollars to spare) are also enthusiastic about hybrid events which combine online and live outreach.

After what seems like a long pause, I’m stumbling across more international news, e.g. “Nigeria and its nanotechnology research” published December 19, 2022 and “China and nanotechnology” published September 6, 2022. I think there’s also an Iran piece here somewhere.

With that …

Making resolutions in the dark

Hopefully this year I will catch up with the Council of Canadian Academies (CCA) output and finally review a few of their 2021 reports such as Leaps and Boundaries; a report on artificial intelligence applied to science inquiry and, perhaps, Powering Discovery; a report on research funding and Natural Sciences and Engineering Research Council of Canada.

Given what appears to a renewed campaign to have germline editing (gene editing which affects all of your descendants) approved in Canada, I might even reach back to a late 2020 CCA report, Research to Reality; somatic gene and engineered cell therapies. it’s not the same as germline editing but gene editing exists on a continuum.

For anyone who wants to see the CCA reports for themselves they can be found here (both in progress and completed).

I’m also going to be paying more attention to how public relations and special interests influence what science is covered and how it’s covered. In doing this 2022 roundup, I noticed that I featured an overview of fusion energy not long before the breakthrough. Indirect influence on this blog?

My post was precipitated by an article by Alex Pasternak in Fast Company. I’m wondering what precipitated Alex Pasternack’s interest in fusion energy since his self-description on the Huffington Post website states this “… focus on the intersections of science, technology, media, politics, and culture. My writing about those and other topics—transportation, design, media, architecture, environment, psychology, art, music … .”

He might simply have received a press release that stimulated his imagination and/or been approached by a communications specialist or publicists with an idea. There’s a reason for why there are so many public relations/media relations jobs and agencies.

Que sera, sera (Whatever will be, will be)

I can confidently predict that 2023 has some surprises in store. I can also confidently predict that the European Union’s big research projects (1B Euros each in funding for the Graphene Flagship and Human Brain Project over a ten year period) will sunset in 2023, ten years after they were first announced in 2013. Unless, the powers that be extend the funding past 2023.

I expect the Canadian quantum community to provide more fodder for me in the form of a 2023 report on Quantum Technologies from the Council of Canadian academies, if nothing else otherwise.

I’ve already featured these 2023 science events but just in case you missed them,

  • 2023 Preview: Bill Nye the Science Guy’s live show and Marvel Avengers S.T.A.T.I.O.N. (Scientific Training And Tactical Intelligence Operative Network) coming to Vancouver (Canada) November 24, 2022 posting
  • September 2023: Auckland, Aotearoa New Zealand set to welcome women in STEM (science, technology, engineering, and mathematics) November 15, 2022 posting

Getting back to this blog, it may not seem like a new year during the first few weeks of 2023 as I have quite the stockpile of draft posts. At this point I have drafts that are dated from June 2022 and expect to be burning through them so as not to fall further behind but will be interspersing them, occasionally, with more current posts.

Most importantly: a big thank you to everyone who drops by and reads (and sometimes even comments) on my posts!!! it’s very much appreciated and on that note: I wish you all the best for 2023.

A spray-on dress with nanoparticles as the base?

Even a month after the fact, this is still fascinating. The magic is in watching the paint/textile get sprayed onto model, Bella Hadid’s body, and watching the liquid transform into a textile. (Note: Ms. Hadid has a minimal amount of clothing at the start),

Fashion designer/scientist, Manel Torres developed the technology, Fabrican, about 20 years ago according to an October 14, 2022 article by Gooseed for complex.com,

Coperni, the Parisian ready-to-wear brand founded by Sébastien Meyer and Arnaud Vaillant, has always focused on tailored minimalism since it launched in 2013. Yet it also strives to take an innovative approach to design that connects its collections with the current fashion moment and pay homage to the past.  

The finale of their Spring/Summer 2023 presentation for Paris Fashion Week, where model Bella Hadid walked onto stage half-naked to get sprayed with a white substance, gave the brand a viral moment. At first glance, most of us thought it was a performance. But after a few minutes, the white shell that appeared on Bella’s body looked like a dress solidified into a texture that almost resembled latex. It wasn’t a body painting, but an actual dress. Charlotte Raymond, Coperni’s Head of Design, even helped style the dress by cutting a slit into the garment and altering the straps to make it an off the shoulder silhouette. The rest is history. Videos of the dress blew up on social media and are now anchored in the digital ether.

The truth is that this magic behind the dress is not new. It has been around for almost two decades.

The innovative technology behind Hadid’s Coperni dress was created by Manel Torres, a Spanish fashion designer turned scientist. Torres has been nicknamed “The Chemist Tailor” because of Fabrican, a liquid tissue made up of polymers, additives, and fiber that turns into a solid nonwoven material when it comes into contact with air. That’s why Fabrican can come out of a spray can to instantly create something like Bella’s Coperni dress. It can also be used to create protective covering for furniture or car interiors. Torres founded his business in 2003 and has been researching the possibility of creating clothes, chairs, and medical patches with just one spray for over 20 years and counting.

His journey started first at the La Escuela de Artes y Técnicas de la Moda in Barcelona, where Torres studied arts with a specialty in fashion design. He then enrolled at the Royal College of Art in London where he graduated with an MA in womenswear. He went on to graduate with a PhD from the Royal College of Art in 2001 by publishing a thesis centered on spray-on fabrics from an aerosol can. It was a collaborative thesis between his school’s fashion department and the chemical engineering department at the Imperial College of London. Torres then started creating his own collections with the first versions of Fabrican fabric. Before Coperni, he presented Fabrican at several runway shows like Science in Style in 2010 and during Moscow Fashion Week in 2011.

Despite Torres’ fashion background, he mostly works with clients within the automobile, medical, and sportswear industry. “I’m a fashion guy so my wish is that this industry starts to invest more in technology and not rely so much on branding,” says Torres when sharing his views on the fashion industry a couple days after the Coperni moment.

Torres’ drive to push Fabrican into the fashion business has also garnered the interest of other industries outside of apparel. He says it has made him realize that there are possibilities for new production models in all aspects of design. “This is completely a new idea so it requires a completely new approach. That in an industry like fashion, and in any industry in general, is going to take some time,” says Torres. He is patient and persistent about achieving his number one goal, which is to make Fabrican available for everybody.

Additionally, since Fabrican is plant-based and composed of natural fibers, it can be used as an alternative to animal-derived leathers. The fabric can also be washed and reused and sprayed on to again to extend the garment. Torres hopes to grow Fabrican to an industrial scale with the help of a robotic arm spray system that could quickly create complex forms in a very precise way and operate 24 hours a day, which could significantly reduce human labor and product costs associated with garment production. The durability of the fabric is also something that Torres assures to be “very similar to the clothes we use daily but needs to be improved.” He reveals that he’s currently working with the German government to apply Fabrican technology to produce uniforms.

…  

For the curious, there are more images and videos embedded, as well as, the links I’ve have eliminated from the excerpts, in Gooseed’s October 14, 2022 article.

Eglė Radžiūtė’s October 3 (?), 2022 article for boredpanda.com fills out the fashion commentary with a bit more detail about the science, Note: Links have been removed,

In about 9 minutes, Bella’s body was engulfed in a light layer of fabric. Once the fabric had a second to settle, Coperni’s Head of Design Charlotte Raymond came up to wipe off the excess and shape the dress into its final form. Lowering the shoulder straps, cutting the bottom to mid-calf length, and adding a slit on Bella’s left leg, Charlotte completed something that was out of this world.

The segment was not previously rehearsed with Bella due to her Paris Fashion Week schedule, adding to the magic, as well as showing off the professionalism of the dress’s engineers, the designers, and Bella herself. The night before the show, a model stood in for Bella, but she couldn’t control her shivering on the chilly runway as the cold material hit her skin.

“I was so nervous,” Bella said backstage, as it would have been her first experience being sprayed. But she didn’t let it show. She was steely and delicate, occasionally raising her arms above her head with an elegant flair, or offering a little smile at the people working on her. “I kind of just became the character, whoever she is.”

Wasn’t it cold up there? “Honey, cold is an understatement,” Bella said, as reported by the NYTimes. “I really blacked out.” Yet as soon as she left the runway, she felt like the performance had been a “pinnacle moment” in her career.

Let’s dive into the science behind the dress. Partnering with Doctor Manel Torres, Founder and Managing Director of Fabrican Ltd, they utilized a spray-on fabric that, once sprayed, dries to create a wearable, non-woven textile. It can be made using different types of fibers: from natural to synthetic, including wool, cotton, nylon, cellulose, and carbon nanofibers. [emphasis mine]

Based in London [UK], at the London Bioscience Innovation Center, Doctor Torres has been working on this multifaceted piece of technology since 2003. A liquid suspension—a finely distributed solid in a liquid, which is not dissolved—is applied via spray gun or aerosol to a surface, creating a fabric. The cross-linking of fibers, which adhere to one another, creates an instant non-woven fabric.

The future-forward invention may be used for more than just creating intricate fashion; they believe it can revolutionize multiple industries. As stated on BBC’s The Imagineers, the fabric is sterile and thus can be made into bandages. It can be made to set hard and, thus, could be used as a cast for broken bones. But perhaps most crucially, the fabric absorbs oil, and so it could be used to clean up after oil tanker disasters.

Whilst in pictures the dress looked to be made of a kind of silk or cotton, those who got close enough to touch it discovered that it felt soft but elastic, bumpy like a sponge. According to Arnaud, the dress was taken off like any other tight, slightly stretchy one: a process of peeling off and shimmying out. It can be hung and washed, or put back into the bottle of its original solution to regenerate.

Coperni is an ultra-modern Parisian ready-to-wear and accessories brand designed by Sébastien Meyer and Arnaud Vaillant. Established in 2013, the pair have been on a mission to find the intersection between fashion and technology, “marrying exhaustive origami-like technique with a neat, ‘sportif’ silhouette.”

You can better see the dress’s texture in this image,

Image credits: bellahadid [downloaded from https://www.boredpanda.com/bella-hadid-coperni-spray-on-dress/?utm_source=duckduckgo&utm_medium=referral&utm_campaign=organic]

Health concerns

Do read the comments at the end of Eglė Radžiūtė’s October 3 (?), 2022 article. Most are admiring but there is a cautionary note from a construction painter noting that no one wore any “respiratory protective devices.” An ‘industrial hygienist’ seconded the the painter’s concern “that stuff is in their lungs,” as would anyone concerned with lung health.

The science of a spray-on textile

You can glean some information from his patent filings (where you’ll find mention of nanosilica but not of the carbon nanofibers mentioned in Radžiūtė’s article), Non-woven fabric Patent number: 8124549; Non-woven fabric Patent number: 8088315; Non-Woven Fabric Publication number: 20100286583; Non-Woven Fabric Publication number: 20090036014; and Non-woven fabric Publication number: 20050222320 on justia.com. The full list of Torres’ patents is here.

I’m guessing there’s more than one kind of engineered nanomaterial to be found in Torres’ mixtures but he’s pretty careful about spilling too much information. Charlotte Hu in her October 4, 2022 article for Popular Science helps to decode further the information in the patents (Note: Links have been removed),

This instantaneously materialized dress is not a magic trick, but a testament to innovations in material science more than two decades in the making. The man behind the creation is Manel Torres, who in 2003 created the substance used on Hadid, Fabrican (presumably a portmanteau of the phrase “fabric in a can”). His inspiration? Silly string and spiderwebs. His idea was to elevate the coarse cords of the silly string into a finer fabric that could be dispersed through a mist. Torres explained in a 2013 Ted Talk that when this spray-on fabric comes in contact with air, it turns into a solid material that’s stretchy and feels like suede. 

What exactly is in Fabrican? According to the patents granted to the company, the liquid fabric is made up of a suspension of liquid polymers (large molecules bonded together), additives, binders like natural latex, cross-linked natural and synthetic fibers, and a fast-evaporating solvent like acetone. The fibers can be polyester, polypropylene, cotton, linen, or wool. 

Torres added that they can easily form the material around 3D molds or patterns and tweak the textures, so they can get something that’s fleece-like, paper-like, lace-like, or rubber-like. He imagined that people could go into a booth, customize their dress, and instantly have it 3D printed onto their bodies. The spray could even be used for spot repairs on existing clothing.  

… Fabrican states on its website that it uses “fibres recycled from discarded clothes and other fabrics. The technology can also utilise biodegradable fibres and binders in place of fossil-based polymers to reduce the carbon footprint of material and manufacturing.” Additionally, the company said that “at the end of their useful life, sprayed fabrics can be re-dissolved and sprayed anew.”  

For the curious, here’s the Fabrican Ltd. website, the Coperni website, and a Wikipedia entry for Silly String.

I have another story about producing something in midair in a May 17, 2016 posting titled: Printing in midair. That was about 3D printing metallic devices in midair.

H/t to the Celebrity Social Media October 3, 2022 posting (keep scrolling down about 75% of the way down) on Laineygossip.com and to Rosemary Hurst because her comments about the dress led me to Charlotte Hu’s article. *ETA: November 4, 2022 at 1550 PT: Rosemary compared to a process for handmaking paper.*

Keeping your hands cool and your coffee hot with a cup cozy inspired by squid skin

Researchers in the Department of Chemical and Biomolecular Engineering at the University of California, Irvine have invented a squid-skin inspired material that can wrap around a coffee cup to shield sensitive fingers from heat. They have also created a method for economically mass producing the adaptive fabric, making possible a wide range of uses. Credit: Melissa Sung Courtesy: University of California Irvine

I love that image. Melissa Sung, thank you. Sadly, squid-inspired cup cozies aren’t available yet according to a March 28, 2022 news item on phys.org but researchers are working on it, Note: Links have been removed,

In the future, you may have a squid to thank for your coffee staying hot on a cold day. Drawing inspiration from cephalopod skin, engineers at the University of California, Irvine invented an adaptive composite material that can insulate beverage cups, restaurant to-go bags, parcel boxes and even shipping containers.

The innovation is an infrared-reflecting metallized polymer film developed in the laboratory of Alon Gorodetsky, UCI associate professor of chemical and biomolecular engineering. In a paper published today [March 28, 2022] in Nature Sustainability, Gorodetsky and his team members describe a large-area composite material that regulates heat by means of reconfigurable metal structures that can reversibly separate from one another and come back together under different strain levels.

“The metal islands in our composite material are next to one another when the material is relaxed and become separated when the material is stretched, allowing for control of the reflection and transmission of infrared light or heat dissipation,” said Gorodetsky. “The mechanism is analogous to chromatophore expansion and contraction in a squid’s skin, which alters the reflection and transmission of visible light.”

Chromatophore size changes help squids communicate and camouflage their bodies to evade predators and hide from prey. Gorodetsky said by mimicking this approach, his team has enabled “tunable thermoregulation” in their material, which can lead to improved energy efficiency and protect sensitive fingers from hot surfaces.

A March 28, 2022 University of California at Irvine (UCI) news release (also on EurekAlert), which originated the news item, delves further into this squid-inspired research and its commercialization,

A key breakthrough of this project was the UCI researchers’ development of a cost-effective production method of their composite material at application-relevant quantities. The copper and rubber raw materials start at about a dime per square meter with the costs reduced further by economies of scale, according to the paper. The team’s fabrication technique involves depositing a copper film onto a reusable substrate such as aluminum foil and then spraying multiple polymer layers onto the copper film, all of which can be done in nearly any batch size imaginable.

“The combined manufacturing strategy that we have now perfected in our lab is a real game changer,” said Gorodetsky. “We have been working with cephalopod-inspired adaptive materials and systems for years but previously have only been able to fabricate them over relatively small areas. Now there is finally a path to making this stuff roll-by-roll in a factory.”

The developed strategy and economies of scale should make it possible for the composite material to be used in a wide range of applications, from the coffee cup cozy up to tents, or in any container in which tunable temperature regulation is desired.

The invention will go easy on the environment due its environmental sustainability, said lead author Mohsin Badshah, a former UCI postdoctoral scholar in chemical and biomolecular engineering. “The composite material can be recycled in bulk by removing the copper with vinegar and using established commercial methods to repurpose the remaining stretchable polymer,” he said.

The team conducted universally relatable coffee cup testing in their laboratory on the UCI campus, where they proved they could control the cooling of the coffee. They were able to accurately and theoretically predict and then experimentally confirm the changes in temperature for the beverage-filled cups. The was also able to achieve a 20-fold modulation of infrared radiation transmittance and a 30-fold regulation of thermal fluxes under standardized testing conditions. The stable material even worked well for high levels of mechanical deformation and after repeated mechanical cycling.

“There is an enormous array of applications for this material,” said Gorodetsky. “Think of all the perishable goods that have been delivered to people’s homes during the pandemic. Any package that Amazon or another company sends that needs to be temperature-controlled can use a lining made from our squid-inspired adaptive composite material. Now that we can make large sheets of it at a time, we have something that can benefit many aspects of our lives.”

Joining Gorodetsky and Badshah on this project were Erica Leung, who recently graduated UCI with a Ph.D. in chemical and biomolecular engineering, and Aleksandra Strzelecka and Panyiming Liu, who are current UCI graduate students. The research was funded by the Defense Advanced Research Projects Agency, the Advanced Research Projects Agency – Energy and the Air Force Office of Scientific Research. A provisional patent for the technology and manufacturing process has been applied for.

Here’s a link to and a citation for the paper,

Scalable manufacturing of sustainable packaging materials with tunable thermoregulability by Mohsin Ali Badshah, Erica M. Leung, Panyiming Liu, Aleksandra Anna Strzelecka & Alon A. Gorodetsky. Nature Sustainability (2022) DOI: https://doi.org/10.1038/s41893-022-00847-2 Published: 28 March 2022

This paper is behind a paywall.

AI (artificial intelligence) and art ethics: a debate + a Botto (AI artist) October 2022 exhibition in the Uk

Who is an artist? What is an artist? Can everyone be an artist? These are the kinds of questions you can expect with the rise of artificially intelligent artists/collaborators. Of course, these same questions have been asked many times before the rise of AI (artificial intelligence) agents/programs in the field of visual art. Each time the questions are raised is an opportunity to examine our beliefs from a different perspective. And, not to be forgotten, there are questions about money.

The shock

First, the ‘art’,

The winning work. Colorado State Fair 2022. Screengrab from Discord [downloaded from https://www.artnews.com/art-news/news/colorado-state-fair-ai-generated-artwork-controversy-1234638022/]

Shanti Escalante-De Mattei’s September 1, 2022 article for ArtNews.com provides an overview of the latest AI art controversy (Note: A link has been removed),

The debate around AI art went viral once again when a man won first place at the Colorado State Fair’s art competition in the digital category with a work he made using text-to-image AI generator Midjourney.

Twitter user and digital artist Genel Jumalon tweeted out a screenshot from a Discord channel in which user Sincarnate, aka game designer Jason Allen, celebrated his win at the fair. Jumalon wrote, “Someone entered an art competition with an AI-generated piece and won the first prize. Yeah that’s pretty fucking shitty.”

The comments on the post range from despair and anger as artists, both digital and traditional, worry that their livelihoods might be at stake after years of believing that creative work would be safe from AI-driven automation. [emphasis mine]

Rachel Metz’s September 3, 2022 article for CNN provides more details about how the work was generated (Note: Links have been removed),

Jason M. Allen was almost too nervous to enter his first art competition. Now, his award-winning image is sparking controversy about whether art can be generated by a computer, and what, exactly, it means to be an artist.

In August [2022], Allen, a game designer who lives in Pueblo West, Colorado, won first place in the emerging artist division’s “digital arts/digitally-manipulated photography” category at the Colorado State Fair Fine Arts Competition. His winning image, titled “Théâtre D’opéra Spatial” (French for “Space Opera Theater”), was made with Midjourney — an artificial intelligence system that can produce detailed images when fed written prompts. A $300 prize accompanied his win.

Allen’s winning image looks like a bright, surreal cross between a Renaissance and steampunk painting. It’s one of three such images he entered in the competition. In total, 11 people entered 18 pieces of art in the same category in the emerging artist division.

The definition for the category in which Allen competed states that digital art refers to works that use “digital technology as part of the creative or presentation process.” Allen stated that Midjourney was used to create his image when he entered the contest, he said.

The newness of these tools, how they’re used to produce images, and, in some cases, the gatekeeping for access to some of the most powerful ones has led to debates about whether they can truly make art or assist humans in making art.

This came into sharp focus for Allen not long after his win. Allen had posted excitedly about his win on Midjourney’s Discord server on August 25 [2022], along with pictures of his three entries; it went viral on Twitter days later, with many artists angered by Allen’s win because of his use of AI to create the image, as a story by Vice’s Motherboard reported earlier this week.

“This sucks for the exact same reason we don’t let robots participate in the Olympics,” one Twitter user wrote.

“This is the literal definition of ‘pressed a few buttons to make a digital art piece’,” another Tweeted. “AI artwork is the ‘banana taped to the wall’ of the digital world now.”

Yet while Allen didn’t use a paintbrush to create his winning piece, there was plenty of work involved, he said.

“It’s not like you’re just smashing words together and winning competitions,” he said.

You can feed a phrase like “an oil painting of an angry strawberry” to Midjourney and receive several images from the AI system within seconds, but Allen’s process wasn’t that simple. To get the final three images he entered in the competition, he said, took more than 80 hours.

First, he said, he played around with phrasing that led Midjourney to generate images of women in frilly dresses and space helmets — he was trying to mash up Victorian-style costuming with space themes, he said. Over time, with many slight tweaks to his written prompt (such as to adjust lighting and color harmony), he created 900 iterations of what led to his final three images. He cleaned up those three images in Photoshop, such as by giving one of the female figures in his winning image a head with wavy, dark hair after Midjourney had rendered her headless. Then he ran the images through another software program called Gigapixel AI that can improve resolution and had the images printed on canvas at a local print shop.

Ars Technica has run a number of articles on the subject of Art and AI, Benj Edwards in an August 31, 2022 article seems to have been one of the first to comment on Jason Allen’s win (Note 1: Links have been removed; Note 2: Look at how Edwards identifies Jason Allen as an artist),

A synthetic media artist named Jason Allen entered AI-generated artwork into the Colorado State Fair fine arts competition and announced last week that he won first place in the Digital Arts/Digitally Manipulated Photography category, Vice reported Wednesday [August 31, 2022?] based on a viral tweet.

Allen’s victory prompted lively discussions on Twitter, Reddit, and the Midjourney Discord server about the nature of art and what it means to be an artist. Some commenters think human artistry is doomed thanks to AI and that all artists are destined to be replaced by machines. Others think art will evolve and adapt with new technologies that come along, citing synthesizers in music. It’s a hot debate that Wired covered in July [2022].

It’s worth noting that the invention of the camera in the 1800s prompted similar criticism related to the medium of photography, since the camera seemingly did all the work compared to an artist that labored to craft an artwork by hand with a brush or pencil. Some feared that painters would forever become obsolete with the advent of color photography. In some applications, photography replaced more laborious illustration methods (such as engraving), but human fine art painters are still around today.

Benj Edwards in a September 12, 2022 article for Ars Technica examines how some art communities are responding (Note: Links have been removed),

Confronted with an overwhelming amount of artificial-intelligence-generated artwork flooding in, some online art communities have taken dramatic steps to ban or curb its presence on their sites, including Newgrounds, Inkblot Art, and Fur Affinity, according to Andy Baio of Waxy.org.

Baio, who has been following AI art ethics closely on his blog, first noticed the bans and reported about them on Friday [Sept. 9, 2022?]. …

The arrival of widely available image synthesis models such as Midjourney and Stable Diffusion has provoked an intense online battle between artists who view AI-assisted artwork as a form of theft (more on that below) and artists who enthusiastically embrace the new creative tools.

… a quickly evolving debate about how art communities (and art professionals) can adapt to software that can potentially produce unlimited works of beautiful art at a rate that no human working without the tools could match.

A few weeks ago, some artists began discovering their artwork in the Stable Diffusion data set, and they weren’t happy about it. Charlie Warzel wrote a detailed report about these reactions for The Atlantic last week [September 7, 2022]. With battle lines being drawn firmly in the sand and new AI creativity tools coming out steadily, this debate will likely continue for some time to come.

Filthy lucre becomes more prominent in the conversation

Lizzie O’Leary in a September 12, 2022 article for Fast Company presents a transcript of an interview (from the TBD podcast) she conducted with Drew Harwell, tech reporter covering A.I. for Washington Post) about the ‘Jason Allen’ win,

I’m struck by how quickly these art A.I.s are advancing. DALL-E was released in January of last year and there were some pretty basic images. And then, a year later, DALL-E 2 is using complex, faster methods. Midjourney, the one Jason Allen used, has a feature that allows you to upscale and downscale images. Where is this sudden supply and demand for A.I. art coming from?

You could look back to five years ago when they had these text-to-image generators and the output would be really crude. You could sort of see what the A.I. was trying to get at, but we’ve only really been able to cross that photorealistic uncanny valley in the last year or so. And I think the things that have contributed to that are, one, better data. You’re seeing people invest a lot of money and brainpower and resources into adding more stuff into bigger data sets. We have whole groups that are taking every image they can get on the internet. Billions, billions of images from Pinterest and Amazon and Facebook. You have bigger data sets, so the A.I. is learning more. You also have better computing power, and those are the two ingredients to any good piece of A.I. So now you have A.I. that is not only trained to understand the world a little bit better, but it can now really quickly spit out a very finely detailed generated image.

Is there any way to know, when you look at a piece of A.I. art, what images it referenced to create what it’s doing? Or is it just so vast that you can’t kind of unspool it backward?

When you’re doing an image that’s totally generated out of nowhere, it’s taking bits of information from billions of images. It’s creating it in a much more sophisticated way so that it’s really hard to unspool.

Art generated by A.I. isn’t just a gee-whiz phenomenon, something that wins prizes, or even a fascinating subject for debate—it has valuable commercial uses, too. Some that are a little frightening if you’re, say, a graphic designer.

You’re already starting to see some of these images illustrating news articles, being used as logos for companies, being used in the form of stock art for small businesses and websites. Anything where somebody would’ve gone and paid an illustrator or graphic designer or artist to make something, they can now go to this A.I. and create something in a few seconds that is maybe not perfect, maybe would be beaten by a human in a head-to-head, but is good enough. From a commercial perspective, that’s scary, because we have an industry of people whose whole job is to create images, now running up against A.I.

And the A.I., again, in the last five years, the A.I. has gotten better and better. It’s still not perfect. I don’t think it’ll ever be perfect, whatever that looks like. It processes information in a different, maybe more literal, way than a human. I think human artists will still sort of have the upper hand in being able to imagine things a little more outside of the box. And yet, if you’re just looking for three people in a classroom or a pretty simple logo, you’re going to go to A.I. and you’re going to take potentially a job away from a freelancer whom you would’ve given it to 10 years ago.

I can see a use case here in marketing, in advertising. The A.I. doesn’t need health insurance, it doesn’t need paid vacation days, and I really do wonder about this idea that the A.I. could replace the jobs of visual artists. Do you think that is a legitimate fear, or is that overwrought at this moment?

I think it is a legitimate fear. When something can mirror your skill set, not 100 percent of the way, but enough of the way that it could replace you, that’s an issue. Do these A.I. creators have any kind of moral responsibility to not create it because it could put people out of jobs? I think that’s a debate, but I don’t think they see it that way. They see it like they’re just creating the new generation of digital camera, the new generation of Photoshop. But I think it is worth worrying about because even compared with cameras and Photoshop, the A.I. is a little bit more of the full package and it is so accessible and so hard to match in terms. It’s really going to be up to human artists to find some way to differentiate themselves from the A.I.

This is making me wonder about the humans underneath the data sets that the A.I. is trained on. The criticism is, of course, that these businesses are making money off thousands of artists’ work without their consent or knowledge and it undermines their work. Some people looked at the Stable Diffusion and they didn’t have access to its whole data set, but they found that Thomas Kinkade, the landscape painter, was the most referenced artist in the data set. Is the A.I. just piggybacking? And if it’s not Thomas Kinkade, if it’s someone who’s alive, are they piggybacking on that person’s work without that person getting paid?

Here’s a bit more on the topic of money and art in a September 19, 2022 article by John Herrman for New York Magazine. First, he starts with the literary arts, Note: Links have been removed,

Artificial-intelligence experts are excited about the progress of the past few years. You can tell! They’ve been telling reporters things like “Everything’s in bloom,” “Billions of lives will be affected,” and “I know a person when I talk to it — it doesn’t matter whether they have a brain made of meat in their head.”

We don’t have to take their word for it, though. Recently, AI-powered tools have been making themselves known directly to the public, flooding our social feeds with bizarre and shocking and often very funny machine-generated content. OpenAI’s GPT-3 took simple text prompts — to write a news article about AI or to imagine a rose ceremony from The Bachelor in Middle English — and produced convincing results.

Deepfakes graduated from a looming threat to something an enterprising teenager can put together for a TikTok, and chatbots are occasionally sending their creators into crisis.

More widespread, and probably most evocative of a creative artificial intelligence, is the new crop of image-creation tools, including DALL-E, Imagen, Craiyon, and Midjourney, which all do versions of the same thing. You ask them to render something. Then, with models trained on vast sets of images gathered from around the web and elsewhere, they try — “Bart Simpson in the style of Soviet statuary”; “goldendoodle megafauna in the streets of Chelsea”; “a spaghetti dinner in hell”; “a logo for a carpet-cleaning company, blue and red, round”; “the meaning of life.”

This flood of machine-generated media has already altered the discourse around AI for the better, probably, though it couldn’t have been much worse. In contrast with the glib intra-VC debate about avoiding human enslavement by a future superintelligence, discussions about image-generation technology have been driven by users and artists and focus on labor, intellectual property, AI bias, and the ethics of artistic borrowing and reproduction [emphasis mine]. Early controversies have cut to the chase: Is the guy who entered generated art into a fine-art contest in Colorado (and won!) an asshole? Artists and designers who already feel underappreciated or exploited in their industries — from concept artists in gaming and film and TV to freelance logo designers — are understandably concerned about automation. Some art communities and marketplaces have banned AI-generated images entirely.

Requests are effectively thrown into “a giant swirling whirlpool” of “10,000 graphics cards,” Holz [David Holz, Midjourney founder] said, after which users gradually watch them take shape, gaining sharpness but also changing form as Midjourney refines its work.

This hints at an externality beyond the worlds of art and design. “Almost all the money goes to paying for those machines,” Holz said. New users are given a small number of free image generations before they’re cut off and asked to pay; each request initiates a massive computational task, which means using a lot of electricity.

High compute costs [emphasis mine] — which are largely energy costs — are why other services have been cautious about adding new users. …

Another Midjourney user, Gila von Meissner, is a graphic designer and children’s-book author-illustrator from “the boondocks in north Germany.” Her agent is currently shopping around a book that combines generated images with her own art and characters. Like Pluckebaum [Brian Pluckebaum who works in automotive-semiconductor marketing and designs board games], she brought up the balance of power with publishers. “Picture books pay peanuts,” she said. “Most illustrators struggle financially.” Why not make the work easier and faster? “It’s my character, my edits on the AI backgrounds, my voice, and my story.” A process that took months now takes a week, she said. “Does that make it less original?”

User MoeHong, a graphic designer and typographer for the state of California, has been using Midjourney to make what he called generic illustrations (“backgrounds, people at work, kids at school, etc.”) for government websites, pamphlets, and literature: “I get some of the benefits of using custom art — not that we have a budget for commissions! — without the paying-an-artist part.” He said he has mostly replaced stock art, but he’s not entirely comfortable with the situation. “I have a number of friends who are commercial illustrators, and I’ve been very careful not to show them what I’ve made,” he said. He’s convinced that tools like this could eventually put people in his trade out of work. “But I’m already in my 50s,” he said, “and I hope I’ll be gone by the time that happens.”

Fan club

The last article I’m featuring here is a September 15, 2021 piece by Agnieszka Cichocka for DailyArt, which provides good, brief descriptions of algorithms, generative creative networks, machine learning, artificial neural networks, and more. She is an enthusiast (Note: Links have been removed),

I keep wondering if Leonardo da Vinci, who, in my opinion, was the most forward thinking artist of all time, would have ever imagined that art would one day be created by AI. He worked on numerous ideas and was constantly experimenting, and, although some were failures, he persistently tried new products, helping to move our world forward. Without such people, progress would not be possible. 

Machine Learning

As humans, we learn by acquiring knowledge through observations, senses, experiences, etc. This is similar to computers. Machine learning is a process in which a computer system learns how to perform a task better in two ways—either through exposure to environments that provide punishments and rewards (reinforcement learning) or by training with specific data sets (the system learns automatically and improves from previous experiences). Both methods help the systems improve their accuracy. Machines then use patterns and attempt to make an accurate analysis of things they have not seen before. To give an example, let’s say we feed the computer with thousands of photos of a dog. Consequently, it can learn what a dog looks like based on those. Later, even when faced with a picture it has never seen before, it can tell that the photo shows a dog.

If you want to see some creative machine learning experiments in art, check out ML x ART. This is a website with hundreds of artworks created using AI tools.

Some thoughts

As the saying goes “a picture is worth a thousand words” and, now, It seems that pictures will be made from words or so suggests the example of Jason M. Allen feeding prompts to the AI system Midjourney.

I suspect (as others have suggested) that in the end, artists who use AI systems will be absorbed into the art world in much the same way as artists who use photography, or are considered performance artists and/or conceptual artists, and/or use video have been absorbed. There will be some displacements and discomfort as the questions I opened this posting with (Who is an artist? What is an artist? Can everyone be an artist?) are passionately discussed and considered. Underlying many of these questions is the issue of money.

The impact on people’s livelihoods is cheering or concerning depending on how the AI system is being used. Herrman’s September 19, 2022 article highlights two examples that focus on graphic designers. Gila von Meissner, the illustrator and designer, who uses her own art to illustrate her children’s books in a faster, more cost effective way with an AI system and MoeHong, a graphic designer for the state of California, who uses an AI system to make ‘customized generic art’ for which the state government doesn’t have to pay.

So far, the focus has been on Midjourney and other AI agents that have been created by developers for use by visual artists and writers. What happens when the visual artist or the writer is the developer? A September 12, 2022 article by Brandon Scott Roye for Cool Hunting approaches the question (Note: Links have been removed),

Mario Klingemann and Sasha Stiles on Semi-Autonomous AI Artists

An artist and engineer at the forefront of generating AI artwork, Mario Klingemann and first-generation Kalmyk-American poet, artist and researcher Sasha Stiles both approach AI from a more human, personal angle. Creators of semi-autonomous systems, both Klingemann and Stiles are the minds behind Botto and Technelegy, respectively. They are both artists in their own right, but their creations are too. Within web3, the identity of the “artist” who creates with visuals and the “writer” who creates with words is enjoying a foundational shift and expansion. Many have fashioned themselves a new title as “engineer.”

Based on their primary identities as an artist and poet, Klingemann and Stiles face the conundrum of becoming engineers who design the tools, rather than artists responsible for the final piece. They now have the ability to remove themselves from influencing inputs and outputs.

If you have time, I suggest reading Roye’s September 12, 2022 article as it provides some very interesting ideas although I don’t necessarily agree with them, e.g., “They now have the ability to remove themselves from influencing inputs and outputs.” Anyone who’s following the ethics discussion around AI knows that biases are built into the algorithms whether we like it or not. As for artists and writers calling themselves ‘engineers’, they may get a little resistance from the engineering community.

As users of open source software, Klingemann and Stiles should not have to worry too much about intellectual property. However, it seems copyright for the actual works and patents for the software could raise some interesting issues especially since money is involved.

In a March 10, 2022 article by Shraddha Nair for Stir World, Klingemann claims to have made over $1M from auctions of Botto’s artworks. it’s not clear to me where Botto obtains its library of images for future use (which may signal a potential problem); Stiles’ Technelegy creates poems from prompts using its library of her poems. (For the curious, I have an August 30, 2022 post “Should AI algorithms get patents for their inventions and is anyone talking about copyright for texts written by AI algorithms?” which explores some of the issues around patents.)

Who gets the patent and/or the copyright? Assuming you and I are employing machine learning to train our AI agents separately, could there be an argument that if my version of the AI is different than yours and proves more popular with other content creators/ artists that I should own/share the patent to the software and rights to whatever the software produces?

Getting back to Herrman’s comment about high compute costs and energy, we seem to have an insatiable appetite for energy and that is not only a high cost financially but also environmentally.

Botto exhibition

Here’s more about Klingemann’s artist exhibition by Botto (from an October 6, 2022 announcement received via email),

Mario Klingemann is a pioneering figurehead in the field of AI art,
working deep in the field of Machine Learning. Governed by a community
of 5,000 people, Klingemann developed Botto around an idea of creating
an autonomous entity that is able to be creative and co-creative.
Inspired by Goethe’s artificial man in Faust, Botto is a genderless AI
entity that is guided by an international community and art historical
trends. Botto creates 350 art pieces per week that are presented to its
community. Members of the community give feedback on these art fragments
by voting, expressing their individual preferences on what is
aesthetically pleasing to them. Then collectively the votes are used as
feedback for Botto’s generative algorithm, dictating what direction
Botto should take in its next series of art pieces.

The creative capacity of its algorithm is far beyond the capacities of
an individual to combine and find relationships within all the
information available to the AI. Botto faces similar issues as a human
artist, and it is programmed to self-reflect and ask, “I’ve created
this type of work before. What can I show them that’s different this
week?”

Once a week, Botto auctions the art fragment with the most votes on
SuperRare. All proceeds from the auction go back to the community. The
AI artist auctioned its first three pieces, Asymmetrical Liberation,
Scene Precede, and Trickery Contagion for more than $900,000 dollars,
the most successful AI artist premiere. Today, Botto has produced
upwards of 22 artworks and current sales have generated over $2 million
in total
[emphasis mine].

From March 2022 when Botto had made $1M to October 2022 where it’s made over $2M. It seems Botto is a very financially successful artist.

Botto: A Whole Year of Co-Creation

This exhibition (October 26 – 30, 2022) is being held in London, England at this location:

The Department Store, Brixton 248 Ferndale Road London SW9 8FR United Kingdom

Enjoy!