Tag Archives: machine/flesh

Audio tattoo

When I use the term machine/flesh, it’s usually about hardware being combined with the body (e.g., neuroprosthetics) but this news bit concerns a rather different way of integrating technology into the body. From a January ?, 2018 news item on BBC (British Broadcasting Corporation) Newsbeat,

In the message, her grandma can be heard wishing her a happy birthday, before saying “I love you”.

She tells her granddaughter [Sakyrah Morris of Chicago, Illinois, US]: “You should be up and awake because it’s your birthday, you rock-headed little kid.”

With an app, Sakyrah is able to scan the waveform of the voice recording and play it back using image recognition.

“My grandmother passed away in May 2015 and my birthday was the month before in April,” she  told Newsbeat.

“She called me a little past midnight to wish me happy birthday and to tell me that she loved me.

“I had been holding onto that voicemail for what’s been almost three years now and I got the idea recently to get it tattooed.

“I figured it’d be something permanent that would be across my heart to be more meaningful.”

Mark Molloy’s January 5, 2018 article for The Telegraph provides more details about Morris and her audio tattoo (Note: A link has been removed),

Singer Sakyrah Morris can hear a voicemail birthday message left by her grandmother by simply hovering her smartphone camera over the soundwave tattoo.

The personalised tattoos are created by company Skin Motion using a combination of audio processing, image recognition and cloud computing.

When her grandmother passed away, Sakyrah “decided to save the voicemail in as many places as I could” and later decided to invest in a soundwave tattoo.

“About a month ago while working on one of my songs, I started to observe the sound waves on the screen and I thought that it would be great for me to get a tattoo of one with my grandmother’s voicemail,” she added.

“After doing some research, I came across a new company called Skin Motion. Their app allows you to link the image of your tattoo to the audio of your choice, so that when you hold your camera over the tattoo, the audio will play the message. …

You can hear the tattoo (from Emily Chan’s Jan. ,3 2018 Daily Mail article),

I went digging for more information about Skin Motion and found this on their About Us webpage,

Skin Motion is a tattoo artist network and patent-pending cloud platform for creating personalized augmented reality Tattoos.

In April 2017, tattoo artist Nate Siggard created the first Soundwave Tattoo™ to be played back using a mobile app. He created a video to show how it worked and the video went viral with over 280 million views.

Skin Motion was founded shortly after to make Soundwave Tattoos a reality for people all over the world who wanted to get them. Some of these people sent us messages about why they wanted to get a Soundwave Tattoo and the stories they shared inspired a team of experts to create the patent-pending augmented reality cloud platform for personalized augmented reality Tattoos.

Skin Motion is based in Los Angeles, California and has licensed Tattoo Artists from countries all over the world to create Soundwave Tattoos. You can find an artist close to you in the Tattoo Artist Directory.

A little more digging brought me to the Insider YouTube channel where I found this video, which offers a little more detail about how the technology works,

I wonder what happens should your ‘loved’ one become an ‘unloved’ one. Is the removal process the same as with a standard tattoo? Curiously, the question is not in the company’s Frequently Asked Questions.

Quadriplegic man reanimates a limb with implanted brain-recording and muscle-stimulating systems

It took me a few minutes to figure out why this item about a quadriplegic (also known as, tetraplegic) man is news. After all, I have a May 17, 2012 posting which features a video and information about a quadri(tetra)plegic woman who was drinking her first cup of coffee, independently, in many years. The difference is that she was using an external robotic arm and this man is using *his own arm*,

This Case Western Reserve University (CRWU) video accompanies a March 28, 2017 CRWU news release, (h/t ScienceDaily March 28, 2017 news item)

Bill Kochevar grabbed a mug of water, drew it to his lips and drank through the straw.

His motions were slow and deliberate, but then Kochevar hadn’t moved his right arm or hand for eight years.

And it took some practice to reach and grasp just by thinking about it.

Kochevar, who was paralyzed below his shoulders in a bicycling accident, is believed to be the first person with quadriplegia in the world to have arm and hand movements restored with the help of two temporarily implanted technologies.

A brain-computer interface with recording electrodes under his skull, and a functional electrical stimulation (FES) system* activating his arm and hand, reconnect his brain to paralyzed muscles.

Holding a makeshift handle pierced through a dry sponge, Kochevar scratched the side of his nose with the sponge. He scooped forkfuls of mashed potatoes from a bowl—perhaps his top goal—and savored each mouthful.

“For somebody who’s been injured eight years and couldn’t move, being able to move just that little bit is awesome to me,” said Kochevar, 56, of Cleveland. “It’s better than I thought it would be.”

Kochevar is the focal point of research led by Case Western Reserve University, the Cleveland Functional Electrical Stimulation (FES) Center at the Louis Stokes Cleveland VA Medical Center and University Hospitals Cleveland Medical Center (UH). A study of the work was published in the The Lancet March 28 [2017] at 6:30 p.m. U.S. Eastern time.

“He’s really breaking ground for the spinal cord injury community,” said Bob Kirsch, chair of Case Western Reserve’s Department of Biomedical Engineering, executive director of the FES Center and principal investigator (PI) and senior author of the research. “This is a major step toward restoring some independence.”

When asked, people with quadriplegia say their first priority is to scratch an itch, feed themselves or perform other simple functions with their arm and hand, instead of relying on caregivers.

“By taking the brain signals generated when Bill attempts to move, and using them to control the stimulation of his arm and hand, he was able to perform personal functions that were important to him,” said Bolu Ajiboye, assistant professor of biomedical engineering and lead study author.

Technology and training

The research with Kochevar is part of the ongoing BrainGate2* pilot clinical trial being conducted by a consortium of academic and VA institutions assessing the safety and feasibility of the implanted brain-computer interface (BCI) system in people with paralysis. Other investigational BrainGate research has shown that people with paralysis can control a cursor on a computer screen or a robotic arm (braingate.org).

“Every day, most of us take for granted that when we will to move, we can move any part of our body with precision and control in multiple directions and those with traumatic spinal cord injury or any other form of paralysis cannot,” said Benjamin Walter, associate professor of neurology at Case Western Reserve School of Medicine, clinical PI of the Cleveland BrainGate2 trial and medical director of the Deep Brain Stimulation Program at UH Cleveland Medical Center.

“The ultimate hope of any of these individuals is to restore this function,” Walter said. “By restoring the communication of the will to move from the brain directly to the body this work will hopefully begin to restore the hope of millions of paralyzed individuals that someday they will be able to move freely again.”

Jonathan Miller, assistant professor of neurosurgery at Case Western Reserve School of Medicine and director of the Functional and Restorative Neurosurgery Center at UH, led a team of surgeons who implanted two 96-channel electrode arrays—each about the size of a baby aspirin—in Kochevar’s motor cortex, on the surface of the brain.

The arrays record brain signals created when Kochevar imagines movement of his own arm and hand. The brain-computer interface extracts information from the brain signals about what movements he intends to make, then passes the information to command the electrical stimulation system.

To prepare him to use his arm again, Kochevar first learned how to use his brain signals to move a virtual-reality arm on a computer screen.

“He was able to do it within a few minutes,” Kirsch said. “The code was still in his brain.”

As Kochevar’s ability to move the virtual arm improved through four months of training, the researchers believed he would be capable of controlling his own arm and hand.

Miller then led a team that implanted the FES systems’ 36 electrodes that animate muscles in the upper and lower arm.

The BCI decodes the recorded brain signals into the intended movement command, which is then converted by the FES system into patterns of electrical pulses.

The pulses sent through the FES electrodes trigger the muscles controlling Kochevar’s hand, wrist, arm, elbow and shoulder. To overcome gravity that would otherwise prevent him from raising his arm and reaching, Kochevar uses a mobile arm support, which is also under his brain’s control.

New Capabilities

Eight years of muscle atrophy required rehabilitation. The researchers exercised Kochevar’s arm and hand with cyclical electrical stimulation patterns. Over 45 weeks, his strength, range of motion and endurance improved. As he practiced movements, the researchers adjusted stimulation patterns to further his abilities.

Kochevar can make each joint in his right arm move individually. Or, just by thinking about a task such as feeding himself or getting a drink, the muscles are activated in a coordinated fashion.

When asked to describe how he commanded the arm movements, Kochevar told investigators, “I’m making it move without having to really concentrate hard at it…I just think ‘out’…and it goes.”

Kocehvar is fitted with temporarily implanted FES technology that has a track record of reliable use in people. The BCI and FES system together represent early feasibility that gives the research team insights into the potential future benefit of the combined system.

Advances needed to make the combined technology usable outside of a lab are not far from reality, the researchers say. Work is underway to make the brain implant wireless, and the investigators are improving decoding and stimulation patterns needed to make movements more precise. Fully implantable FES systems have already been developed and are also being tested in separate clinical research.

Kochevar welcomes new technology—even if it requires more surgery—that will enable him to move better. “This won’t replace caregivers,” he said. “But, in the long term, people will be able, in a limited way, to do more for themselves.”

There is more about the research in a March 29, 2017 article by Sarah Boseley for The Guardian,

Bill Kochevar, 53, has had electrical implants in the motor cortex of his brain and sensors inserted in his forearm, which allow the muscles of his arm and hand to be stimulated in response to signals from his brain, decoded by computer. After eight years, he is able to drink and feed himself without assistance.

“I think about what I want to do and the system does it for me,” Kochevar told the Guardian. “It’s not a lot of thinking about it. When I want to do something, my brain does what it does.”

The experimental technology, pioneered by the Case Western Reserve University in Cleveland, Ohio, is the first in the world to restore brain-controlled reaching and grasping in a person with complete paralysis.

For now, the process is relatively slow, but the scientists behind the breakthrough say this is proof of concept and that they hope to streamline the technology until it becomes a routine treatment for people with paralysis. In the future, they say, it will also be wireless and the electrical arrays and sensors will all be implanted under the skin and invisible.

A March 28, 2017 Lancet news release on EurekAlert provides a little more technical insight into the research and Kochevar’s efforts,

Although only tested with one participant, the study is a major advance and the first to restore brain-controlled reaching and grasping in a person with complete paralysis. The technology, which is only for experimental use in the USA, circumvents rather than repairs spinal injuries, meaning the participant relies on the device being implanted and switched on to move.

“Our research is at an early stage, but we believe that this neuro-prosthesis could offer individuals with paralysis the possibility of regaining arm and hand functions to perform day-to-day activities, offering them greater independence,” said lead author Dr Bolu Ajiboye, Case Western Reserve University, USA. “So far it has helped a man with tetraplegia to reach and grasp, meaning he could feed himself and drink. With further development, we believe the technology could give more accurate control, allowing a wider range of actions, which could begin to transform the lives of people living with paralysis.” [1]

Previous research has used similar elements of the neuro-prosthesis. For example, a brain-computer interface linked to electrodes on the skin has helped a person with less severe paralysis open and close his hand, while other studies have allowed participants to control a robotic arm using their brain signals. However, this is the first to restore reaching and grasping via the system in a person with a chronic spinal cord injury.

In this study, a 53 year-old man who had been paralysed below the shoulders for eight years underwent surgery to have the neuro-prosthesis fitted.

This involved brain surgery to place sensors in the motor cortex area of his brain responsible for hand movement – creating a brain-computer interface that learnt which movements his brain signals were instructing for. This initial stage took four months and included training using a virtual reality arm.

He then underwent another procedure placing 36 muscle stimulating electrodes into his upper and lower arm, including four that helped restore finger and thumb, wrist, elbow and shoulder movements. These were switched on 17 days after the procedure, and began stimulating the muscles for eight hours a week over 18 weeks to improve strength, movement and reduce muscle fatigue.

The researchers then wired the brain-computer interface to the electrical stimulators in his arm, using a decoder (mathematical algorithm) to translate his brain signals into commands for the electrodes in his arm. The electrodes stimulated the muscles to produce contractions, helping the participant intuitively complete the movements he was thinking of. The system also involved an arm support to stop gravity simply pulling his arm down.

During his training, the participant described how he controlled the neuro-prosthesis: “It’s probably a good thing that I’m making it move without having to really concentrate hard at it. I just think ‘out’ and it just goes.”

After 12 months of having the neuro-prosthesis fitted, the participant was asked to complete day-to-day tasks, including drinking a cup of coffee and feeding himself. First of all, he observed while his arm completed the action under computer control. During this, he thought about making the same movement so that the system could recognise the corresponding brain signals. The two systems were then linked and he was able to use it to drink a coffee and feed himself.

He successfully drank in 11 out of 12 attempts, and it took him roughly 20-40 seconds to complete the task. When feeding himself, he did so multiple times – scooping forkfuls of food and navigating his hand to his mouth to take several bites.

“Although similar systems have been used before, none of them have been as easy to adopt for day-to-day use and they have not been able to restore both reaching and grasping actions,” said Dr Ajiboye. “Our system builds on muscle stimulating electrode technology that is already available and will continue to improve with the development of new fully implanted and wireless brain-computer interface systems. This could lead to enhanced performance of the neuro-prosthesis with better speed, precision and control.” [1]

At the time of the study, the participant had had the neuro-prosthesis implanted for almost two years (717 days) and in this time experienced four minor, non-serious adverse events which were treated and resolved.

Despite its achievements, the neuro-prosthesis still had some limitations, including that movements made using it were slower and less accurate than those made using the virtual reality arm the participant used for training. When using the technology, the participant also needed to watch his arm as he lost his sense of proprioception – the ability to intuitively sense the position and movement of limbs – as a result of the paralysis.

Writing in a linked Comment, Dr Steve Perlmutter, University of Washington, USA, said: “The goal is futuristic: a paralysed individual thinks about moving her arm as if her brain and muscles were not disconnected, and implanted technology seamlessly executes the desired movement… This study is groundbreaking as the first report of a person executing functional, multi-joint movements of a paralysed limb with a motor neuro-prosthesis. However, this treatment is not nearly ready for use outside the lab. The movements were rough and slow and required continuous visual feedback, as is the case for most available brain-machine interfaces, and had restricted range due to the use of a motorised device to assist shoulder movements… Thus, the study is a proof-of-principle demonstration of what is possible, rather than a fundamental advance in neuro-prosthetic concepts or technology. But it is an exciting demonstration nonetheless, and the future of motor neuro-prosthetics to overcome paralysis is brighter.”

[1] Quote direct from author and cannot be found in the text of the Article.

Here’s a link to and a citation for the paper,

Restoration of reaching and grasping movements through brain-controlled muscle stimulation in a person with tetraplegia: a proof-of-concept demonstration by A Bolu Ajiboye, Francis R Willett, Daniel R Young, William D Memberg, Brian A Murphy, Jonathan P Miller, Benjamin L Walter, Jennifer A Sweet, Harry A Hoyen, Michael W Keith, Prof P Hunter Peckham, John D Simeral, Prof John P Donoghue, Prof Leigh R Hochberg, Prof Robert F Kirsch. The Lancet DOI: http://dx.doi.org/10.1016/S0140-6736(17)30601-3 Published: 28 March 2017 [online?]

This paper is behind a paywall.

For anyone  who’s interested, you can find the BrainGate website here.

*I initially misidentified the nature of the achievement and stated that Kochevar used a “robotic arm, which is attached to his body” when it was his own reanimated arm. Corrected on April 25, 2017.

Functional hybrid system that can connect human tissue with electronic devices

I’ve tagged this particular field of interest ‘machine/flesh’ because I find it more descriptive than ‘bio-hybrid system’ which was the term used in a Nov. 15, 2016 news item on phys.org,

One of the biggest challenges in cognitive or rehabilitation neurosciences is the ability to design a functional hybrid system that can connect and exchange information between biological systems, like neurons in the brain, and human-made electronic devices. A large multidisciplinary effort of researchers in Italy brought together physicists, chemists, biochemists, engineers, molecular biologists and physiologists to analyze the biocompatibility of the substrate used to connect these biological and human-made components, and investigate the functionality of the adhering cells, creating a living biohybrid system.

A Nov.15, 2016 American Institute of Physics news release on EurekAlert, which originated the news item, details the investigation,

In an article appearing this week in AIP Advances, from AIP Publishing, the research team used the interaction between light and matter to investigate the material properties at the molecular level using Raman spectroscopy, a technique that, until now, has been principally applied to material science. Thanks to the coupling of the Raman spectrometer with a microscope, spectroscopy becomes a useful tool for investigating micro-objects such as cells and tissues. Raman spectroscopy presents clear advantages for this type of investigation: The molecular composition and the modi?cation of subcellular compartments can be obtained in label-free conditions with non-invasive methods and under physiological conditions, allowing the investigation of a large variety of biological processes both in vitro and in vivo.

Once the biocompatibility of the substrate was analyzed and the functionality of the adhering cells investigated, the next part of this puzzle is connecting with the electronic component. In this case a memristor was used.

“Its name reveals its peculiarity (MEMory ResISTOR), it has a sort of “memory”: depending on the amount of voltage that has been applied to it in the past, it is able to vary its resistance, because of a change of its microscopic physical properties,” said Silvia Caponi, a physicist at the Italian National Research Council in Rome. By combining memristors, it is possible to create pathways within the electrical circuits that work similar to the natural synapses, which develop variable weight in their connections to reproduce the adaptive/learning mechanism. Layers of organic polymers, like polyaniline (PANI) a semiconductor polymer, also have memristive properties, allowing them to work directly with biological materials into a hybrid bio-electronic system.

“We applied the analysis on a hybrid bio-inspired device but in a prospective view, this work provides the proof of concept of an integrated study able to analyse the status of living cells in a large variety of applications that merges nanosciences, neurosciences and bioelectronics,” said Caponi. A natural long-term objective of this work would be interfacing machines and nervous systems as seamlessly as possible.

The multidisciplinary team is ready to build on this proof of principle to realize the potential of memristor networks.

“Once assured the biocompatibility of the materials on which neurons grow,” said Caponi, “we want to define the materials and their functionalization procedures to find the best configuration for the neuron-memristor interface to deliver a full working hybrid bio-memristive system.”

Caption: These are immunofluorescence analysis of SH-SY5Y cells treated for 5 days with 10uM Retinoic Acid and 50ng/ml BDNF for the next 3 days. The DAPI fluorescence stain is blue and Beta-tubulin is green. Credit: Caponi, et al.

Caption: These are immunofluorescence analysis of SH-SY5Y cells treated for 5 days with 10uM Retinoic Acid and 50ng/ml BDNF for the next 3 days. The DAPI fluorescence stain is blue and Beta-tubulin is green. Credit: Caponi, et al.

Here’s a link to and a citation for the paper,

A multidisciplinary approach to study the functional properties of neuron-like cell models constituting a living bio-hybrid system: SH-SY5Y cells adhering to PANI substrate by S. Caponi, S. Mattana, M. Ricci, K. Sagini, L. J. Juarez-Hernandez, A. M. Jimenez-Garduño, N. Cornella, L. Pasquardini, L. Urbanelli, P. Sassi, A. Morresi, C. Emiliani, D. Fioretto, M. Dalla Serra, C. Pederzolli, S. Iannotta, P. Macchi, and C. Musio. AIP Advances 6, 111303 (2016); http://dx.doi.org/10.1063/1.4966587

This paper appears to be open access.

‘Seamless’ bioeletronics made possible with protein bridge

For some years now I’ve been tagging certain posts with ‘machine/flesh’ as more bioelectronic devices are being invented for use as implants of various kinds.

Researchers at the University of Washington (state) have found a means of making bioelectronics implants a more comfortable fit in the body according to an Oct. 4, 2016 news item on phys.org,

Life has always played by its own set of molecular rules. From the biochemistry behind the first cells, evolution has constructed wonders like hard bone, rough bark and plant enzymes that harvest light to make food.

But our tools for manipulating life—to treat disease, repair damaged tissue and replace lost limbs—come from the nonliving realm: metals, plastics and the like. Though these save and preserve lives, our synthetic treatments are rooted in a chemical language ill-suited to our organic elegance. Implanted electrodes scar, wires overheat and our bodies struggle against ill-fitting pumps, pipes or valves.

A solution lies in bridging this gap where artificial meets biological—harnessing biological rules to exchange information between the biochemistry of our bodies and the chemistry of our devices. In a paper published Sept. 22 [2016] in Scientific Reports, engineers at the University of Washington unveiled peptides—small proteins which carry out countless essential tasks in our cells—that can provide just such a link.

An Oct. 3, 2016 University of Washington (state) news release (also on EurekAlert), which originated the news item, expands on the theme,

The team, led by UW professor Mehmet Sarikaya in the Departments of Materials Science & Engineering, shows how a genetically engineered peptide can assemble into nanowires atop 2-D, solid surfaces that are just a single layer of atoms thick. These nanowire assemblages are critical because the peptides relay information across the bio/nano interface through molecular recognition — the same principles that underlie biochemical interactions such as an antibody binding to its specific antigen or protein binding to DNA.

Since this communication is two-way, with peptides understanding the “language” of technology and vice versa, their approach essentially enables a coherent bioelectronic interface.

“Bridging this divide would be the key to building the genetically engineered biomolecular solid-state devices of the future,” said Sarikaya, who is also a professor of chemical engineering and oral health sciences.

His team in the UW Genetically Engineered Materials Science and Engineering Center studies how to coopt the chemistry of life to synthesize materials with technologically significant physical, electronic and photonic properties. To Sarikaya, the biochemical “language” of life is a logical emulation.

“Nature must constantly make materials to do many of the same tasks we seek,” he said.

The UW team wants to find genetically engineered peptides with specific chemical and structural properties. They sought out a peptide that could interact with materials such as gold, titanium and even a mineral in bone and teeth. These could all form the basis of future biomedical and electro-optical devices. Their ideal peptide should also change the physical properties of synthetic materials and respond to that change. That way, it would transmit “information” from the synthetic material to other biomolecules — bridging the chemical divide between biology and technology.

In exploring the properties of 80 genetically selected peptides — which are not found in nature but have the same chemical components of all proteins — they discovered that one, GrBP5, showed promising interactions with the semimetal graphene. They then tested GrBP5’s interactions with several 2-D nanomaterials which, Sarikaya said, “could serve as the metals or semiconductors of the future.”

“We needed to know the specific molecular interactions between this peptide and these inorganic solid surfaces,” he added.

Their experiments revealed that GrBP5 spontaneously organized into ordered nanowire patterns on graphene. With a few mutations, GrBP5 also altered the electrical conductivity of a graphene-based device, the first step toward transmitting electrical information from graphene to cells via peptides.

In parallel, Sarikaya’s team modified GrBP5 to produce similar results on a semiconductor material — molybdenum disulfide — by converting a chemical signal to an optical signal. They also computationally predicted how different arrangements of GrBP5 nanowires would affect the electrical conduction or optical signal of each material, showing additional potential within GrBP5’s physical properties.

“In a way, we’re at the flood gates,” said Sarikaya. “Now we need to explore the basic properties of this bridge and how we can modify it to permit the flow of ‘information’ from electronic and photonic devices to biological systems.”

Here’s a link to and a citation for the paper,

Bioelectronic interfaces by spontaneously organized peptides on 2D atomic single layer materials by Yuhei Hayamizu, Christopher R. So, Sefa Dag, Tamon S. Page, David Starkebaum, & Mehmet Sarikaya. Scientific Reports 6, Article number: 33778 (2016) doi:10.1038/srep33778 Published online: 22 September 2016

This paper is open access.

This image illustrates the GrBP5 nanowires,

A top view image of GrBP5 nanowires on a 2-D surface of molybdenum disulfide.Mehmet Sarikaya/Scientific Reports

A top view image of GrBP5 nanowires on a 2-D surface of molybdenum disulfide.Mehmet Sarikaya/Scientific Reports

Man with world’s first implanted bionic arm participates in first Cybathlon (olympics for cyborgs)

The world’s first Cybathlon is being held on Oct. 8, 2016 in Zurich, Switzerland. One of the participants is an individual who took part in some groundbreaking research into implants which was featured in my Oct. 10, 2014 posting. There’s more about the Cybathlon and the participant in an Oct. 4, 2016 news item on phys.org,

A few years ago, a patient was implanted with a bionic arm for the first time in the world using control technology developed at Chalmers University of Technology. He is now taking part in Cybathlon, a new international competition in which 74 participants with physical disabilities will compete against each other, using the latest robotic prostheses and other assistive technologies – a sort of ‘Cyborg Olympics’.

The Paralympics will now be followed by the Cybathlon, which takes place in Zürich on October 8th [2016]. This is the first major competition to show that the boundaries between human and machine are becoming more and more blurred. The participants will compete in six different disciplines using the machines they are connected to as well as possible.

Cybathlon is intended to drive forward the development of prostheses and other types of assistive aids. Today, such technologies are often highly advanced technically, but provide limited value in everyday life.

An Oct. 4, 2016 Chalmers University of Technology press release by Johanna Wilde, which originated the news item, provides details about the competitor, his prosthetic device, and more,

Magnus, one of the participants, has now had his biomechatronically integrated arm prosthesis for almost four years. He says that his life has totally changed since the implantation, which was performed by Dr Rickard Brånemark, associate professor at Sahlgrenska University Hospital.

“I don’t feel handicapped since I got this arm”, says Magnus. “I can now work full time and can perform all the tasks in both my job and my family life. The prosthesis doesn’t feel like a machine, but more like my own arm.”

Magnus lives in northern Sweden and works as a lorry driver. He regularly visits Gothenburg in southern Sweden and carries out tests with researcher Max Ortiz Catalan, assistant professor at Chalmers University of Technology, who has been in charge of developing the technology and leads the team competing in the Cybathlon.

“This is a completely new research field in which we have managed to directly connect the artificial limb to the skeleton, nerves and muscles,” says Dr Max Ortiz Catalan. “In addition, we are including direct neural sensory feedback in the prosthetic arm so the patient can intuitively feel with it.”

Today Magnus can feel varying levels of pressure in his artificial hand, something which is necessary to instinctively grip an object firmly enough. He is unique in the world in having a permanent sensory connection between the prosthesis and his nervous system, working outside laboratory conditions. Work is now under way to add more types of sensations.

At the Cybathlon he will be competing for the Swedish team, which is formed by Chalmers University of Technology, Sahlgrenska University Hospital and the company Integrum AB.

The competition has a separate discipline for arm prostheses. In this discipline Magnus has to complete a course made up of six different stations at which the prosthesis will be put to the test. For example, he has to open a can with a can opener, load a tray with crockery and open a door with the tray in his hand. The events at the Cybathlon are designed to be spectator-friendly while being based on various operations that the participants have to cope with in their daily lives.

“However, the competition will not really show the unique advantages of our technology, such as the sense of touch and the bone-anchored attachment which makes the prosthesis comfortable enough to wear all day,” says Max Ortiz Catalan.

Magnus is the only participant with an amputation above the elbow. This naturally makes the competition more difficult for him than for the others, who have a natural elbow joint.

“From a competitive perspective Cybathlon is far from ideal to demonstrate clinically viable technology,” says Max Ortiz Catalan. “But it is a major and important event in the human-machine interface field in which we would like to showcase our technology. Unlike several of the other participants, Magnus will compete in the event using the same technology he uses in his everyday life.”

Facts about Cybathlon
•    The very first Cybathlon is being organised by the Swiss university ETH Zürich.
•    The €5 million event will take place in Zürich´s 7600 spectator ice hockey stadium, Swiss Arena.
•    74 participants are competing for 59 different teams from 25 countries around the world. In total, the teams consist of about 300 scientists, engineers, support staff and competitors.
•    The teams range from small ad hoc teams to the world’s largest manufacturers of advanced prostheses.
•    The majority of the teams are groups from research labs and many of the prostheses have come straight out of the lab.
•    Unlike the Olympics and Paralympics, the Cybathlon participants are not athletes but ordinary people with various disabilities. The aims of the competition are to establish a dialogue between academia and industry, to facilitate discussion between technology developers and people with disabilities and to promote the use of robotic assistive aids to the general public.
•    Cybathlon will return in 2020, as a seven-day event in Tokyo, to coincide with the Olympics.

Facts about the Swedish team
The Opra Osseointegration team is a multidisciplinary team comprising technical and medical partners. The team is led by Dr Max Ortiz Catalan, assistant professor at Chalmers University of Technology, who has been in charge of developing the technology in close collaboration with Dr Rickard Brånemark, who is a surgeon at Sahlgrenska University Hospital and an associate professor at Gothenburg University. Dr Brånemark led the team performing the implantation of the device. Integrum AB, a Swedish company, complements the team as the pioneering provider of bone-anchored limb prostheses.

This video gives you an idea of what it’s in store on Oct. 8, 2016,

Long-term brain mapping with injectable electronics

Charles Lieber and his team at Harvard University announced a success with their work on injectable electronics last year (see my June 11, 2015 posting for more) and now they are reporting on their work with more extensive animal studies according to an Aug. 29, 2016 news item on psypost.org,

Scientists in recent years have made great strides in the quest to understand the brain by using implanted probes to explore how specific neural circuits work.

Though effective, those probes also come with their share of problems as a result of rigidity. The inflammation they produce induces chronic recording instability and means probes must be relocated every few days, leaving some of the central questions of neuroscience – like how the neural circuits are reorganized during development, learning and aging- beyond scientists’ reach.

But now, it seems, things are about to change.

Led by Charles Lieber, The Mark Hyman Jr. Professor of Chemistry and chair of the Department of Chemistry and Chemical Biology, a team of researchers that included graduate student Tian-Ming Fu, postdoctoral fellow Guosong Hong, graduate student Tao Zhou and others, has demonstrated that syringe-injectable mesh electronics can stably record neural activity in mice for eight months or more, with none of the inflammation

An Aug. 29, 2016 Harvard University press release, which originated the news item, provides more detail,

“With the ability to follow the same individual neurons in a circuit chronically…there’s a whole suite of things this opens up,” Lieber said. “The eight months we demonstrate in this paper is not a limit, but what this does show is that mesh electronics could be used…to investigate neuro-degenerative diseases like Alzheimer’s, or processes that occur over long time, like aging or learning.”

Lieber and colleagues also demonstrated that the syringe-injectable mesh electronics could be used to deliver electrical stimulation to the brain over three months or more.

“Ultimately, our aim is to create these with the goal of finding clinical applications,” Lieber said. “What we found is that, because of the lack of immune response (to the mesh electronics), which basically insulates neurons, we can deliver stimulation in a much more subtle way, using lower voltages that don’t damage tissue.”

The possibilities, however, don’t end there.

The seamless integration of the electronics and biology, Lieber said, could open the door to an entirely new class of brain-machine interfaces and vast improvements in prosthetics, among other fields.

“Today, brain-machine interfaces are based on traditional implanted probes, and there has been some impressive work that’s been done in that field,” Lieber said. “But all the interfaces rely on the same technique to decode neural signals.”

Because traditional rigid implanted probes are invariably unstable, he explained, researchers and clinicians rely on decoding what they call the “population average” – essentially taking a host of neural signals and applying complex computational tools to determine what they mean.

Using tissue-like mesh electronics, by comparison, researchers may be able to read signals from specific neurons over time, potentially allowing for the development of improved brain-machine interfaces for prosthetics.

“We think this is going to be very powerful, because we can identify circuits and both record and stimulate in a way that just hasn’t been possible before,” Lieber said. “So what I like to say is: I think therefore it happens.”

Lieber even held out the possibility that the syringe-injectable mesh electronics could one day be used to treat catastrophic injuries to the brain and spinal cord.

“I don’t think that’s science-fiction,” he said. “Other people may say that will be possible through, for example, regenerative medicine, but we are pursuing this from a different angle.

“My feeling is that this is about a seamless integration between the biological and the electronic systems, so they’re not distinct entities,” he continued. “If we can make the electronics look like the neural network, they will work together…and that’s where you want to be if you want to exploit the strengths of both.”

In the 2015 posting, Lieber was discussing cyborgs, here he broaches the concept without using the word, “… seamless integration between the biological and the electronic systems, so they’re not distinct entities.”

Here’s a link to and a citation for the paper,

Stable long-term chronic brain mapping at the single-neuron level by Tian-Ming Fu, Guosong Hong, Tao Zhou, Thomas G Schuhmann, Robert D Viveros, & Charles M Lieber. Nature Methods (2016) doi:10.1038/nmeth.3969 Published online 29 August 2016

This paper is behind a paywall.

Biohackers (also known as bodyhackers or grinders) become more common?

Stephen Melendez’s June 11, 2016 story about biohackers/bodyhackers/grinders for Fast Company sports a striking image in the banner, an x-ray of a pair hands featuring some mysterious additions to the webbing between thumbs and forefingers (Note: Links have been removed),

Tim Shank can guarantee he’ll never leave home without his keys. Why? His house keys are located inside his body.

Shank, the president of the Minneapolis futurist group TwinCities+, has a chip installed in his hand that can communicate electronically with his front door and tell it to unlock itself. His wife has one, too.

In fact, Shank has several chips in his hand, including a near field communication (NFC) chip like the ones used in Apple Pay and similar systems, which stores a virtual business card with contact information for TwinCities+. “[For] people with Android phones, I can just tap their phone with my hand, right over the chip, and it will send that information to their phone,” he says. In the past, he’s also used a chip to store a bitcoin wallet.

Shank is one of a growing number of “biohackers” who implant hardware ranging from microchips to magnets inside their bodies.

Certainly the practice seems considerably more developed since the first time it was mentioned here in a May 27, 2010 posting about a researcher who’d implanted a chip into his body which he then contaminated with a computer virus. In the comments, you’ll find Amal Grafstraa who’s mentioned in the Melendez article at some length, from the Melendez article (Note: Links have been removed),

Some biohackers use their implants in experimental art projects. Others who have disabilities or medical conditions use them to improve their quality of life, while still others use the chips to extend the limits of human perception. …

Experts sometimes caution that the long-term health risks of the practice are still unknown. But many biohackers claim that, if done right, implants can be no more dangerous than getting a piercing or tattoo. In fact, professional body piercers are frequently the ones tasked with installing these implants, given that they possess the training and sterilization equipment necessary to break people’s skin safely.

“When you talk about things like risk, things like putting it in your body, the reality is the risk of having one of these installed is extremely low—it’s even lower than an ear piercing,” claims Amal Graafstra, the founder of Dangerous Things, a biohacking supply company.

Graafstra, who is also the author of the book RFID Toys, says he first had an RFID chip installed in his hand in 2005, which allowed him to unlock doors without a key. When the maker movement took off a few years later, and as more hackers began to explore what they could put inside their bodies, he founded Dangerous Things with the aim of ensuring these procedures were done safely.

“I decided maybe it’s time to wrap a business model around this and make sure that the things people are trying to put in their bodies are safe,” he says. The company works with a network of trained body piercers and offers online manuals and videos for piercers looking to get up to speed on the biohacking movement.

At present, these chips are capable of verifying users’ identities and opening doors. And according to Graafstra, a next-generation chip will have enough on-board cryptographic power to potentially work with credit card terminals securely.

“The technology is there—we can definitely talk to payment terminals with it—but we don’t have the agreements in place with banks [and companies like] MasterCard to make that happen,” he says.

Paying for goods with an implantable chip might sound unusual for consumers and risky for banks, but Graafstra thinks the practice will one day become commonplace. He points to a survey released by Visa last year that found that 25% of Australians are “at least slightly interested” in paying for purchases through a chip implanted in their bodies.

Melendez’s article is fascinating and well worth reading in its entirety. It’s not all keys and commerce as this next and last excerpt shows,

Other implantable technology has more of an aesthetic focus: Pittsburgh biohacking company Grindhouse Wetware offers a below-the-skin, star-shaped array of LED lights called Northstar. While the product was inspired by the on-board lamps of a device called Circadia that Grindhouse founder Tim Cannon implanted to send his body temperature to a smartphone, the commercially available Northstar features only the lights and is designed to resemble natural bioluminescence.

“This particular device is mainly aesthetic,” says Grindhouse spokesman Ryan O’Shea. “It can backlight tattoos or be used in any kind of interpretive dance, or artists can use it in various ways.”

The lights activate in the presence of a magnetic field—one that is often provided by magnets already implanted in the same user’s fingertips. Which brings up another increasingly common piece of bio-hardware: magnetic finger implants. ….

There are other objects that can be implanted in bodies. In one case, an artist, Wafaa Bilal had a camera implanted into the back of his head for a 3rd eye. I mentioned the Iraqi artist in my April 13, 2011 posting titled: Blood, memristors, cyborgs plus brain-controlled computers, prosthetics, and art (scroll down about 75% of the way). Bilal was unable to find a doctor who would perform the procedure so he went to a body-piercing studio. Unfortunately, the posting chronicles his infection and subsequent removal of the camera (h/t Feb. 11, 2011 BBC [British Broadcasting Corporation] news online article).

Observations

It’s been a while since I’ve written about bodyhacking and I’d almost forgotten about the practice relegating it to the category of “one of those trendy ideas that get left behind as interest shifts.” My own interest had shifted more firmly to neuroprosthetics (the integration of prostheses into the nervous system).

I had coined a tag for bodyhacking and neuroprostheses: machine/flesh which covers both those topics and more (e.g. cyborgs) as we continue to integrate machines into our bodies.

Final note

I was reminded of Wafaa Bilal recently when checking out a local arts magazine, Preview: the gallery guide, June/July/August 2016 issue. His work (the 168:01show) is being shown in Calgary, Alberta, Canada at the Esker Foundation from May 27 to August 28, 2016,

168:01 is a major solo exhibition of new and recent work by Iraqi-born, New York-based artist Wafaa Bilal, renowned for his online performances and technologically driven encounters that speak to the impact of international politics on individual lives.

In 168:01, Bilal takes the Bayt al-Hikma, or House of Wisdom, as a starting point for a sculptural installation of a library. The Bayt al-Hikma was a major academic center during the Islamic Golden Age where Muslim, Jewish, and Christian scholars studied the humanities and science. By the middle of the Ninth Century, the House of Wisdom had accumulated the largest library in the world. Four centuries later, a Mongol siege laid waste to all the libraries of Baghdad along with the House of Wisdom. According to some accounts, the library was thrown into the Tigris River to create a bridge of books for the Mongol army to cross. The pages bled ink into the river for seven days – or 168 hours, after which the books were drained of knowledge. Today, the Bayt al-Hikma represents one of the most well-known examples of historic cultural loss as a casualty of wartime.

For this exhibition, Bilal has constructed a makeshift library filled with empty white books. The white books symbolize the priceless cultural heritage destroyed at Bayt al-Hikma as well as the libraries, archives, and museums whose systematic decimation by occupying forces continues to ravage his homeland. Throughout the duration of the exhibition, the white books will slowly be replaced with visitor donations from a wishlist compiled by The College of Fine Arts at the University of Baghdad, whose library was looted and destroyed in 2003. At the end of each week a volunteer unpacks the accumulated shipments, catalogues each new book by hand, and places the books on the shelves. At the end of the exhibition, all the donated books will be sent to the University of Baghdad to help rebuild their library. This exchange symbolizes the power of individuals to rectify violence inflicted on cultural spaces that are meant to preserve and store knowledge for future generations.

In conjunction with the library, Bilal presents a powerful suite of photographs titled The Ashes Series that brings the viewer closer to images of violence and war in the Middle East. In an effort to foster empathy and humanize the onslaught of violent images that inundate Western media during wartime, Bilal has reconstructed journalistic images of the destruction caused by the Iraq War. He writes, “Reconstructing the destructed spaces is a way to exist in them, to share them with an audience, and to provide a layer of distance, as the original photographs are too violent and run the risk of alienating the viewer. It represents an attempt to make sense of the destruction and to preserve the moment of serenity after the dust has settled, to give the ephemeral moment extended life in a mix of beauty and violence.” In the photograph Al-Mutanabbi Street from The Ashes Series, the viewer encounters dilapidated historic and modern buildings on a street covered with layers upon layers of rubble and fragments of torn books. Bilal’s images emanate a slowness that deepens engagement between the viewer and the image, thereby inviting them to share the burden of obliterated societies and reimagine a world built on the values of peace and hope.

The House of Wisdom has been mentioned here a few times perhaps most comprehensively and in the context of the then recent opening of the King Abdullah University for Science and Technology (KAUST; located in Saudi Arabia) in this Sept. 24, 2009 posting (scroll down about 45% of the way).

Anyone interested in hacking their own body?

 

I expect you can find out more Amal Grafstraa’s website.

Chip in brain lets quadriplegic (tetraplegic) move hands and fingers

An April 13, 2016 news item on ScienceDaily describes the latest brain implant,

Six years ago, he was paralyzed in a diving accident. Today, he participates in clinical sessions during which he can grasp and swipe a credit card or play a guitar video game with his own fingers and hand. These complex functional movements are driven by his own thoughts and a prototype medical system that are detailed in a study published online today in the journal Nature.

The device, called NeuroLife, was invented at Battelle, which teamed with physicians and neuroscientists from The Ohio State University Wexner Medical Center to develop the research approach and perform the clinical study. Ohio State doctors identified the study participant and implanted a tiny computer chip into his brain.

An April 13, 2016 Ohio State University news release on EurekAlert, which originated the news item, provides more details about the participant and the technology,

That pioneering participant, Ian Burkhart, is a 24-year-old quadriplegic from Dublin, Ohio, and the first person to use this technology. This electronic neural bypass for spinal cord injuries reconnects the brain directly to muscles, allowing voluntary and functional control of a paralyzed limb by using his thoughts. The device interprets thoughts and brain signals then bypasses his injured spinal cord and connects directly to a sleeve that stimulates the muscles that control his arm and hand.

“We’re showing for the first time that a quadriplegic patient is able to improve his level of motor function and hand movements,” said Dr. Ali Rezai, a co-author of the study and a neurosurgeon at Ohio State’s Wexner Medical Center.

Burkhart first demonstrated the neural bypass technology in June 2014, when he was able to open and close his hand simply by thinking about it. Now, he can perform more sophisticated movements with his hands and fingers such as picking up a spoon or picking up and holding a phone to his ear — things he couldn’t do before and which can significantly improve his quality of life.

“It’s amazing to see what he’s accomplished,” said Nick Annetta, electrical engineering lead for Battelle’s team on the project. “Ian can grasp a bottle, pour the contents of the bottle into a jar and put the bottle back down. Then he takes a stir bar, grips that and then stirs the contents of the jar that he just poured and puts it back down. He’s controlling it every step of the way.”

The neural bypass technology combines algorithms that learn and decode the user’s brain activity and a high-definition muscle stimulation sleeve that translates neural impulses from the brain and transmits new signals to the paralyzed limb.

The Battelle team has been working on this technology for more than a decade. To develop the algorithms, software and stimulation sleeve, Battelle scientists first recorded neural impulses from an electrode array implanted in a paralyzed person’s brain. They used that recorded data to illustrate the device’s effect on the patient and prove the concept.

Four years ago, former Battelle researcher Chad Bouton and his team began collaborating with Ohio State Neurological Institute researchers and clinicians Rezai and Dr. Jerry Mysiw to design the clinical trials and validate the feasibility of using the neural bypass technology in patients.

“In the 30 years I’ve been in this field, this is the first time we’ve been able to offer realistic hope to people who have very challenging lives,” said Mysiw, chair of the Department of Physical Medicine and Rehabilitation at Ohio State. “What we’re looking to do is help these people regain more control over their bodies.”

During a three-hour surgery in April 2014, Rezai implanted a computer chip smaller than a pea onto the motor cortex of Burkhart’s brain.

The Ohio State and Battelle teams worked together to figure out the correct sequence of electrodes to stimulate to allow Burkhart to move his fingers and hand functionally. For example, Burkhart uses different brain signals and muscles to rotate his hand, make a fist or pinch his fingers together to grasp an object. As part of the study, Burkhart worked for months using the electrode sleeve to stimulate his forearm to rebuild his atrophied muscles so they would be more responsive to the electric stimulation.

“During the last decade, we’ve learned how to decipher brain signals in patients who are completely paralyzed and now, for the first time, those thoughts are being turned into movement,” said study co-author Bouton, who directed Battelle’s team before he joined the New York-based Feinstein Institute for Medical Research. “Our findings show that signals recorded from within the brain can be re-routed around an injury to the spinal cord, allowing restoration of functional movement and even movement of individual fingers.”

Burkhart said it was an easy decision to participate in the FDA-approved clinical trial at Ohio State’s Wexner Medical Center because he wanted to try to help others with spinal cord injuries. “I just kind of think that it’s my obligation to society,” Burkhart said. “If someone else had an opportunity to do it in some other part of the world, I would hope that they would commit their time so that everyone can benefit from it in the future.”

Rezai and the team from Battelle agree that this technology holds the promise to help patients affected by various brain and spinal cord injuries such as strokes and traumatic brain injury to be more independent and functional.

“We’re hoping that this technology will evolve into a wireless system connecting brain signals and thoughts to the outside world to improve the function and quality of life for those with disabilities,” Rezai said. “One of our major goals is to make this readily available to be used by patients at home.”

Burkhart is the first of a potential five participants in a clinical study. Mysiw and Rezai have identified a second patient who is scheduled to start the study in the summer.

“Participating in this research has changed me in the sense that I have a lot more hope for the future now,” Burkhart said. “I always did have a certain level of hope, but now I know, first-hand, that there are going to be improvements in science and technology that will make my life better.”

Here’s a link to and a citation for the paper,

Restoring cortical control of functional movement in a human with quadriplegia by Chad E. Bouton, Ammar Shaikhouni, Nicholas V. Annetta, Marcia A. Bockbrader, David A. Friedenberg, Dylan M. Nielson, Gaurav Sharma, Per B. Sederberg, Bradley C. Glenn, W. Jerry Mysiw, Austin G. Morgan, Milind Deogaonkar, & Ali R. Rezai. Nature (2016)  doi:10.1038/nature17435 Published online 13 April 2016

This paper is behind a paywall but there is an in depth April 13, 2016 article by Linda Geddes in Nature providing nuggets of new insight such as this,

Previous studies have suggested that after spinal-cord injuries, the brain undergoes ‘reorganization’ — a rewiring of its connections. But this new work suggests that the degree of reorganization occurring after such injuries may be less than previously assumed. “It gives us a lot of hope that there are perhaps not as many neural changes in the brain as we might have imagined [emphasis mine] after an injury like this, and we can bypass damaged areas of the spinal cord to regain movement,” says Bouton.

The Geddes article is open access.

Finally, there’s an April 13, 2016 article by Will Oremus for Slate.com, which notes that this story is not a fairy tale as there’s a possibility the chip will be removed in the near future as the US Food and Drug Administration’s approval of the device was conditional due to this,

Burkhart knows the device was never meant to last forever. The brain implant’s efficacy gradually degrades over time due to scarring in the brain tissue, and eventually that hardware degradation will start to undo the progress that Burkhart and the software have made together.

He told me he has accepted that his newfound mobility is temporary, and that the progress he has made is likely to benefit posterity more than it benefits him. “I now know that when I’m connected to the system I can do all these great things. It won’t be too much of a shock to me [when it’s over], because even now I can only use the system for a few hours a week when I’m down in the lab. But it will be something I’ll certainly miss.”

Skin as a touchscreen (“smart” hands)

An April 11, 2016 news item on phys.org highlights some research presented at the IEEE (Institute of Electrical and Electronics Engineers) Haptics (touch) Symposium 2016,

Using your skin as a touchscreen has been brought a step closer after UK scientists successfully created tactile sensations on the palm using ultrasound sent through the hand.

The University of Sussex-led study – funded by the Nokia Research Centre and the European Research Council – is the first to find a way for users to feel what they are doing when interacting with displays projected on their hand.

This solves one of the biggest challenges for technology companies who see the human body, particularly the hand, as the ideal display extension for the next generation of smartwatches and other smart devices.

Current ideas rely on vibrations or pins, which both need contact with the palm to work, interrupting the display.

However, this new innovation, called SkinHaptics, sends sensations to the palm from the other side of the hand, leaving the palm free to display the screen.

An April 11, 2016 University of Sussex press release (also on EurekAlert) by James Hakmer, which originated the news item, provides more detail,

The device uses ‘time-reversal’ processing to send ultrasound waves through the hand. This technique is effectively like ripples in water but in reverse – the waves become more targeted as they travel through the hand, ending at a precise point on the palm.

It draws on a rapidly growing field of technology called haptics, which is the science of applying touch sensation and control to interaction with computers and technology.

Professor Sriram Subramanian, who leads the research team at the University of Sussex, says that technologies will inevitably need to engage other senses, such as touch, as we enter what designers are calling an ‘eye-free’ age of technology.

He says: “Wearables are already big business and will only get bigger. But as we wear technology more, it gets smaller and we look at it less, and therefore multisensory capabilities become much more important.

“If you imagine you are on your bike and want to change the volume control on your smartwatch, the interaction space on the watch is very small. So companies are looking at how to extend this space to the hand of the user.

“What we offer people is the ability to feel their actions when they are interacting with the hand.”

The findings were presented at the IEEE Haptics Symposium [April 8 – 11] 2016 in Philadelphia, USA, by the study’s co-author Dr Daniel Spelmezan, a research assistant in the Interact Lab.

There is a video of the work (I was not able to activate sound, if there is any accompanying this video),

The consequence of watching this silent video was that I found the whole thing somewhat mysterious.