Tag Archives: prostheses

A bioengineered robot hand with its own nervous system: machine/flesh and a job opening

A November 14, 2017 news item on phys.org announces a grant for a research project which will see engineered robot hands combined with regenerative medicine to imbue neuroprosthetic hands with the sense of touch,

The sense of touch is often taken for granted. For someone without a limb or hand, losing that sense of touch can be devastating. While highly sophisticated prostheses with complex moving fingers and joints are available to mimic almost every hand motion, they remain frustratingly difficult and unnatural for the user. This is largely because they lack the tactile experience that guides every movement. This void in sensation results in limited use or abandonment of these very expensive artificial devices. So why not make a prosthesis that can actually “feel” its environment?

That is exactly what an interdisciplinary team of scientists from Florida Atlantic University and the University of Utah School of Medicine aims to do. They are developing a first-of-its-kind bioengineered robotic hand that will grow and adapt to its environment. This “living” robot will have its own peripheral nervous system directly linking robotic sensors and actuators. FAU’s College of Engineering and Computer Science is leading the multidisciplinary team that has received a four-year, $1.3 million grant from the National Institute of Biomedical Imaging and Bioengineering of the [US] National Institutes of Health for a project titled “Virtual Neuroprosthesis: Restoring Autonomy to People Suffering from Neurotrauma.”

A November14, 2017 Florida Atlantic University (FAU) news release by Gisele Galoustian, which originated the news item, goes into more detail,

With expertise in robotics, bioengineering, behavioral science, nerve regeneration, electrophysiology, microfluidic devices, and orthopedic surgery, the research team is creating a living pathway from the robot’s touch sensation to the user’s brain to help amputees control the robotic hand. A neuroprosthesis platform will enable them to explore how neurons and behavior can work together to regenerate the sensation of touch in an artificial limb.

At the core of this project is a cutting-edge robotic hand and arm developed in the BioRobotics Laboratory in FAU’s College of Engineering and Computer Science. Just like human fingertips, the robotic hand is equipped with numerous sensory receptors that respond to changes in the environment. Controlled by a human, it can sense pressure changes, interpret the information it is receiving and interact with various objects. It adjusts its grip based on an object’s weight or fragility. But the real challenge is figuring out how to send that information back to the brain using living residual neural pathways to replace those that have been damaged or destroyed by trauma.

“When the peripheral nerve is cut or damaged, it uses the rich electrical activity that tactile receptors create to restore itself. We want to examine how the fingertip sensors can help damaged or severed nerves regenerate,” said Erik Engeberg, Ph.D., principal investigator, an associate professor in FAU’s Department of Ocean and Mechanical Engineering, and director of FAU’s BioRobotics Laboratory. “To accomplish this, we are going to directly connect these living nerves in vitro and then electrically stimulate them on a daily basis with sensors from the robotic hand to see how the nerves grow and regenerate while the hand is operated by limb-absent people.”

For the study, the neurons will not be kept in conventional petri dishes. Instead, they will be placed in  biocompatible microfluidic chambers that provide a nurturing environment mimicking the basic function of living cells. Sarah E. Du, Ph.D., co-principal investigator, an assistant professor in FAU’s Department of Ocean and Mechanical Engineering, and an expert in the emerging field of microfluidics, has developed these tiny customized artificial chambers with embedded micro-electrodes. The research team will be able to stimulate the neurons with electrical impulses from the robot’s hand to help regrowth after injury. They will morphologically and electrically measure in real-time how much neural tissue has been restored.

Jianning Wei, Ph.D., co-principal investigator, an associate professor of biomedical science in FAU’s Charles E. Schmidt College of Medicine, and an expert in neural damage and regeneration, will prepare the neurons in vitro, observe them grow and see how they fare and regenerate in the aftermath of injury. This “virtual” method will give the research team multiple opportunities to test and retest the nerves without any harm to subjects.

Using an electroencephalogram (EEG) to detect electrical activity in the brain, Emmanuelle Tognoli, Ph.D., co-principal investigator, associate research professor in FAU’s Center for Complex Systems and Brain Sciences in the Charles E. Schmidt College of Science, and an expert in electrophysiology and neural, behavioral, and cognitive sciences, will examine how the tactile information from the robotic sensors is passed onto the brain to distinguish scenarios with successful or unsuccessful functional restoration of the sense of touch. Her objective: to understand how behavior helps nerve regeneration and how this nerve regeneration helps the behavior.

Once the nerve impulses from the robot’s tactile sensors have gone through the microfluidic chamber, they are sent back to the human user manipulating the robotic hand. This is done with a special device that converts the signals coming from the microfluidic chambers into a controllable pressure at a cuff placed on the remaining portion of the amputated person’s arm. Users will know if they are squeezing the object too hard or if they are losing their grip.

Engeberg also is working with Douglas T. Hutchinson, M.D., co-principal investigator and a professor in the Department of Orthopedics at the University of Utah School of Medicine, who specializes in hand and orthopedic surgery. They are developing a set of tasks and behavioral neural indicators of performance that will ultimately reveal how to promote a healthy sensation of touch in amputees and limb-absent people using robotic devices. The research team also is seeking a post-doctoral researcher with multi-disciplinary experience to work on this breakthrough project.

Here’s more about the job opportunity from the FAU BioRobotics Laboratory job posting, (I checked on January 30, 2018 and it seems applications are still being accepted.)

Post-doctoral Opportunity

Dated Posted: Oct. 13, 2017

The BioRobotics Lab at Florida Atlantic University (FAU) invites applications for a NIH NIBIB-funded Postdoctoral position to develop a Virtual Neuroprosthesis aimed at providing a sense of touch in amputees and limb-absent people.

Candidates should have a Ph.D. in one of the following degrees: mechanical engineering, electrical engineering, biomedical engineering, bioengineering or related, with interest and/or experience in transdisciplinary work at the intersection of robotic hands, biology, and biomedical systems. Prior experience in the neural field will be considered an advantage, though not a necessity. Underrepresented minorities and women are warmly encouraged to apply.

The postdoctoral researcher will be co-advised across the department of Mechanical Engineering and the Center for Complex Systems & Brain Sciences through an interdisciplinary team whose expertise spans Robotics, Microfluidics, Behavioral and Clinical Neuroscience and Orthopedic Surgery.

The position will be for one year with a possibility of extension based on performance. Salary will be commensurate with experience and qualifications. Review of applications will begin immediately and continue until the position is filled.

The application should include:

  1. a cover letter with research interests and experiences,
  2. a CV, and
  3. names and contact information for three professional references.

Qualified candidates can contact Erik Engeberg, Ph.D., Associate Professor, in the FAU Department of Ocean and Mechanical Engineering at eengeberg@fau.edu. Please reference AcademicKeys.com in your cover letter when applying for or inquiring about this job announcement.

You can find the apply button on this page. Good luck!

Solar-powered graphene skin for more feeling in your prosthetics

A March 23, 2017 news item on Nanowerk highlights research that could put feeling into a prosthetic limb,

A new way of harnessing the sun’s rays to power ‘synthetic skin’ could help to create advanced prosthetic limbs capable of returning the sense of touch to amputees.

Engineers from the University of Glasgow, who have previously developed an ‘electronic skin’ covering for prosthetic hands made from graphene, have found a way to use some of graphene’s remarkable physical properties to use energy from the sun to power the skin.

Graphene is a highly flexible form of graphite which, despite being just a single atom thick, is stronger than steel, electrically conductive, and transparent. It is graphene’s optical transparency, which allows around 98% of the light which strikes its surface to pass directly through it, which makes it ideal for gathering energy from the sun to generate power.

A March 23, 2017 University of Glasgow press release, which originated the news item, details more about the research,

Ravinder Dahiya

Dr Ravinder Dahiya

A new research paper, published today in the journal Advanced Functional Materials, describes how Dr Dahiya and colleagues from his Bendable Electronics and Sensing Technologies (BEST) group have integrated power-generating photovoltaic cells into their electronic skin for the first time.

Dr Dahiya, from the University of Glasgow’s School of Engineering, said: “Human skin is an incredibly complex system capable of detecting pressure, temperature and texture through an array of neural sensors which carry signals from the skin to the brain.

“My colleagues and I have already made significant steps in creating prosthetic prototypes which integrate synthetic skin and are capable of making very sensitive pressure measurements. Those measurements mean the prosthetic hand is capable of performing challenging tasks like properly gripping soft materials, which other prosthetics can struggle with. We are also using innovative 3D printing strategies to build more affordable sensitive prosthetic limbs, including the formation of a very active student club called ‘Helping Hands’.

“Skin capable of touch sensitivity also opens the possibility of creating robots capable of making better decisions about human safety. A robot working on a construction line, for example, is much less likely to accidentally injure a human if it can feel that a person has unexpectedly entered their area of movement and stop before an injury can occur.”

The new skin requires just 20 nanowatts of power per square centimetre, which is easily met even by the poorest-quality photovoltaic cells currently available on the market. And although currently energy generated by the skin’s photovoltaic cells cannot be stored, the team are already looking into ways to divert unused energy into batteries, allowing the energy to be used as and when it is required.

Dr Dahiya added: “The other next step for us is to further develop the power-generation technology which underpins this research and use it to power the motors which drive the prosthetic hand itself. This could allow the creation of an entirely energy-autonomous prosthetic limb.

“We’ve already made some encouraging progress in this direction and we’re looking forward to presenting those results soon. We are also exploring the possibility of building on these exciting results to develop wearable systems for affordable healthcare. In this direction, recently we also got small funds from Scottish Funding Council.”

For more information about this advance and others in the field of prosthetics you may want to check out Megan Scudellari’s March 30, 2017 article for the IEEE’s (Institute of Electrical and Electronics Engineers) Spectrum (Note: Links have been removed),

Cochlear implants can restore hearing to individuals with some types of hearing loss. Retinal implants are now on the market to restore sight to the blind. But there are no commercially available prosthetics that restore a sense of touch to those who have lost a limb.

Several products are in development, including this haptic system at Case Western Reserve University, which would enable upper-limb prosthetic users to, say, pluck a grape off a stem or pull a potato chip out of a bag. It sounds simple, but such tasks are virtually impossible without a sense of touch and pressure.

Now, a team at the University of Glasgow that previously developed a flexible ‘electronic skin’ capable of making sensitive pressure measurements, has figured out how to power their skin with sunlight. …

Here’s a link to and a citation for the paper,

Energy-Autonomous, Flexible, and Transparent Tactile Skin by Carlos García Núñez, William Taube Navaraj, Emre O. Polat and Ravinder Dahiya. Advanced Functional Materials DOI: 10.1002/adfm.201606287 Version of Record online: 22 MAR 2017

© 2017 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim

This paper is behind a paywall.

Man with world’s first implanted bionic arm participates in first Cybathlon (olympics for cyborgs)

The world’s first Cybathlon is being held on Oct. 8, 2016 in Zurich, Switzerland. One of the participants is an individual who took part in some groundbreaking research into implants which was featured in my Oct. 10, 2014 posting. There’s more about the Cybathlon and the participant in an Oct. 4, 2016 news item on phys.org,

A few years ago, a patient was implanted with a bionic arm for the first time in the world using control technology developed at Chalmers University of Technology. He is now taking part in Cybathlon, a new international competition in which 74 participants with physical disabilities will compete against each other, using the latest robotic prostheses and other assistive technologies – a sort of ‘Cyborg Olympics’.

The Paralympics will now be followed by the Cybathlon, which takes place in Zürich on October 8th [2016]. This is the first major competition to show that the boundaries between human and machine are becoming more and more blurred. The participants will compete in six different disciplines using the machines they are connected to as well as possible.

Cybathlon is intended to drive forward the development of prostheses and other types of assistive aids. Today, such technologies are often highly advanced technically, but provide limited value in everyday life.

An Oct. 4, 2016 Chalmers University of Technology press release by Johanna Wilde, which originated the news item, provides details about the competitor, his prosthetic device, and more,

Magnus, one of the participants, has now had his biomechatronically integrated arm prosthesis for almost four years. He says that his life has totally changed since the implantation, which was performed by Dr Rickard Brånemark, associate professor at Sahlgrenska University Hospital.

“I don’t feel handicapped since I got this arm”, says Magnus. “I can now work full time and can perform all the tasks in both my job and my family life. The prosthesis doesn’t feel like a machine, but more like my own arm.”

Magnus lives in northern Sweden and works as a lorry driver. He regularly visits Gothenburg in southern Sweden and carries out tests with researcher Max Ortiz Catalan, assistant professor at Chalmers University of Technology, who has been in charge of developing the technology and leads the team competing in the Cybathlon.

“This is a completely new research field in which we have managed to directly connect the artificial limb to the skeleton, nerves and muscles,” says Dr Max Ortiz Catalan. “In addition, we are including direct neural sensory feedback in the prosthetic arm so the patient can intuitively feel with it.”

Today Magnus can feel varying levels of pressure in his artificial hand, something which is necessary to instinctively grip an object firmly enough. He is unique in the world in having a permanent sensory connection between the prosthesis and his nervous system, working outside laboratory conditions. Work is now under way to add more types of sensations.

At the Cybathlon he will be competing for the Swedish team, which is formed by Chalmers University of Technology, Sahlgrenska University Hospital and the company Integrum AB.

The competition has a separate discipline for arm prostheses. In this discipline Magnus has to complete a course made up of six different stations at which the prosthesis will be put to the test. For example, he has to open a can with a can opener, load a tray with crockery and open a door with the tray in his hand. The events at the Cybathlon are designed to be spectator-friendly while being based on various operations that the participants have to cope with in their daily lives.

“However, the competition will not really show the unique advantages of our technology, such as the sense of touch and the bone-anchored attachment which makes the prosthesis comfortable enough to wear all day,” says Max Ortiz Catalan.

Magnus is the only participant with an amputation above the elbow. This naturally makes the competition more difficult for him than for the others, who have a natural elbow joint.

“From a competitive perspective Cybathlon is far from ideal to demonstrate clinically viable technology,” says Max Ortiz Catalan. “But it is a major and important event in the human-machine interface field in which we would like to showcase our technology. Unlike several of the other participants, Magnus will compete in the event using the same technology he uses in his everyday life.”

Facts about Cybathlon
•    The very first Cybathlon is being organised by the Swiss university ETH Zürich.
•    The €5 million event will take place in Zürich´s 7600 spectator ice hockey stadium, Swiss Arena.
•    74 participants are competing for 59 different teams from 25 countries around the world. In total, the teams consist of about 300 scientists, engineers, support staff and competitors.
•    The teams range from small ad hoc teams to the world’s largest manufacturers of advanced prostheses.
•    The majority of the teams are groups from research labs and many of the prostheses have come straight out of the lab.
•    Unlike the Olympics and Paralympics, the Cybathlon participants are not athletes but ordinary people with various disabilities. The aims of the competition are to establish a dialogue between academia and industry, to facilitate discussion between technology developers and people with disabilities and to promote the use of robotic assistive aids to the general public.
•    Cybathlon will return in 2020, as a seven-day event in Tokyo, to coincide with the Olympics.

Facts about the Swedish team
The Opra Osseointegration team is a multidisciplinary team comprising technical and medical partners. The team is led by Dr Max Ortiz Catalan, assistant professor at Chalmers University of Technology, who has been in charge of developing the technology in close collaboration with Dr Rickard Brånemark, who is a surgeon at Sahlgrenska University Hospital and an associate professor at Gothenburg University. Dr Brånemark led the team performing the implantation of the device. Integrum AB, a Swedish company, complements the team as the pioneering provider of bone-anchored limb prostheses.

This video gives you an idea of what it’s in store on Oct. 8, 2016,

Prosthetics in North Carolina and in Vancouver, Canada

North Carolina

This is the first time I’ve seen any kind of hand prosthestic offering finger control. From a May 31, 2016 OrthoCarolina news release (received via email),

Two OrthoCarolina hand surgeons have successfully completed the first surgery to allow for a prosthetic hand with individual finger control on an amputee patient. Partnering with OrthoCarolina Research Institute (OCRI) in pursuit of medical breakthroughs through orthopedic research, Drs. Glenn Gaston and Bryan Loeffler conceptualized and performed the procedure involving transferring existing muscle from the fingers to the back of the hand and wrist without damaging the nerves and blood vessels to the muscles. The patient who underwent the test surgery is now able to control individual prosthetic fingers using the same muscles that controlled his fingers pre-amputation, making him the first person in the world to have individual digit control in a functioning myoelectric prosthesis.

“Patients who have sustained full or partial hand amputations obviously have significant morbidity and limited function, which is a challenge. Because of the limited number of muscles available after a hand amputation, prostheses have previously allowed only control of the thumb and fingers as a group and single finger control was never possible,” said Dr. Glenn Gaston.  “The severity of this patient’s injury was so great that replanting the lost fingers was not possible, so we collaborated on a new surgery that would allow him to have individual digital control.”

Hypothesizing that existing muscle in the back of human fingers could be transferred to the back of the hand and wrist without damaging the nerves and blood vessels to those muscles, Drs. Gaston and Loeffler first performed cadaveric testing to ensure feasibility. The goal of the initial project was for the small muscles that control individual fingers to regain control of prosthetic fingers by maintaining enough blood and nerve supply to allow the prosthetic limb to recognize individual digits.

With successful research completed, they collaborated with the Hanger Clinic to determine how much bone would be required to be removed from the hand, allowing the prosthetic componentry enough space to maintain a normal hand length.

The two surgeons jointly performed the surgery as a pilot case on a partial hand amputee, moving the muscles while still allowing the prosthesis to detect signals from the transferred muscles; a procedure never before reported in orthopedic literature.

“Imagine the limitations you would have if all of your fingers had to move as one unit, and then suddenly you were able to move individual fingers to perform specific actions,” said Dr. Bryan Loeffler. “This muscle transfer is a breakthrough that could impact how upper extremity amputees are managed and specific amputations are done in the future.”

Drs. Loeffler and Gaston have completed a cadaver model demonstrating the capability of the same type of surgery for a more proximal level total hand amputation. They presented their research at a podium presentation to the First International Symposium on Innovations in Amputation Surgery and Prosthetic Technologies (IASPT) May 12-13, 2016 in Chicago.

OrthoCarolina Research Institute is an independent non-profit committed to the advancement of orthopedic practice through clinical research. OCRI will continue to support this ground-breaking research and the manufacturing of this cutting edge prosthesis. “This is a tremendous example of the life-changing impact that orthopedic research plays in advancing patient outcomes,” said Christi Cadd, Executive Director of OCRI.

You can find out more about OrthoCarolina here.

Vancouver, Canada

While they celebrate exciting prosthetic news in North Carolina, those of us in Vancouver have been given the opportunity to view an unusual display of vintage artificial limbs (prosthetics) in an exhibition, All Together Now, featuring a number of rarely seen private collections including corsets, Chinese restaurant menus, and pinball machines. From a June 22, 2016 article by Janet Smith for the Georgia Straight, here’s more about the prosthetic collection,

For those unfamiliar, the lifelike artificial legs and arms that hang on the Museum of Vancouver’s wall might seem like medical oddities from a less advanced era.

But for collector David Moe, a certified prosthetist, they are integral, inspiring pieces for his career, his teaching, and his workspace.

“I love them all,” he says with enthusiasm, standing in the museum’s giant new exhibit All Together Now: Vancouver Collectors and Their World, in a corner of an expansive, cabinet-of-curiosities-styled room that houses everything from scores of local Chinese-restaurant menus to rows of 19th-century corsets and a glass case full of hundreds of action figures. “It’s very strange because they have been all around me for so long and they have sat in predominant spaces at work—they sit on the top of a shelf. So when I walk back in there right now there are these kinds of empty holes.

“But I’m happy to have them on display and to let people think about what they see and have the opportunity to have them think about prosthetics. Because nobody ever thinks about them until they need one.”

Moe began collecting almost from his start, at the age of 14, when he worked sweeping floors and pouring plaster at Northern Alberta Prosthetic & Orthotic Services, his family’s business in Edmonton. One of his first big finds was a leg that sits in the exhibit today—a meticulously carved wooden limb covered in smooth skin-tone leather, dating back to the 1930s. At the time, he recognized the craftsmanship and tucked it away where it wouldn’t disappear; today he still marvels at the anatomical design, with a hinged knee that bends with the use of straps.

“… . The math is the math. But we’ve moved so far. I really love where we’ve come from,” says Moe, gesturing to the vintage pieces he uses regularly to teach students at BCIT [British Columbia Institute of Technology]. He says he can appreciate the human touch and deep care that went into each one, then adds: “All of these were used by people, so the energy of these people is in these. I feel that responsibility of these people in here.”

To show how far his specialty has come, though, Moe has juxtaposed the historic limbs with modern-day advances—decorative limb coverings with fashionable latticework, or a kids’ shin piece that’s been emblazoned with a comic-book image of Superman. Now, instead of trying to just mimic natural limbs, some people are opting for statement pieces that actually draw attention to their prosthetic. “This empowers them in this powerless situation where someone has amputated your leg,” he notes.

As with other exhibits in All Together Now, there are audiovisuals that accompany his collection—in this case showing people using the advanced limbs of today, from a female triathlete carrying her baby to another client playing competitive volleyball.

“When someone does the Grouse Grind or, hell, just walks their child down the street, that’s when they come alive. We’re rebuilding lives, not pieces,” Moe says.

You can find out more about All Together Now here,

All Together Now: Vancouver Collectors and Their Worlds features 20 beautiful, rare, and unconventional collections, with something for everyone including corsets, prosthetics, pinball machines, taxidermy, toys, and much more. In this exhibition both collector and collected are objects of study, interaction, and delight.

The exhibition runs until January 8, 2017. The last Thursday of the month is by donation from 5 pm to 8 pm. More information about admission can be found here and you might also want to check out the exhibition’s Events page.

Cyborgian dance at McGill University (Canada)

As noted in the Canadian Council of Academies report ((State of Science and Technology in Canada, 2012), which was mentioned in my Dec. 28, 2012 posting, the field of visual and performing arts is an area of strength and that is due to one province, Québec. Mark Wilson’s Aug. 13, 2013 article for Fast Company and Paul Ridden’s Aug. 7, 2013 article for gizmag.com about McGill University’s Instrumented Bodies: Digital Prostheses for Music and Dance Performance seem to confirm Québec’s leadership.

From Wilson’s Aug. 13, 2013 article (Note: A link has been removed),

One is a glowing exoskeleton spine, while another looks like a pair of cyborg butterfly wings. But these aren’t just costumes; they’re wearable, functional art.

In fact, the team of researchers from the IDML (Input Devices and Music Interaction Laboratory [at McGill University]) who are responsible for the designs go so far as to call their creations “prosthetic instruments.”

Ridden’s Aug. 7, 2013 article offers more about the project’s history and technology,

For the last three years, a small research team at McGill University has been working with a choreographer, a composer, dancers and musicians on a project named Instrumented Bodies. Three groups of sensor-packed, internally-lit digital music controllers that attach to a dancer’s costume have been developed, each capable of wirelessly triggering synthesized music as the performer moves around the stage. Sounds are produced by tapping or stroking transparent Ribs or Visors, or by twisting, turning or moving Spines. Though work on the project continues, the instruments have already been used in a performance piece called Les Gestes which toured Canada and Europe during March and April.

Both articles are interesting but Wilson’s is the fast read and Ridden’s gives you information you can’t find by looking up the Instrumented Bodies: Digital Prostheses for Music and Dance Performance project webpage,

These instruments are the culmination of a three-year long project in which the designers worked closely with dancers, musicians, composers and a choreographer. The goal of the project was to develop instruments that are visually striking, utilize advanced sensing technologies, and are rugged enough for extensive use in performance.

The complex, transparent shapes are lit from within, and include articulated spines, curved visors and ribcages. Unlike most computer music control interfaces, they function both as hand-held, manipulable controllers and as wearable, movement-tracking extensions to the body. Further, since the performers can smoothly attach and detach the objects, these new instruments deliberately blur the line between the performers’ bodies and the instrument being played.

The prosthetic instruments were designed and developed by Ph.D. researchers Joseph Malloch and Ian Hattwick [and Marlon Schumacher] under the supervision of IDMIL director Marcelo Wanderley. Starting with sketches and rough foam prototypes for exploring shape and movement, they progressed through many iterations of the design before arriving at the current versions. The researchers made heavy use of digital fabrication technologies such as laser-cutters and 3D printers, which they accessed through the McGill University School of Architecture and the Centre for Interdisciplinary Research in Music Media and Technology, also hosted by McGill.

Each of the nearly thirty working instruments produced for the project has embedded sensors, power supplies and wireless data transceivers, allowing a performer to control the parameters of music synthesis and processing in real time through touch, movement, and orientation. The signals produced by the instruments are routed through an open-source peer-to-peer software system the IDMIL team has developed for designing the connections between sensor signals and sound synthesis parameters.

For those who prefer to listen and watch, the researchers have created a video documentary,

I usually don’t include videos that run past 5 mins. but I’ve made an exception for this almost 15 mins. documentary.

I was trying to find mention of a dancer and/or choreographer associated with this project and found a name along with another early stage participant, choreographer, Isabelle Van Grimde, and composer, Sean Ferguson, in Ridden’s article.

Prosthetics and the human brain

On the heels of research which suggests that humans tend to view their prostheses, including wheel chairs, as part of their bodies, researchers in Europe  have announced the development of a working exoskeleton powered by the wearer’s thoughts.

First, there’s the ‘wheelchair’ research, from the Mar. 6, 2013 news item on ScienceDaily,

People with spinal cord injuries show strong association of wheelchairs as part of their body, not extension of immobile limbs.

The human brain can learn to treat relevant prosthetics as a substitute for a non-working body part, according to research published March 6 in the open access journal PLOS ONE by Mariella Pazzaglia and colleagues from Sapienza University and IRCCS Fondazione Santa Lucia of Rome in Italy, supported by the International Foundation for Research in Paraplegie.

The researchers found that wheelchair-bound study participants with spinal cord injuries perceived their body’s edges as being plastic and flexible to include the wheelchair, independent of time since their injury or experience with using a wheelchair. Patients with lower spinal cord injuries who retained upper body movement showed a stronger association of the wheelchair with their body than those who had spinal cord impairments in the entire body.

According to the authors, this suggests that rather than being thought of only as an extension of the immobile limbs, the wheelchairs had become tangible, functional substitutes for the affected body part. …

As I mentioned in a Jan. 30, 2013 posting,

There have been some recent legal challenges as to what constitutes one’s body (from The Economist article, You, robot? [you can find the article here: http://www.economist.com/node/21560986]),

If you are dependent on a robotic wheelchair for mobility, for example, does the wheelchair count as part of your body? Linda MacDonald Glenn, an American lawyer and bioethicist, thinks it does. Ms Glenn (who is not involved in the RoboLaw project) persuaded an initially sceptical insurance firm that a “mobility assistance device” damaged by airline staff was more than her client’s personal property, it was an extension of his physical body. The airline settled out of court.

According to the Mar. 6, 2013 news release on EurekAlert from the Public Library of Science (PLoS), the open access article by Pazzaglia and her colleagues can be found here (Note: I have added a link),

Pazzaglia M, Galli G, Scivoletto G, Molinari M (2013) A Functionally Relevant Tool for the Body following Spinal Cord Injury. PLOS ONE 8(3): e58312.doi:10.1371/journal.pone.0058312

At almost the same time as Pazzaglia’s work,  a “Mind-controlled Exoskeleton” is announced in a Mar. 7, 2013 news item on ScienceDaily,

Every year thousands of people in Europe are paralysed by a spinal cord injury. Many are young adults, facing the rest of their lives confined to a wheelchair. Although no medical cure currently exists, in the future they could be able to walk again thanks to a mind-controlled robotic exoskeleton being developed by EU-funded researchers.

The system, based on innovative ‘Brain-neural-computer interface’ (BNCI) technology — combined with a light-weight exoskeleton attached to users’ legs and a virtual reality environment for training — could also find applications in there habilitation of stroke victims and in assisting astronauts rebuild muscle mass after prolonged periods in space.

The Mar. 7, 2013 news release on CORDIS, which originated the news item, offers a description of the “Mindwalker” project,

‘Mindwalker was proposed as a very ambitious project intended to investigate promising approaches to exploit brain signals for the purpose of controlling advanced orthosis, and to design and implement a prototype system demonstrating the potential of related technologies,’ explains Michel Ilzkovitz, the project coordinator at Space Applications Services in Belgium.

The team’s approach relies on an advanced BNCI system that converts electroencephalography (EEG) signals from the brain, or electromyography (EMG) signals from shoulder muscles, into electronic commands to control the exoskeleton.

The Laboratory of Neurophysiology and Movement Biomechanics at the Université Libre de Bruxelles (ULB) focused on the exploitation of EEG and EMG signals treated by an artificial neural network, while the Foundation Santa Lucia in Italy developed techniques based on EMG signals modelled by the coupling of neural and biomechanical oscillators.

One approach for controlling the exoskeleton uses so-called ‘steady-state visually evoked potential’, a method that reads flickering visual stimuli produced at different frequencies to induce correlated EEG signals. Detection of these EEG signals is used to trigger commands such as ‘stand’, ‘walk’, ‘faster’ or ‘slower’.

A second approach is based on processing EMG signals generated by the user’s shoulders and exploits the natural arm-leg coordination in human walking: arm-swing patterns can be perceived in this way and converted into control signals commanding the exoskeleton’s legs.

A third approach, ‘ideation’, is also based on EEG-signal processing. It uses the identification and exploitation of EEG Theta cortical signals produced by the natural mental process associated with walking. The approach was investigated by the Mindwalker team but had to be dropped due to the difficulty, and time needed, in turning the results of early experiments into a fully exploitable system.

Regardless of which method is used, the BNCI signals have to be filtered and processed before they can be used to control the exoskeleton. To achieve this, the Mindwalker researchers fed the signals into a ‘Dynamic recurrent neural network'(DRNN), a processing technique capable of learning and exploiting the dynamic character of the BNCI signals.

‘This is appealing for kinematic control and allows a much more natural and fluid way of controlling an exoskeleton,’ Mr Ilzkovitz says.

The team adopted a similarly practical approach for collecting EEG signals from the user’s scalp. Most BNCI systems are either invasive, requiring electrodes to be placed directly into brain tissue, or require users to wear a ‘wet’ capon their head, necessitating lengthy fitting procedures and the use of special gels to reduce the electrical resistance at the interface between the skin and the electrodes. While such systems deliver signals of very good quality and signal-to-noise ratio, they are impractical for everyday use.

The Mindwalker team therefore turned to a ‘dry’ technology developed by Berlin-based eemagine Medical Imaging Solutions: a cap covered in electrodes that the user can fit themselves, and which uses innovative electronic components to amplify and optimise signals before sending them to the neural network.

‘The dry EEG cap can be placed by the subject on their head by themselves in less than a minute, just like a swimming cap,’ Mr Ilzkovitz says.

Before proceeding any further with details, here’s what the Mindwalker looks like,

© MINDWALKER (downladed from http://cordis.europa.eu/fetch?CALLER=OFFR_TM_EN&ACTION=D&RCN=10601)

© MINDWALKER (downloaded from http://cordis.europa.eu/fetch?CALLER=OFFR_TM_EN&ACTION=D&RCN=10601)

After finding a way to collect the EEG/EMG signals and interpret them, the researchers needed to create the exoskeleton (from the CORDIS news release),

The universities of Delft and Twente in the Netherlands proposed an innovative approach for the design of the exoskeleton and its control. The exoskeletonis designed to be sufficiently robust to bear the weight of a 100 kg adult and powerful enough to recover balance from external causes of instability such as the user’s own torso movements during walking or a gentle push from the back or side. Compared to other exoskeletons developed to date it is relatively light, weighing less than 30 kg without batteries, and, because a final version of the system should be self-powered, it is designed to minimise energy consumption.

The Mindwalker researchers achieved energy efficiency through the use of springs fitted inside the joints that are capable of absorbing and recovering some of the energy otherwise dissipated during walking, and through the development of an efficient strategy for controlling the exoskeleton.

Most exoskeletons are designed to be balanced when stationary or quasi-static and to move by little steps inside their ground stability perimeter, an approach known as ‘Zero moment point’, or ZMP. Although this approach is commonly used for controlling humanoid robots, when applied to exoskeletons, it makes them heavy and slow – and usually requires users to be assisted by a walking frame, sticks or some other support device when they move.

Alternatively, a more advanced and more natural control strategy can replicate the way humans actually walk, with a controlled loss of balance in the walking direction.

‘This approach is called “Limit-cycle walking” and has been implemented using model predictive control to predict the behaviour of the user and exoskeleton and for controlling the exoskeleton during the walk. This was the approach investigated in Mindwalker,’ Mr Ilzkovitz says.

To train users to control the exoskeleton, researchers from Space Applications Services developed a virtual-reality training platform, providing an immersive environment in which new users can safely become accustomed to using the system before testing it out in a clinical setting, and, the team hope, eventually using it in everyday life.

By the end of this year, tests with able-bodied trial users will be completed. The system will then be transferred to the Foundation Santa Lucia for conducting a clinical evaluation until May 2013 with five to 10volunteers suffering from spinal cord injuries. These trials will help identify shortcomings and any areas of performance improvement, the project coordinator says.

In the meantime, the project partners are continuing research on different components for a variety of potential applications. The project coordinator notes, for example, that elements of the system could be adapted for the rehabilitation of stroke victims or to develop easy-to-use exoskeletons for elderly people for mobility support.

Space Applications Services, meanwhile, is also exploring applications of the Mindwalker technology to train astronauts and help them rebuild muscle mass after spending long periods of time in zero-gravity environments.

There’s more about the European Commission’s Seventh Programme-funded Mindwalker project here.

Parallel with these developments in Europe, Miguel Nicolelis of Duke University has stated that he will have a working exoskeleton (Walk Again Project)  for the kickoff by a paraplegic individual for the opening of the World Cup (soccer/football) in Brazil in 2014. I mentioned Nicolelis and his work most recently in a Mar. 4, 2013 posting.

Taken together, this research which strongly suggests that people can perceive prostheses as being part of their bodies and exoskeletons that are powered by the wearer’s thoughts, we seem to be edging closer to a world where machines and humans become one.

Monkeys, mind control, robots, prosthetics, and the 2014 World Cup (soccer/football)

The idea that a monkey in the US could control a robot’s movements in Japan is stunning. Even more stunning is the fact that the research is four years old. It was discussed publicly in a Jan. 15, 2008 article by Sharon Gaudin for Computer World,

Scientists in the U.S. and Japan have successfully used a monkey’s brain activity to control a humanoid robot — over the Internet.

This research may only be a few years away from helping paralyzed people walk again by enabling them to use their thoughts to control exoskeletons attached to their bodies, according to Miguel Nicolelis, a professor of neurobiology at Duke University and lead researcher on the project.

“This is an attempt to restore mobility to people,” said Nicolelis. “We had the animal trained to walk on a treadmill. As it walked, we recorded its brain activity that generated its locomotion pattern. As the animal was walking and slowing down and changing his pattern, his brain activity was driving a robot in Japan in real time.”

This video clip features an animated monkey simulating control of  a real robot in Japan (the Computational Brain Project of the Japan Science and Technology Agency (JST) in Kyoto partnered with Duke University for this project),

I wonder if the Duke researchers or communications staff thought that the sight of real rhesus monkeys on treadmills might be too disturbing. While we’re on the topic of simulation, I wonder where the robot in the clip actually resides. Quibbles about the video clip aside, I have no doubt that the research took place.

There’s a more recent (Oct. 5, 2011) article, about the work being done in Nicolelis’ laboratory at Duke University, by Ed Yong for Discover Magazine (mentioned previously described in my Oct. 6, 2011 posting),

This is where we are now: at Duke University, a monkey controls a virtual arm using only its thoughts. Miguel Nicolelis had fitted the animal with a headset of electrodes that translates its brain activity into movements. It can grab virtual objects without using its arms. It can also feel the objects without its hands, because the headset stimulates its brain to create the sense of different textures. Monkey think, monkey do, monkey feel – all without moving a muscle.
And this is where  Nicolelis wants to be in three years: a young quadriplegic Brazilian man strolls confidently into a massive stadium. He controls his four prosthetic limbs with his thoughts, and they in turn send tactile information straight to his brain. The technology melds so fluidly with his mind that he confidently runs up and delivers the opening kick of the 2014 World Cup.

This sounds like a far-fetched dream, but Nicolelis – a big soccer fan – is talking to the Brazilian government to make it a reality.

According to Yong, Nicolelis has created an international consortium to support the Walk Again Project. From the project home page,

The Walk Again Project, an international consortium of leading research centers around the world represents a new paradigm for scientific collaboration among the world’s academic institutions, bringing together a global network of scientific and technological experts, distributed among all the continents, to achieve a key humanitarian goal.

The project’s central goal is to develop and implement the first BMI [brain-machine interface] capable of restoring full mobility to patients suffering from a severe degree of paralysis. This lofty goal will be achieved by building a neuroprosthetic device that uses a BMI as its core, allowing the patients to capture and use their own voluntary brain activity to control the movements of a full-body prosthetic device. This “wearable robot,” also known as an “exoskeleton,” will be designed to sustain and carry the patient’s body according to his or her mental will.

In addition to proposing to develop new technologies that aim at improving the quality of life of millions of people worldwide, the Walk Again Project also innovates by creating a complete new paradigm for global scientific collaboration among leading academic institutions worldwide. According to this model, a worldwide network of leading scientific and technological experts, distributed among all the continents, come together to participate in a major, non-profit effort to make a fellow human being walk again, based on their collective expertise. These world renowned scholars will contribute key intellectual assets as well as provide a base for continued fundraising capitalization of the project, setting clear goals to establish fundamental advances toward restoring full mobility for patients in need.

It’s the exoskeleton described on the Walk Again Project home page that Nicolelis is hoping will enable a young Brazilian quadriplegic to deliver the opening kick for the 2014 World Cup (soccer/football) in Brazil.