Tag Archives: bionic eye

Metallic nanoflowers produce neuron-like fractals

I was a bit surprised to find that this University of Oregon story was about a patent. Here’s more from a July 28, 2015 news item on Azonano,

Richard Taylor’s vision of using artificial fractal-based implants to restore sight to the blind — part of a far-reaching concept that won an innovation award this year from the White House — is now covered under a broad U.S. patent.

The patent goes far beyond efforts to use the emerging technology to restore eyesight. It covers all fractal-designed electronic implants that link signaling activity with nerves for any purpose in animal and human biology.

Fractals are objects with irregular curves or shapes. “They are a trademark building block of nature,” said Taylor, a professor of physics and director of the Materials Science Institute at the University of Oregon [UO]. “In math, that property is self-similarity. Trees, clouds, rivers, galaxies, lungs and neurons are fractals. What we hope to do is adapt the technology to nature’s geometry.”

Named in U.S. patent 9079017 are Taylor, the UO, Taylor’s research collaborator Simon Brown, and Brown’s home institution, the University of Canterbury in New Zealand.

A July 28, 2015 University of Oregon news release (also on EurekAlert) by Jim Barlow, which originated the news item, continues the patent celebration,

“We’re very delighted,” Taylor said. “The U.S. Patent and Trademark Office has recognized the novelty and utility of our general concept, but there is a lot to do. We want to get all of the fundamental science sorted out. We’re looking at least another couple of years of basic science before moving forward.”

The patent solidifies the relationship between the two universities, said Charles Williams, associate vice president for innovation at the UO. “This is still in the very early days. This project has attracted national attention, awards and grants.

“We hope to engage the right set of partners to develop the technology over time as the concept moves into potentially vast forms of medical applications,” Williams added. “Dr. Taylor’s interdisciplinary science is a hallmark of the creativity at the University of Oregon and a great example of the international research collaborations that our faculty engage in every day.”

Here’s an image illustrating the ‘fractal neurons’,

FractalImplant

Caption: Retinal neurons, outlined in yellow, attach to and follows branches of a fractal interconnect. Such connections, says University of Oregon physicist Richard Taylor, could some day help to treat eye diseases such as macular degeneration. Credit: Courtesy of Richard Taylor

The news release goes on to describe the ‘fractal approach’ to eye implants which is markedly different from the implants entering the marketplace,

Taylor raised the idea of a fractal-based approach to treat eye diseases in a 2011 article in Physics World, writing that it could overcome problems associated with efforts to insert photodiodes behind the eyes. Current chip technology doesn’t allow sufficient connections with neurons.

“The wiring — the neurons — in the retina is fractal, but the chips are not fractal,” Taylor said. His vision, based on research with Brown, is to grow nanoflowers seeded from nanoparticles of metals that self assemble in a natural process, producing fractals that mimic and communicate with neurons.

It is conceivable, Taylor said, that fractal interconnects — as the implants are called in the patent — could be shaped so they network with like-shaped neurons to address narrow needs, such as a feedback loop for the sensation of touch from a prosthetic arm or leg to the brain.

Such implants would overcome the biological rejection of implants with smooth surfaces or those randomly patterned that have been developed in a trial-and-error approach to link to neurons.

Once perfected, he said, the implants would generate an electrical field that would fool a sea of glial cells that insulate and protect neurons from foreign invaders. Fractal interconnects would allow electrical signals to operate in “a safety zone biologically” that avoids toxicity issues.

“The patent covers any generic interface for connecting any electronics to any nerve,” Taylor said, adding that fractal interconnects are not electrodes. “Our interface is multifunctional. The primary thing is to get the electrical field into the system so that reaches the neurons and induces the signal.”

Taylor’s proposal for using fractal-based technology earned the top prize in a contest held by the innovation company InnoCentive. Taylor was honored in April [2015] at a meeting of the White House Office of Science and Technology Policy.

The competition was sponsored by a collaboration of science philanthropies including the Research Corporation for Science Advancement, the Gordon and Betty Moore Foundation, the W.M. Keck Foundation, the Kavli Foundation, the Templeton Foundation and the Burroughs Wellcome Fund.

You can find out more about InnoCentive here. As for other types of artificial eye implants, the latest here is a June 30, 2015 post titled, Clinical trial for bionic eye (artificial retinal implant) shows encouraging results (safety and efficacy).

Clinical trial for bionic eye (artificial retinal implant) shows encouraging results (safety and efficacy)

The Argus II artificial retina was first mentioned here in a Feb. 15, 2013 posting (scroll down about 50% of the way) when it received US Food and Drug Administration (FDA) commercial approval. In retrospect that seems puzzling since the results of a three-year clinical trial have just been reported in a June 23, 2015 news item on ScienceDaily (Note: There was one piece of information about the approval which didn’t make its way into the information disseminated in 2013),

The three-year clinical trial results of the retinal implant popularly known as the “bionic eye,” have proven the long-term efficacy, safety and reliability of the device that restores vision in those blinded by a rare, degenerative eye disease. The findings show that the Argus II significantly improves visual function and quality of life for people blinded by retinitis pigmentosa. They are being published online in Ophthalmology, the journal of the American Academy of Ophthalmology.

A June 23, 2015 American Academy of Ophthalmology news release (also on EurekAlert), which originated the news item, describes the condition the Argus II is designed for and that crucial bit of FDA information,

Retinitis pigmentosa is an incurable disease that affects about 1 in 4,000 Americans and causes slow vision loss that eventually leads to blindness.[1] The Argus II system was designed to help provide patients who have lost their sight due to the disease with some useful vision. Through the device, patients with retinitis pigmentosa are able to see patterns of light that the brain learns to interpret as an image. The system uses a miniature video camera stored in the patient’s glasses to send visual information to a small computerized video processing unit which can be stored in a pocket. This computer turns the image to electronic signals that are sent wirelessly to an electronic device implanted on the retina, the layer of light-sensing cells lining the back of the eye.

The Argus II received Food and Drug Administration (FDA) approval as a Humanitarian Use Device (HUD) in 2013, which is an approval specifically for devices intended to benefit small populations and/or rare conditions. [emphasis mine]

I don’t recall seeing “Humanitarian Use Device (HUD)” in the 2013 materials which focused on the FDA’s commercial use approval. I gather from this experience that commercial use doesn’t necessarily mean they’ve finished with clinical trials and are ready to start selling the product. In any event, I will try to take a closer look at the actual approvals the next time, assuming I can make sense of the language.

After all the talk about it, here’s what the device looks like,

 Caption: Figure A, The implanted portions of the Argus II System. Figure B, The external components of the Argus II System. Images in real time are captured by camera mounted on the glasses. The video processing unit down-samples and processes the image, converting it to stimulation patterns. Data and power are sent via radiofrequency link form the transmitter antenna on the glasses to the receiver antenna around the eye. A removable, rechargeable battery powers the system. Credit: Photo courtesy of Second Sight Medical Products, Inc.


Caption: Figure A, The implanted portions of the Argus II System. Figure B, The external components of the Argus II System. Images in real time are captured by camera mounted on the glasses. The video processing unit down-samples and processes the image, converting it to stimulation patterns. Data and power are sent via radiofrequency link form the transmitter antenna on the glasses to the receiver antenna around the eye. A removable, rechargeable battery powers the system.
Credit: Photo courtesy of Second Sight Medical Products, Inc.

The news release offers more details about the recently completed clinical trial,

To further evaluate the safety, reliability and benefit of the device, a clinical trial of 30 people, aged 28 to 77, was conducted in the United States and Europe. All of the study participants had little or no light perception in both eyes. The researchers conducted visual function tests using both a computer screen and real-world conditions, including finding and touching a door and identifying and following a line on the ground. A Functional Low-vision Observer Rated Assessment (FLORA) was also performed by independent visual rehabilitation experts at the request of the FDA to assess the impact of the Argus II system on the subjects’ everyday lives, including extensive interviews and tasks performed around the home.

The visual function results indicated that up to 89 percent of the subjects performed significantly better with the device. The FLORA found that among the subjects, 80 percent received benefit from the system when considering both functional vision and patient-reported quality of life, and no subjects were affected negatively.

After one year, two-thirds of the subjects had not experienced device- or surgery-related serious adverse events. After three years, there were no device failures. Throughout the three years, 11 subjects experienced serious adverse events, most of which occurred soon after implantation and were successfully treated. One of these treatments, however, was to remove the device due to recurring erosion after the suture tab on the device became damaged.

“This study shows that the Argus II system is a viable treatment option for people profoundly blind due to retinitis pigmentosa – one that can make a meaningful difference in their lives and provides a benefit that can last over time,” said Allen C. Ho, M.D., lead author of the study and director of the clinical retina research unit at Wills Eye Hospital. “I look forward to future studies with this technology which may make possible expansion of the intended use of the device, including treatment for other diseases and eye injuries.”

Here’s a link to a PDF of and a citation for the paper,

Long-Term Results from an Epiretinal Prosthesis to Restore Sight to the Blind by Allen C. Ho,Mark S. Humayun, Jessy D. Dorn, Lyndon da Cruz, Gislin Dagnelie,James Handa, Pierre-Olivier Barale, José-Alain Sahel, Paulo E. Stanga, Farhad Hafezi, Avinoam B. Safran, Joel Salzmann, Arturo Santos, David Birch, Rand Spencer, Artur V. Cideciyan, Eugene de Juan, Jacque L. Duncan, Dean Eliott, Amani Fawzi, Lisa C. Olmos de Koo, Gary C. Brown, Julia A. Haller, Carl D. Regillo, Lucian V. Del Priore, Aries Arditi, Duane R. Geruschat, Robert J. Greenberg. Opthamology, June 2015 http://dx.doi.org/10.1016/j.ophtha.2015.04.032

This paper is open access.

‘Touching’ infrared light, if you’re a rat followed by announcement of US FDA approval of first commercial artificial retina (bionic eye)

Researcher Miguel Nicolelis and his colleagues at Duke University have implanted a neuroprosthetic device in the portion of a rat’s brain related to touch that allows the rats to see infrared light. From the Feb. 12, 2013 news release on EurekAlert,

Researchers have given rats the ability to “touch” infrared light, normally invisible to them, by fitting them with an infrared detector wired to microscopic electrodes implanted in the part of the mammalian brain that processes tactile information. The achievement represents the first time a brain-machine interface has augmented a sense in adult animals, said Duke University neurobiologist Miguel Nicolelis, who led the research team.

The experiment also demonstrated for the first time that a novel sensory input could be processed by a cortical region specialized in another sense without “hijacking” the function of this brain area said Nicolelis. This discovery suggests, for example, that a person whose visual cortex was damaged could regain sight through a neuroprosthesis implanted in another cortical region, he said.

Although the initial experiments tested only whether rats could detect infrared light, there seems no reason that these animals in the future could not be given full-fledged infrared vision, said Nicolelis. For that matter, cortical neuroprostheses could be developed to give animals or humans the ability to see in any region of the electromagnetic spectrum, or even magnetic fields. “We could create devices sensitive to any physical energy,” he said. “It could be magnetic fields, radio waves, or ultrasound. We chose infrared initially because it didn’t interfere with our electrophysiological recordings.”

Interestingly, the research was supported by the US National Institute of Mental Health (as per the news release).

The researchers have more to say about what they’re doing,

“The philosophy of the field of brain-machine interfaces has until now been to attempt to restore a motor function lost to lesion or damage of the central nervous system,” said Thomson, [Eric Thomson] first author of the study. “This is the first paper in which a neuroprosthetic device was used to augment function—literally enabling a normal animal to acquire a sixth sense.”

Here’s how they conducted the research,

The mammalian retina is blind to infrared light, and mammals cannot detect any heat generated by the weak infrared light used in the studies. In their experiments, the researchers used a test chamber that contained three light sources that could be switched on randomly. Using visible LED lights, they first taught each rat to choose the active light source by poking its nose into an attached port to receive a reward of a sip of water.

After training the rats, the researchers implanted in their brains an array of stimulating microelectrodes, each roughly a tenth the diameter of a human hair. The microelectrodes were implanted in the cortical region that processes touch information from the animals’ facial whiskers.

Attached to the microelectrodes was an infrared detector affixed to the animals’ foreheads. The system was programmed so that orientation toward an infrared light would trigger an electrical signal to the brain. The signal pulses increased in frequency with the intensity and proximity of the light.

The researchers returned the animals to the test chamber, gradually replacing the visible lights with infrared lights. At first in infrared trials, when a light was switched on the animals would tend to poke randomly at the reward ports and scratch at their faces, said Nicolelis. This indicated that they were initially interpreting the brain signals as touch. However, over about a month, the animals learned to associate the brain signal with the infrared source. They began to actively “forage” for the signal, sweeping their heads back and forth to guide themselves to the active light source. Ultimately, they achieved a near-perfect score in tracking and identifying the correct location of the infrared light source.

To ensure that the animals were really using the infrared detector and not their eyes to sense the infrared light, the researchers conducted trials in which the light switched on, but the detector sent no signal to the brain. In these trials, the rats did not react to the infrared light.

Their finding could have an impact on notions of mammalian brain plasticity,

A key finding, said Nicolelis, was that enlisting the touch cortex for light detection did not reduce its ability to process touch signals. “When we recorded signals from the touch cortex of these animals, we found that although the cells had begun responding to infrared light, they continued to respond to whisker touch. It was almost like the cortex was dividing itself evenly so that the neurons could process both types of information.

This finding of brain plasticity is in contrast with the “optogenetic” approach to brain stimulation, which holds that a particular neuronal cell type should be stimulated to generate a desired neurological function. Rather, said Nicolelis, the experiments demonstrate that a broad electrical stimulation, which recruits many distinct cell types, can drive a cortical region to adapt to a new source of sensory input.

All of this work is part of Nicolelis’ larger project ‘Walk Again’ which is mentioned in my March 16, 2012 posting and includes a reference to some ethical issues raised by the work. Briefly, Nicolelis and an international team of collaborators are developing a brain-machine interface that will enable full mobility for people who are severely paralyzed. From the news release,

The Walk Again Project has recently received a $20 million grant from FINEP, a Brazilian research funding agency to allow the development of the first brain-controlled whole body exoskeleton aimed at restoring mobility in severely paralyzed patients. A first demonstration of this technology is expected to happen in the opening game of the 2014 Soccer World Cup in Brazil.

Expanding sensory abilities could also enable a new type of feedback loop to improve the speed and accuracy of such exoskeletons, said Nicolelis. For example, while researchers are now seeking to use tactile feedback to allow patients to feel the movements produced by such “robotic vests,” the feedback could also be in the form of a radio signal or infrared light that would give the person information on the exoskeleton limb’s position and encounter with objects.

There’s more information including videos about the work with infrared light and rats at the Nicolelis Lab website.  Here’s a citation for and link to the team’s research paper,

Perceiving invisible light through a somatosensory cortical prosthesis by Eric E. Thomson, Rafael Carra, & Miguel A.L. Nicolelis. Nature Communications Published 12 Feb 2013 DOI: 10.1038/ncomms2497

Meanwhile, the US Food and Drug Administraton (FDA) has approved the first commercial artificial retina, from the Feb. 14, 2013 news release,

The U.S. Food and Drug Administration (FDA) granted market approval to an artificial retina technology today, the first bionic eye to be approved for patients in the United States. The prosthetic technology was developed in part with support from the National Science Foundation (NSF).

The device, called the Argus® II Retinal Prosthesis System, transmits images from a small, eye-glass-mounted camera wirelessly to a microelectrode array implanted on a patient’s damaged retina. The array sends electrical signals via the optic nerve, and the brain interprets a visual image.

The FDA approval currently applies to individuals who have lost sight as a result of severe to profound retinitis pigmentosa (RP), an ailment that affects one in every 4,000 Americans. The implant allows some individuals with RP, who are completely blind, to locate objects, detect movement, improve orientation and mobility skills and discern shapes such as large letters.

The Argus II is manufactured by, and will be distributed by, Second Sight Medical Products of Sylmar, Calif., which is part of the team of scientists and engineers from the university, federal and private sectors who spent nearly two decades developing the system with public and private investment.

Scientists are often compelled to do research in an area inspired by family,

“Seeing my grandmother go blind motivated me to pursue ophthalmology and biomedical engineering to develop a treatment for patients for whom there was no foreseeable cure,” says the technology’s co-developer, Mark Humayun, associate director of research at the Doheny Eye Institute at the University of Southern California and director of the NSF Engineering Research Center for Biomimetic MicroElectronic Systems (BMES). …”

There’s also been considerable government investment,

The effort by Humayun and his colleagues has received early and continuing support from NSF, the National Institutes of Health and the Department of Energy, with grants totaling more than $100 million. The private sector’s support nearly matched that of the federal government.

“The retinal implant exemplifies how NSF grants for high-risk, fundamental research can directly result in ground-breaking technologies decades later,” said Acting NSF Assistant Director for Engineering Kesh Narayanan. “In collaboration with the Second Sight team and the courageous patients who volunteered to have experimental surgery to implant the first-generation devices, the researchers of NSF’s Biomimetic MicroElectronic Systems Engineering Research Center are developing technologies that may ultimately have as profound an impact on blindness as the cochlear implant has had for hearing loss.”

Leaving aside controversies about cochlear implants and the possibility of such controversies with artificial retinas (bionic eyes), it’s interesting to note that this device is dependent on an external camera,

The researchers’ efforts have bridged cellular biology–necessary for understanding how to stimulate the retinal ganglion cells without permanent damage–with microelectronics, which led to the miniaturized, low-power integrated chip for performing signal conversion, conditioning and stimulation functions. The hardware was paired with software processing and tuning algorithms that convert visual imagery to stimulation signals, and the entire system had to be incorporated within hermetically sealed packaging that allowed the electronics to operate in the vitreous fluid of the eye indefinitely. Finally, the research team had to develop new surgical techniques in order to integrate the device with the body, ensuring accurate placement of the stimulation electrodes on the retina.

“The artificial retina is a great engineering challenge under the interdisciplinary constraint of biology, enabling technology, regulatory compliance, as well as sophisticated design science,” adds Liu.  [Wentai Liu of the University of California, Los Angeles] “The artificial retina provides an interface between biotic and abiotic systems. Its unique design characteristics rely on system-level optimization, rather than the more common practice of component optimization, to achieve miniaturization and integration. Using the most advanced semiconductor technology, the engine for the artificial retina is a ‘system on a chip’ of mixed voltages and mixed analog-digital design, which provides self-contained power and data management and other functionality. This design for the artificial retina facilitates both surgical procedures and regulatory compliance.”

The Argus II design consists of an external video camera system matched to the implanted retinal stimulator, which contains a microelectrode array that spans 20 degrees of visual field. [emphasis mine] …

“The external camera system-built into a pair of glasses-streams video to a belt-worn computer, which converts the video into stimulus commands for the implant,” says Weiland [USC researcher Jim Weiland], “The belt-worn computer encodes the commands into a wireless signal that is transmitted to the implant, which has the necessary electronics to receive and decode both wireless power and data. Based on those data, the implant stimulates the retina with small electrical pulses. The electronics are hermetically packaged and the electrical stimulus is delivered to the retina via a microelectrode array.”

You can see some footage of people using artificial retinas in the context of Grégoire Cosendai’s TEDx Vienna presentation. As I noted in my Aug. 18, 2011 posting where this talk and developments in human enhancement are mentioned, the relevant material can be seen at approximately 13 mins., 25 secs. in Cosendai’s talk.

Second Sight Medical Devices can be found here.