Tag Archives: U.S. Department of Defense

Neuristors and brainlike computing

As you might suspect, a neuristor is based on a memristor .(For a description of a memristor there’s this Wikipedia entry and you can search this blog with the tags ‘memristor’ and neuromorphic engineering’ for more here.)

Being new to neuristors ,I needed a little more information before reading the latest and found this Dec. 24, 2012 article by John Timmer for Ars Technica (Note: Links have been removed),

Computing hardware is composed of a series of binary switches; they’re either on or off. The other piece of computational hardware we’re familiar with, the brain, doesn’t work anything like that. Rather than being on or off, individual neurons exhibit brief spikes of activity, and encode information in the pattern and timing of these spikes. The differences between the two have made it difficult to model neurons using computer hardware. In fact, the recent, successful generation of a flexible neural system required that each neuron be modeled separately in software in order to get the sort of spiking behavior real neurons display.

But researchers may have figured out a way to create a chip that spikes. The people at HP labs who have been working on memristors have figured out a combination of memristors and capacitors that can create a spiking output pattern. Although these spikes appear to be more regular than the ones produced by actual neurons, it might be possible to create versions that are a bit more variable than this one. And, more significantly, it should be possible to fabricate them in large numbers, possibly right on a silicon chip.

The key to making the devices is something called a Mott insulator. These are materials that would normally be able to conduct electricity, but are unable to because of interactions among their electrons. Critically, these interactions weaken with elevated temperatures. So, by heating a Mott insulator, it’s possible to turn it into a conductor. In the case of the material used here, NbO2, the heat is supplied by resistance itself. By applying a voltage to the NbO2 in the device, it becomes a resistor, heats up, and, when it reaches a critical temperature, turns into a conductor, allowing current to flow through. But, given the chance to cool off, the device will return to its resistive state. Formally, this behavior is described as a memristor.

To get the sort of spiking behavior seen in a neuron, the authors turned to a simplified model of neurons based on the proteins that allow them to transmit electrical signals. When a neuron fires, sodium channels open, allowing ions to rush into a nerve cell, and changing the relative charges inside and outside its membrane. In response to these changes, potassium channels then open, allowing different ions out, and restoring the charge balance. That shuts the whole thing down, and allows various pumps to start restoring the initial ion balance.

Here’s a link to and a citation for the research paper described in Timmer’s article,

A scalable neuristor built with Mott memristors by Matthew D. Pickett, Gilberto Medeiros-Ribeiro, & R. Stanley Williams. Nature Materials 12, 114–117 (2013) doi:10.1038/nmat3510 Published online 16 December 2012

This paper is behind a paywall.

A July 28, 2017 news item on Nanowerk provides an update on neuristors,

A future android brain like that of Star Trek’s Commander Data might contain neuristors, multi-circuit components that emulate the firings of human neurons.

Neuristors already exist today in labs, in small quantities, and to fuel the quest to boost neuristors’ power and numbers for practical use in brain-like computing, the U.S. Department of Defense has awarded a $7.1 million grant to a research team led by the Georgia Institute of Technology. The researchers will mainly work on new metal oxide materials that buzz electronically at the nanoscale to emulate the way human neural networks buzz with electric potential on a cellular level.

A July 28, 2017 Georgia Tech news release, which originated the news item, delves further into neuristors and the proposed work leading to an artificial retina that can learn (!). This was not where I was expecting things to go,

But let’s walk expectations back from the distant sci-fi future into the scientific present: The research team is developing its neuristor materials to build an intelligent light sensor, and not some artificial version of the human brain, which would require hundreds of trillions of circuits.

“We’re not going to reach circuit complexities of that magnitude, not even a tenth,” said Alan Doolittle, a professor at Georgia Tech’s School of Electrical and Computer Engineering. “Also, currently science doesn’t really know yet very well how the human brain works, so we can’t duplicate it.”

Intelligent retina

But an artificial retina that can learn autonomously appears well within reach of the research team from Georgia Tech and Binghamton University. Despite the term “retina,” the development is not intended as a medical implant, but it could be used in advanced image recognition cameras for national defense and police work.

At the same time, it would significantly advance brain-mimicking, or neuromorphic, computing. The research field that takes its cues from what science already does know about how the brain computes to develop exponentially more powerful computing.

The retina would be comprised of an array of ultra-compact circuits called neuristors (a word combining “neuron” and “transistor”) that sense light, compute an image out of it and store the image. All three of the functions would occur simultaneously and nearly instantaneously.

“The same device senses, computes and stores the image,” Doolittle said. “The device is the sensor, and it’s the processor, and it’s the memory all at the same time.” A neuristor itself is comprised in part of devices called memristors inspired by the way human neurons work.

Brain vs. PC

That cuts out loads of processing and memory lag time that are inherent in traditional computing.

Take the device you’re reading this article on: Its microprocessor has to tap a separate memory component to get data, then do some processing, tap memory again for more data, process some more, etc. “That back-and-forth from memory to microprocessor has created a bottleneck,” Doolittle said.

A neuristor array breaks the bottleneck by emulating the extreme flexibility of biological nervous systems: When a brain computes, it uses a broad set of neural pathways that flash with enormous data. Then, later, to compute the same thing again, it will use quite different neural paths.

Traditional computer pathways, by contrast, are hardwired. For example, look at a present-day processor and you’ll see lines etched into it. Those are pathways that computational signals are limited to.

The new memristor materials at the heart of the neuristor are not etched, and signals flow through the surface very freely, more like they do through the brain, exponentially increasing the number of possible pathways computation can take. That helps the new intelligent retina compute powerfully and swiftly.

Terrorists, missing children

The retina’s memory could also store thousands of photos, allowing it to immediately match up what it sees with the saved images. The retina could pinpoint known terror suspects in a crowd, find missing children, or identify enemy aircraft virtually instantaneously, without having to trawl databases to correctly identify what is in the images.

Even if you take away the optics, the new neuristor arrays still advance artificial intelligence. Instead of light, a surface of neuristors could absorb massive data streams at once, compute them, store them, and compare them to patterns of other data, immediately. It could even autonomously learn to extrapolate further information, like calculating the third dimension out of data from two dimensions.

“It will work with anything that has a repetitive pattern like radar signatures, for example,” Doolittle said. “Right now, that’s too challenging to compute, because radar information is flying out at such a high data rate that no computer can even think about keeping up.”

Smart materials

The research project’s title acronym CEREBRAL may hint at distant dreams of an artificial brain, but what it stands for spells out the present goal in neuromorphic computing: Cross-disciplinary Electronic-ionic Research Enabling Biologically Realistic Autonomous Learning.

The intelligent retina’s neuristors are based on novel metal oxide nanotechnology materials, unique to Georgia Tech. They allow computing signals to flow flexibly across pathways that are electronic, which is customary in computing, and at the same time make use of ion motion, which is more commonly know from the way batteries and biological systems work.

The new materials have already been created, and they work, but the researchers don’t yet fully understand why.

Much of the project is dedicated to examining quantum states in the materials and how those states help create useful electronic-ionic properties. Researchers will view them by bombarding the metal oxides with extremely bright x-ray photons at the recently constructed National Synchrotron Light Source II.

Grant sub-awardee Binghamton University is located close by, and Binghamton physicists will run experiments and hone them via theoretical modeling.

‘Sea of lithium’

The neuristors are created mainly by the way the metal oxide materials are grown in the lab, which has advantages over building neuristors in a more wired way.

This materials-growing approach is conducive to mass production. Also, though neuristors in general free signals to take multiple pathways, Georgia Tech’s neuristors do it much more flexibly thanks to chemical properties.

“We also have a sea of lithium, and it’s like an infinite reservoir of computational ionic fluid,” Doolittle said. The lithium niobite imitates the way ionic fluid bathes biological neurons and allows them to flash with electric potential while signaling. In a neuristor array, the lithium niobite helps computational signaling move in myriad directions.

“It’s not like the typical semiconductor material, where you etch a line, and only that line has the computational material,” Doolittle said.

Commander Data’s brain?

“Unlike any other previous neuristors, our neuristors will adapt themselves in their computational-electronic pulsing on the fly, which makes them more like a neurological system,” Doolittle said. “They mimic biology in that we have ion drift across the material to create the memristors (the memory part of neuristors).”

Brains are far superior to computers at most things, but not all. Brains recognize objects and do motor tasks much better. But computers are much better at arithmetic and data processing.

Neuristor arrays can meld both types of computing, making them biological and algorithmic at once, a bit like Commander Data’s brain.

The research is being funded through the U.S. Department of Defense’s Multidisciplinary University Research Initiatives (MURI) Program under grant number FOA: N00014-16-R-FO05. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of those agencies.

Fascinating, non?

Northwestern University’s (US) International Institute for Nanotechnology (IIN) rakes in some cash

Within less than a month Northwestern University’s International Institute for Nanotechnology (IIN) has been granted awarded two grants by the US Department of Defense.

4D printing

The first grant, for 4D printing, was announced in a June 11, 2015 Northwestern news release by Megan Fellman (Note: A link has been removed),

Northwestern University’s International Institute for Nanotechnology (IIN) has received a five-year, $8.5 million grant from the U.S. Department of Defense’s competitive Multidisciplinary University Research Initiative (MURI) program to develop a “4-dimensional printer” — the next generation of printing technology for the scientific world.

Once developed, the 4-D printer, operating on the nanoscale, will be used to construct new devices for research in chemistry, materials sciences and U.S. defense-related areas that could lead to new chemical and biological sensors, catalysts, microchip designs and materials designed to respond to specific materials or signals.

“This research promises to bring transformative advancement to the development of biosensors, adaptive optics, artificially engineered tissues and more by utilizing nanotechnology,” said IIN director and chemist Chad A. Mirkin, who is leading the multi-institution project. Mirkin is the George B. Rathmann Professor of Chemistry in the Weinberg College of Arts and Sciences.

The award, issued by the Air Force Office of Scientific Research, supports a team of experts from Northwestern, the University of Miami, the University of California, San Diego, and the University of Maryland.

In science, “printing” encodes information at specific locations on a material’s surface, similar to how we print words on paper with ink. The 4-dimensional printer will consist of millions of tiny elastomeric “pens” that can be used individually and independently to create nanometer-size features composed of hard or soft materials.

The information encoded can be in the form of materials with a defined set of chemical and physical properties. The printing speed and resolution determine the amount and complexity of the information that can be encoded.

Progress in fields ranging from biology to chemical sensing to computing currently are limited by the lack of low-cost equipment that can perform high-resolution printing and 3-dimensional patterning on hard materials (e.g., metals and semiconductors) and soft materials (e.g., organic and biological materials) at nanometer resolution (approximately 1,000 times smaller than the width of a human hair).

“Ultimately, the 4-D printer will provide a foundation for a new generation of tools to develop novel architectures, wherein the hard materials that form the functional components of electronics can be merged with biological or soft materials,” said Milan Mrksich, a co-principal investigator on the grant.

Mrksich is the Henry Wade Rogers Professor of Biomedical Engineering, Chemistry and Cell and Molecular Biology, with appointments in the McCormick School of Engineering and Applied Science, Weinberg and Northwestern University Feinberg School of Medicine.

A July 10, 2015 article about the ‘4D printer’ grant  by Madeline Fox for the Daily Northwestern features a description of 4D printing from Milan Mrksich, a co-principal investigator on the grant,

Milan Mrksich, one of the project’s five senior participants, said that while most people are familiar with the three dimensions of length, width and depth, there are often misconceptions about the fourth property of a four-dimensional object. Mrksich used Legos as an analogy to describe 4D printing technology.

“If you take Lego blocks, you can basically build any structure you want by controlling which Lego is connected to which Lego and controlling all their dimensions in space,” Mrksich said. “Within an object made up of nanoparticles, we’re controlling the placement — as we use a printer to control the placement of every particle, our fourth dimension lets us choose which nanoparticle with which property would be at each position.”

Thank you Dr. Mrksich and Ms. Fox for that helpful analogy.

Designing advanced bioprogrammable nanomaterials

The second grant, announced in a July 6, 2015 Northwestern news release by Megan Fellman, is apparently the only one of its kind in the US (Note: A link has been removed),

Northwestern University’s International Institute for Nanotechnology (IIN) has been awarded a U.S. Air Force Center of Excellence grant to design advanced bioprogrammable nanomaterials for solutions to challenging problems in the areas of energy, the environment, security and defense, as well as for developing ways to monitor and mitigate human stress.

The five-year, $9.8 million grant establishes the Center of Excellence for Advanced Bioprogrammable Nanomaterials (C-ABN), the only one of its kind in the country. After the initial five years, the grant potentially could be renewed for an additional five years.

“Northwestern University was chosen to lead this Center of Excellence because of its investment in infrastructure development, including new facilities and instrumentation; its recruitment of high-caliber faculty members and students; and its track record in bio-nanotechnology and cognitive sciences,” said Timothy Bunning, chief scientist at the U.S. Air Force Research Laboratory (AFRL) Materials and Manufacturing Directorate.

Led by IIN director Chad A. Mirkin, C-ABN will support collaborative, discovery-based research projects aimed at developing bioprogrammable nanomaterials that will meet both military and civilian needs and facilitate the efficient transition of these new technologies from the laboratory to marketplace.

Bioprogrammable nanomaterials are structures that typically contain a biomolecular component, such as nucleic acids or proteins, which give the materials a variety of novel capabilities. [emphasis mine] Nanomaterials can be designed to assemble into large 3-D structures, to interface with biological structures inside cells or tissues, or to interface with existing macroscale devices, for example. These new bioprogrammable nanomaterials and the fundamental knowledge gained through their development will ultimately lead to the creation of wearable, portable and/or human-interactive devices with extraordinary capabilities that will significantly impact both civilian and Air Force needs.

In one research area, scientists will work to understand the molecular underpinnings of vulnerability and resilience to stress. They will use bioprogrammable nanomaterials to develop ultrasensitive sensors capable of detecting and quantifying biomarkers for human stress in biological fluids (e.g., saliva, perspiration or blood), providing means to easily monitor the soldier during times of extreme stress. Ultimately, these bioprogrammable materials may lead to methods to increase human cellular resilience to the effects of stress and/or to correct genetic mutations that decrease cellular resilience of susceptible individuals.

Other research projects, encompassing a wide variety of nanotechnology-enabled goals, include:

Developing hybrid wearable energy-storage devices;
Developing devices to identify chemical and biological targets in a field environment;
Developing flexible bio-electronic circuits;
Designing a new class of flat optics; and
Advancing understanding of design rules between 2-D and 3-D architectures.

The analysis of these nanostructures also will extend fundamental knowledge in the fields of materials science and engineering, human performance, chemistry, biology and physics.

The center will be housed under the IIN, providing researchers with access to IIN’s strong entrepreneurial community and its close ties with Northwestern’s renowned Kellogg School of Management.

This second news release provides an interesting contrast to a recent news release from Sweden’s Karolinska Intitute where the writer was careful to note that the enzymes and organic electronic ion pumps were not living as noted in my June 26, 2015 posting. It seems nucleic acids (as in RNA and DNA) can be mentioned without a proviso in the US. as there seems to be little worry about anti-GMO (genetically modified organisms) and similar backlashes affecting biotechnology research.

‘Glow in the dark’, paint-on bandage heals

Somewhat unexpectedly (to me), this research about a ‘smart’ paint-on bandage is being published by The Optical Society of America (OSA). Here’s more about the work from an Oct. 1, 2014 news item on Nanowerk,

Inspired by a desire to help wounded soldiers, an international, multidisciplinary team of researchers led by Assistant Professor Conor L. Evans at the Wellman Center for Photomedicine of Massachusetts General Hospital (MGH) and Harvard Medical School (HMS) has created a paint-on, see-through, “smart” bandage that glows to indicate a wound’s tissue oxygenation concentration. Because oxygen plays a critical role in healing, mapping these levels in severe wounds and burns can help to significantly improve the success of surgeries to restore limbs and physical functions.

An Oct. 1, 2014 OSA news release (also on EurekAlert), which originated the news item, describes the interest in oxygenation in more detail,

“Information about tissue oxygenation is clinically relevant but is often inaccessible due to a lack of accurate or noninvasive measurements,” explained lead author Zongxi Li, an HMS research fellow on Evans’ team.

Now, the “smart” bandage developed by the team provides direct, noninvasive measurement of tissue oxygenation by combining three simple, compact and inexpensive components: a bright sensor molecule with a long phosphorescence lifetime and appropriate dynamic range; a bandage material compatible with the sensor molecule that conforms to the skin’s surface to form an airtight seal; and an imaging device capable of capturing the oxygen-dependent signals from the bandage with high signal-to-noise ratio.

This work is part of the team’s long-term program “to develop a Sensing, Monitoring And Release of Therapeutics (SMART) bandage for improved care of patients with acute or chronic wounds,” says Evans …

The news release goes on to briefly explain the technology,

For starters, the bandage’s not-so-secret key ingredient is phosphors—molecules that absorb light and then emit it via a process known as phosphorescence.

Phosphorescence is encountered by many on a daily basis—ranging from glow-in-the-dark dials on watches to t-shirt lettering. “How brightly our phosphorescent molecules emit light depends on how much oxygen is present,” said Li. “As the concentration of oxygen is reduced, the phosphors glow both longer and more brightly.” To make the bandage simple to interpret, the team also incorporated a green oxygen-insensitive reference dye, so that changes in tissue oxygenation are displayed as a green-to-red colormap.

The bandage is applied by “painting” it onto the skin’s surface as a viscous liquid, which dries to a solid thin film within a minute. Once the first layer has dried, a transparent barrier layer is then applied atop it to protect the film and slow the rate of oxygen exchange between the bandage and room air—making the bandage sensitive to the oxygen within tissue.

The final piece involves a camera-based readout device, which performs two functions: it provides a burst of excitation light that triggers the emission of the phosphors inside the bandage, and then it records the phosphors’ emission. “Depending on the camera’s configuration, we can measure either the brightness or color of the emitted light across the bandage or the change in brightness over time,” Li said. “Both of these signals can be used to create an oxygenation map.”  The emitted light from the bandage is bright enough that it can be acquired using a regular camera or smartphone—opening the possibility to a portable, field-ready device.

There are some immediate applications, as well as, plans for research that will yield applications (from the news release),

Immediate applications for the oxygen-sensing bandage include monitoring patients with a risk of developing ischemic (restricted blood supply) conditions, postoperative monitoring of skin grafts or flaps, and burn-depth determination as a guide for surgical debridement—the removal of dead or damaged tissue from the body.

“The need for a reliable, accurate and easy-to-use method of rapid assessment of blood flow to the skin for patients remains a clinical necessity,” said co-author Samuel Lin, an HMS associate professor of surgery at Beth Israel Deaconess Medical Center. “Plastic surgeons continuously monitor the state of blood flow to the skin, so the liquid-bandage oxygenation sensor is an exciting step toward improving patient care within the realm of vascular blood flow examination of the skin.”

What’s the next step for the bandage? “We’re developing brighter sensor molecules to improve the bandage’s oxygen sensing efficiency,” said Emmanuel Roussakis, another research fellow in Evans’ laboratory and co-author, who is leading the sensor development effort.  The team’s laboratory research will also focus on expanding the sensing capability of the bandage to other treatment-related parameters—such as pH, bacterial load, oxidative states and specific disease markers—and incorporating an on-demand drug release capacity.

“In the future, our goal for the bandage is to incorporate therapeutic release capabilities that allow for on-demand drug administration at a desired location,” says Evans. “It allows for the visual assessment of the wound bed, so treatment-related wound parameters are readily accessible without the need for bandage removal—preventing unnecessary wound disruption and reducing the chance for bacterial infection.”

Should you be interested, the researchers are looking for industry partners,

Beyond the lab, the team’s aim is to move this technology from the bench to the bedside, so they are actively searching for industry partners. They acknowledge research support from the Military Medical Photonics Program from the U.S. Department of Defense, and National Institutes of Health.

Here’s a link to and a citation for the paper,

Non-invasive transdermal two-dimensional mapping of cutaneous oxygenation with a rapid-drying liquid bandage by Zongxi Li, Emmanuel Roussakis, Pieter G. L. Koolen, Ahmed M. S. Ibrahim, Kuylhee Kim, Lloyd F. Rose, Jesse Wu, Alexander J. Nichols, Yunjung Baek, Reginald Birngruber, Gabriela Apiou-Sbirlea, Robina Matyal, Thomas Huang, Rodney Chan, Samuel J. Lin, and Conor L. Evans. Biomedical Optics Express, Vol. 5, Issue 11, pp. 3748-3764 (2014) http://dx.doi.org/10.1364/BOE.5.003748

This article is open access.

The researcher’s have provided an illustration of the bandage,

Caption: The transparent liquid bandage displays a quantitative, oxygenation-sensitive colormap that can be easily acquired using a simple camera or smartphone. Credit: Li/Wellman Center for Photomedicine.

Caption: The transparent liquid bandage displays a quantitative, oxygenation-sensitive colormap that can be easily acquired using a simple camera or smartphone. Credit: Li/Wellman Center for Photomedicine.