Tag Archives: smart paint

Smart paint that ‘talks’ to canes for better safety crossing the street

Leave a reply

It would be nice if they had some video of people navigating with the help of this ‘smart’ paint. Perhaps one day. Meanwhile, Adele Peters in her March 7, 2018 article for Fast Company provides a vivid description of how a sight-impaired or blind person could navigate more safely and easily,

The crosswalk on a road in front of the Ohio State School for the Blind looks like one that might be found at any intersection. But the white stripes at the edges are made with “smart paint”–and if a student who is visually impaired crosses while using a cane with a new smart tip, the cane will vibrate when it touches the lines.

The paint uses rare-earth nanocrystals that can emit a unique light signature, which a sensor added to the tip of a cane can activate and then read. “If you pulse a laser or LED into these materials, they’ll pulse back at you at a very specific frequency,” says Josh Collins, chief technology officer at Intelligent Materials [sic], the company that manufacturers the oxides that can be added to paint.

…

While digging down for more information, this February 12, 2018 article by Ben Levine for Government Technology Magazine was unearthed (Note: Links have been removed),

In this installment of the Innovation of the Month series (read last month’s story here), we explore the use of smart technologies to help blind and visually impaired people better navigate the world around them. A team at Ohio State University has been working on a “smart paint” application to do just that.

MetroLab’s Executive Director Ben Levine sat down with John Lannutti, professor of materials science engineering at Ohio State University; Mary Ball-Swartwout, orientation and mobility specialist at the Ohio State School for the Blind; and Josh Collins, chief technology officer at Intelligent Material to learn more.

John Lannutti (OSU): The goal of “smart paint for networked smart cities” is to assist people who are blind and visually impaired by implementing a “smart paint” technology that provides accurate location services. You might think, “Can’t GPS do that?” But, surprisingly, current GPS-based solutions actually cannot tell whether somebody is walking on the sidewalk or down the middle of the street. Meanwhile, modern urban intersections are becoming increasingly complex. That means that finding a crosswalk, aligning to cross and maintaining a consistent crossing direction while in motion can be challenging for people who are visually impaired.

And of course, crosswalks aren’t the only challenge. For example, our current mapping technologies are unable to provide the exact location of a building’s entrance. We have a technology solution to those challenges. Smart paint is created by adding exotic light-converting oxides to standard road paints. The paint is detected using a “smart cane,” a modified white cane that detects the smart paint and enables portal-to-portal guidance. The smart cane can also be used to notify vehicles — including autonomous vehicles — of a user’s presence in a crosswalk.

As part of this project, we have a whole team of educational, city and industrial partners, including:

Educational partners: 

  • Ohio State School for the Blind — testing and implementation of smart paint technology in Columbus involving both students and adults
  • Western Michigan University — implementation of smart paint technology with travelers who are blind and visually impaired to maximize orientation and mobility
  • Mississippi State University — the impacts of smart paint technology on mobility and employment for people who are blind and visually impaired

City partners:  

  • Columbus Smart Cities Initiative — rollout of smart paint within Columbus and the paint’s interaction with the Integrated Data Exchange (IDE), a cloud-based platform that dynamically collects user data to show technological impact
  • The city of Tampa, Fla. — rollout of smart paint at the Lighthouse for the Blind
  • The Hillsborough Area Transit Regional Authority, Hillsborough County, Fla. — integration of smart paint with existing bus lines to enable precise location determination
  • The American Council of the Blind — implementation of smart paint with the annual American Council of the Blind convention
  • MetroLab Network — smart paint implementation in city-university partnerships

Industrial collaborators:  

  • Intelligent Material — manufactures and supplies the unique light-converting oxides that make the paint “smart”
  • Crown Technology — paint manufacturing, product evaluation and technical support
  • SRI International — design and manufacturing of the “smart” white cane hardware

Levine: Can you describe what this project focused on and what motivated you to address this particular challenge?

Lannutti: We have been working with Intelligent Material in integrating light-converting oxides into polymeric matrices for specific applications for several years. Intelligent Material supplies these oxides for highly specialized applications across a variety of industries, and has deep experience in filtering and processing the resulting optical outputs. They were already looking at using this technology for automotive applications when the idea to develop applications for people who are blind was introduced. We were extremely fortunate to have the Ohio State School for the Blind (OSSB) right here in Columbus and even more fortunate to have interested collaborators there who have helped us at every step of the way. They even have a room filled with previous white cane technologies; we used those to better understand what works and what doesn’t, helping refine our own product. At about this same time, the National Science Foundation released a call for Smart and Connected Communities proposals, which gave us both a goal and a “home” for this idea.

…

Levine: How will the tools developed in this project impact planning and the built environment?

Ball-Swartwout: One of the great things about smart paint is that it can be added to the built environment easily at little extra cost. We expect that once smart paint is widely adopted, most sighted users will not notice much difference as smart paint is not visually different from regular road paint. Some intersections might need to have more paint features that enable smart white cane-guided entry from the sidewalk into the crosswalk. Paint that tells users that they have reached their destination may become visible as horizontal stripes along modern sidewalks. These paints could be either gray or black or even invisible to sighted pedestrians, but would still be detectable by “smart” white canes to tell users that they have arrived at their destination.

Levine: Can you tell us about the new technologies that are associated with this project? Can you talk about the status quo versus your vision for the future?

Collins: Beyond converting ceramics in paint, placing a highly sensitive excitation source and detector package at the tip of a moving white cane is truly novel. Also challenging is powering this package using minimal battery weight to decrease the likelihood of wrist and upper neck fatigue.

…

The status quo is that the travel of citizens who are blind and visually impaired can be unpredictable. They need better technologies for routine travel and especially for travel to any new destinations. In addition, we anticipate that this technology could assist in the travel of people who have a variety of physical and cognitive impairments.

Our vision for the future of this technology is that it will be widespread and utilized constantly. Outside the U.S., Japan and Europe have integrated relatively expensive technologies into streets and sidewalks, and we see smart paint replacing that very quickly. Because the “pain” of installing smart paint is very small, we believe that grass-roots pressure will enable rapid introduction of this technology.

…

Levine: What was the most surprising thing you learned during this process?

Lannutti: In my mind, the most surprising thing was discovering that sound was not necessarily the best means of guiding users who are blind. This is a bias on the part of sighted individuals as we are used to beeping and buzzing noises that guide or inform us throughout our day. Pedestrians who are blind, on the other hand, need to constantly listen to aspects of their environment to successfully navigate it. For example, listening to traffic noise is extremely important to them as a means of avoiding danger. People who are blind or visually impaired cannot see but need to hear their environment. So we had to dial back our expectations regarding the utility of sound. Instead, we now focus on vibration along the white cane as a means of alerting the user.

If those interested, Levine’s article is well worth reading in its entirety.

Thankfully they’ve added some information to the website for Intelligent Material (Solutions) since I first viewed it.

There’s a bit more information on the Intelligent Material (Solutions’) YouTube video webpage,

Intelligent Material Solutions, Inc. is a privately held business headquartered in Princeton, NJ in the SRI/Sarnoff Campus, formerly RCA Labs. Our technology can be traced through scientific discoveries dating back over 50 years. We are dedicated to solving the worlds’ most challenging problems and in doing so have assembled an innovative, multi-discipliary team of leading scientists from industry and academia to ensure rapid transition from our labs to the world.

The video was published on December 6, 2017. You can find even more details at the company’s LinkedIn page.

Signal danger with smart paint

3 Replies

I was expecting to see the Fraunhofer Institute mentioned (as I’ve covered more than one of their announcements about smart coatings) but it turns out that this smart nanotechnology-enabled paint is being developed by a research team at the University of Strathclyde (Scotland).

From the Jan. 30, 2012 news item on Nanowerk,

An innovative low-cost smart paint that can detect microscopic faults in wind turbines, mines and bridges before structural damage occurs is being developed by researchers at the University of Strathclyde in Glasgow, Scotland. [emphasis mine]

The environmentally-friendly paint uses nanotechnology to detect movement in large structures, and could shape the future of safety monitoring.

…

Dr Mohamed Saafi, of the University’s Department of Civil Engineering, said: “The development of this smart paint technology could have far-reaching implications for the way we monitor the safety of large structures all over the world.

There are no limitations as to where it could be used and the low-cost nature gives it a significant advantage over the current options available in the industry. The process of producing and applying the paint also gives it an advantage as no expertise is required and monitoring itself is straightforward.”

The paint the researchers have been testing is made with fly ash, a recycled waste product, and carbon nanotubes. Mixed together, the ingredients yield a paint with properties similar to cement.

Sam Shead in his Jan. 30, 2012 article for The Engineer explores some of the technical aspects with David McGahon, the researcher who initiated the project as part of his PhD work. One of the aspects making this smart paint possible is that the carbon nanotubes in it can carry an electrical current and changes in the state of a structure can be detected should the carbon nanotubes on the structure bend and affect the electrical current. Excerpted from the article,

… bending is detected by electrodes incorporated within the structure and therefore any significant change in the flow of electrical current can be interpreted as a sign of a structural defect.

…

… wireless communication nodes [in the structures] will be powered in part by a battery but are also expected to rely on energy-harvesting methods where possible.

‘If you’re in a tunnel, you can use the vibrations of cars or trains going past to harvest power. If you’re on a bridge, you could maybe use a solar panel,’ said McGahon. ‘The idea is to make it more sustainable so you’re not running out to your bridge or structure to change the battery all the time.’

If you want to get more technical understanding of the work, I highly recommend Shead’s article.

The news item on Nanowerk offers some more ‘big picture’ details,

“Wind turbine foundations are currently being monitored through visual inspections. The developed paint with the wireless monitoring system would significantly reduce the maintenance costs and improve the safety of these large structures.

“Current technology is restricted to looking at specific areas of a structure at any given time, however, smart paint covers the whole structure which is particularly useful to maximise the opportunity of preventing significant damage.”

The research has been carried out at Strathclyde with Dr Saafi working alongside David McGahon, who initiated the work as part of his PhD project. With fly ash being the main material used to make the paint, it costs just one percent of the alternative widely used inspection methods. [emphasis mine]

A prototype has been developed and tests have shown the paint to be highly effective. It is hoped further tests will be carried out in Glasgow in the near future.

Dr Saafi added: “We are able to carry out the end-to-end process at the University and we are hoping that we can now demonstrate its effectiveness on a large structure.

If you’re at all curious as to what this smart paint looks like here’s an image of David McGahon with a wireless device and the paint (from the University of Strathclyde’s Jan. 30, 2012 news release),

David McGahon with wireless device and smart paint. Courtesy of the University of Strathclyde.

Very exciting stuff!