Tag Archives: Ben Levine

Smart paint that ‘talks’ to canes for better safety crossing the street

It would be nice if they had some video of people navigating with the help of this ‘smart’ paint. Perhaps one day. Meanwhile, Adele Peters in her March 7, 2018 article for Fast Company provides a vivid description of how a sight-impaired or blind person could navigate more safely and easily,

The crosswalk on a road in front of the Ohio State School for the Blind looks like one that might be found at any intersection. But the white stripes at the edges are made with “smart paint”–and if a student who is visually impaired crosses while using a cane with a new smart tip, the cane will vibrate when it touches the lines.

The paint uses rare-earth nanocrystals that can emit a unique light signature, which a sensor added to the tip of a cane can activate and then read. “If you pulse a laser or LED into these materials, they’ll pulse back at you at a very specific frequency,” says Josh Collins, chief technology officer at Intelligent Materials [sic], the company that manufacturers the oxides that can be added to paint.

While digging down for more information, this February 12, 2018 article by Ben Levine for Government Technology Magazine was unearthed (Note: Links have been removed),

In this installment of the Innovation of the Month series (read last month’s story here), we explore the use of smart technologies to help blind and visually impaired people better navigate the world around them. A team at Ohio State University has been working on a “smart paint” application to do just that.

MetroLab’s Executive Director Ben Levine sat down with John Lannutti, professor of materials science engineering at Ohio State University; Mary Ball-Swartwout, orientation and mobility specialist at the Ohio State School for the Blind; and Josh Collins, chief technology officer at Intelligent Material to learn more.

John Lannutti (OSU): The goal of “smart paint for networked smart cities” is to assist people who are blind and visually impaired by implementing a “smart paint” technology that provides accurate location services. You might think, “Can’t GPS do that?” But, surprisingly, current GPS-based solutions actually cannot tell whether somebody is walking on the sidewalk or down the middle of the street. Meanwhile, modern urban intersections are becoming increasingly complex. That means that finding a crosswalk, aligning to cross and maintaining a consistent crossing direction while in motion can be challenging for people who are visually impaired.

And of course, crosswalks aren’t the only challenge. For example, our current mapping technologies are unable to provide the exact location of a building’s entrance. We have a technology solution to those challenges. Smart paint is created by adding exotic light-converting oxides to standard road paints. The paint is detected using a “smart cane,” a modified white cane that detects the smart paint and enables portal-to-portal guidance. The smart cane can also be used to notify vehicles — including autonomous vehicles — of a user’s presence in a crosswalk.

As part of this project, we have a whole team of educational, city and industrial partners, including:

Educational partners: 

  • Ohio State School for the Blind — testing and implementation of smart paint technology in Columbus involving both students and adults
  • Western Michigan University — implementation of smart paint technology with travelers who are blind and visually impaired to maximize orientation and mobility
  • Mississippi State University — the impacts of smart paint technology on mobility and employment for people who are blind and visually impaired

City partners:  

  • Columbus Smart Cities Initiative — rollout of smart paint within Columbus and the paint’s interaction with the Integrated Data Exchange (IDE), a cloud-based platform that dynamically collects user data to show technological impact
  • The city of Tampa, Fla. — rollout of smart paint at the Lighthouse for the Blind
  • The Hillsborough Area Transit Regional Authority, Hillsborough County, Fla. — integration of smart paint with existing bus lines to enable precise location determination
  • The American Council of the Blind — implementation of smart paint with the annual American Council of the Blind convention
  • MetroLab Network — smart paint implementation in city-university partnerships

Industrial collaborators:  

  • Intelligent Material — manufactures and supplies the unique light-converting oxides that make the paint “smart”
  • Crown Technology — paint manufacturing, product evaluation and technical support
  • SRI International — design and manufacturing of the “smart” white cane hardware

Levine: Can you describe what this project focused on and what motivated you to address this particular challenge?

Lannutti: We have been working with Intelligent Material in integrating light-converting oxides into polymeric matrices for specific applications for several years. Intelligent Material supplies these oxides for highly specialized applications across a variety of industries, and has deep experience in filtering and processing the resulting optical outputs. They were already looking at using this technology for automotive applications when the idea to develop applications for people who are blind was introduced. We were extremely fortunate to have the Ohio State School for the Blind (OSSB) right here in Columbus and even more fortunate to have interested collaborators there who have helped us at every step of the way. They even have a room filled with previous white cane technologies; we used those to better understand what works and what doesn’t, helping refine our own product. At about this same time, the National Science Foundation released a call for Smart and Connected Communities proposals, which gave us both a goal and a “home” for this idea.

Levine: How will the tools developed in this project impact planning and the built environment?

Ball-Swartwout: One of the great things about smart paint is that it can be added to the built environment easily at little extra cost. We expect that once smart paint is widely adopted, most sighted users will not notice much difference as smart paint is not visually different from regular road paint. Some intersections might need to have more paint features that enable smart white cane-guided entry from the sidewalk into the crosswalk. Paint that tells users that they have reached their destination may become visible as horizontal stripes along modern sidewalks. These paints could be either gray or black or even invisible to sighted pedestrians, but would still be detectable by “smart” white canes to tell users that they have arrived at their destination.

Levine: Can you tell us about the new technologies that are associated with this project? Can you talk about the status quo versus your vision for the future?

Collins: Beyond converting ceramics in paint, placing a highly sensitive excitation source and detector package at the tip of a moving white cane is truly novel. Also challenging is powering this package using minimal battery weight to decrease the likelihood of wrist and upper neck fatigue.

The status quo is that the travel of citizens who are blind and visually impaired can be unpredictable. They need better technologies for routine travel and especially for travel to any new destinations. In addition, we anticipate that this technology could assist in the travel of people who have a variety of physical and cognitive impairments.

Our vision for the future of this technology is that it will be widespread and utilized constantly. Outside the U.S., Japan and Europe have integrated relatively expensive technologies into streets and sidewalks, and we see smart paint replacing that very quickly. Because the “pain” of installing smart paint is very small, we believe that grass-roots pressure will enable rapid introduction of this technology.

Levine: What was the most surprising thing you learned during this process?

Lannutti: In my mind, the most surprising thing was discovering that sound was not necessarily the best means of guiding users who are blind. This is a bias on the part of sighted individuals as we are used to beeping and buzzing noises that guide or inform us throughout our day. Pedestrians who are blind, on the other hand, need to constantly listen to aspects of their environment to successfully navigate it. For example, listening to traffic noise is extremely important to them as a means of avoiding danger. People who are blind or visually impaired cannot see but need to hear their environment. So we had to dial back our expectations regarding the utility of sound. Instead, we now focus on vibration along the white cane as a means of alerting the user.

If those interested, Levine’s article is well worth reading in its entirety.

Thankfully they’ve added some information to the website for Intelligent Material (Solutions) since I first viewed it.

There’s a bit more information on the Intelligent Material (Solutions’) YouTube video webpage,

Intelligent Material Solutions, Inc. is a privately held business headquartered in Princeton, NJ in the SRI/Sarnoff Campus, formerly RCA Labs. Our technology can be traced through scientific discoveries dating back over 50 years. We are dedicated to solving the worlds’ most challenging problems and in doing so have assembled an innovative, multi-discipliary team of leading scientists from industry and academia to ensure rapid transition from our labs to the world.

The video was published on December 6, 2017. You can find even more details at the company’s LinkedIn page.