Tag Archives: haptic technology

Tactile technology for VR (virtual reality) and AR (augmented reality) users

Tactile technology is also known as haptic technology and you’ll find there are more names for this technology in a September 9, 2024 Institute for Basic Science (IBS) press release (also on EurekAlert) about some of the latest research from Korea,

A virtual haptic implementation technology that allows all users to experience the same tactile sensation has been developed. A research team led by Professor PARK Jang-Ung from the Center for Nanomedicine within the Institute for Basic Science (IBS) and Professor JUNG Hyun Ho from Severance Hospital’s Department of Neurosurgery has developed a technology that provides consistent tactile sensations on displays.

Virtual haptic implementation technology, also known as tactile rendering technology, refers to the methods and systems that simulate the sense of touch in a virtual environment. This technology aims to create the sensation of physical contact with virtual objects, enabling users to “feel” textures, shapes, and forces as if they were interacting with real-world items, even though the objects are digital. The technology is seeing increasing uses in the realms of virtual reality (VR) and augmented reality (AR), where it is used alongside visual and auditory cues to bridge the gap between the virtual and physical worlds.

Notably, electrotactile systems, which generate tactile sensations through electrical stimulation rather than physical vibrations, are emerging as promising next-generation tactile rendering technologies. The sensation of touch is mediated by mechanoreceptors, which are tactile sensory cells located in the skin that transmit tactile information to the brain in the form of electrical signals. Electrotactile systems artificially generate these electrical signals, thereby simulating the sense of touch. Precise and varied tactile experiences can be created by adjusting current density and frequency.

Despite their potential, existing electrotactile technologies face challenges, particularly in safety and consistency. Variations in skin contact pressure can lead to unstable tactile sensations, and the use of high currents raises safety concerns. To address these issues, the IBS research team developed a Transparent Pressure-Calibratable Interference Electrotactile Actuator (TPIEA).

TPIEA comprises two main components: an electrode section responsible for generating electrotactile sensations and a pressure sensor section that adjusts for finger pressure. Researchers greatly reduced the impedance of the electrode by applying platinum nanoparticles to an indium tin oxide-based electrode. This not only decreased impedance compared to conventional electrodes but also achieved a high transmittance of approximately 90%. The integrated pressure sensor ensures that users experience consistent tactile feedback regardless of how they touch the display.

Moreover, the research team conducted a Somatosensory Evoked Potential (SEP) test to quantify tactile sensations. By examining the responses of the user’s somatosensory system to variations in the current and frequency of electrotactile stimulation, they were able to quantitatively differentiate and standardize tactile sensations. The team successfully implemented over nine distinct types of electrotactile sensations, ranging from those resembling hair to those resembling glass, depending on the current density and frequency of the electrical stimulation. The team further demonstrated that the TPIEA could be integrated with smartphone displays to reliably produce complex tactile patterns.

Additionally, the research introduced interference phenomena into the realm of electrotactile technology. The interference phenomenon pertains to the alterations in frequency and amplitude that occur when two electromagnetic fields overlap. This allowed the researchers to elicit the same intensity of electrotactile sensation with a current density that is 30% lower than previously required and to achieve an approximate 32% enhancement in tactile resolution.This research demonstrates the highest level of tactile resolution among current electrotactile technologies, including the Teslasuit.

Lead researcher PARK Jang-Ung remarked, “Through this electrotactile technology, we can effectively integrate visual information from displays with tactile information,” and further expressed, “We anticipate that the findings of this research will significantly enhance the interaction between users and devices across various AR, VR, and smart device applications based on interference stimulation.”

This research has been conducted in collaboration with colleagues from Yonsei University Severance Hospital. It was published in Nature Communications on August 21, 2024.

Here’s a link to and a citation for the paper,

Interference haptic stimulation and consistent quantitative tactility in transparent electrotactile screen with pressure-sensitive transistors by Kyeonghee Lim, Jakyoung Lee, Sumin Kim, Myoungjae Oh, Chin Su Koh, Hunkyu Seo, Yeon-Mi Hong, Won Gi Chung, Jiuk Jang, Jung Ah Lim, Hyun Ho Jung & Jang-Ung Park. Nature Communications volume 15, Article number: 7147 (2024) DOI: https://doi.org/10.1038/s41467-024-51593-2 Published: 21 August 2024

This paper is open access.

Wearable technology: two types of sensors one from the University of Glasgow (Scotland) and the other from the University of British Columbia (Canada)

Sometimes it’s good to try and pull things together.

University of Glasgow and monitoring chronic conditions

A February 23, 2018 news item on phys.org describes the latest wearable tech from the University of Glasgow,

A new type of flexible, wearable sensor could help people with chronic conditions like diabetes avoid the discomfort of regular pin-prick blood tests by monitoring the chemical composition of their sweat instead.

In a new paper published in the journal Biosensors and Bioelectronics, a team of scientists from the University of Glasgow’s School of Engineering outline how they have built a stretchable, wireless system which is capable of measuring the pH level of users’ sweat.

A February 22, 2018 University of Glasgow press release, which originated the news item, expands on the theme,

Ravinder Dahiya

 Courtesy: University of Glasgow

 

Sweat, like blood, contains chemicals generated in the human body, including glucose and urea. Monitoring the levels of those chemicals in sweat could help clinicians diagnose and monitor chronic conditions such as diabetes, kidney disease and some types of cancers without invasive tests which require blood to be drawn from patients.

However, non-invasive, wearable systems require consistent contact with skin to offer the highest-quality monitoring. Current systems are made from rigid materials, making it more difficult to ensure consistent contact, and other potential solutions such as adhesives can irritate skin. Wireless systems which use Bluetooth to transmit their information are also often bulky and power-hungry, requiring frequent recharging.

The University of Glasgow team’s new system is built around an inexpensively-produced sensor capable of measuring pH levels which can stretch and flex to better fit the contours of users’ bodies. Made from a graphite-polyurethane composite and measuring around a single square centimetre, it can stretch up to 53% in length without compromising performance. It will also continue to work after being subjected to flexes of 30% up to 500 times, which the researchers say will allow it to be used comfortably on human skin with minimal impact on the performance of the sensor.

The sensor can transmit its data wirelessly, and without external power, to an accompanying smartphone app called ‘SenseAble’, also developed by the team. The transmissions use near-field communication, a data transmission system found in many current smartphones which is used most often for smartphone payments like ApplePay, via a stretchable RFID antenna integrated into the system – another breakthrough innovation from the research team.

The smartphone app allows users to track pH levels in real time and was demonstrated in the lab using a chemical solution created by the researchers which mimics the composition of human sweat.

The research was led by Professor Ravinder Dahiya, head of the University of Glasgow’s School of Engineering’s Bendable Electronics and Sensing Technologies (BEST) group.

Professor Dahiya said: “Human sweat contains much of the same physiological information that blood does, and its use in diagnostic systems has the significant advantage of not needing to break the skin in order to administer tests.

“Now that we’ve demonstrated that our stretchable system can be used to monitor pH levels, we’ve already begun additional research to expand the capabilities of the sensor and make it a more complete diagnostic system. We’re planning to add sensors capable of measuring glucose, ammonia and urea, for example, and ultimately we’d like to see a system ready for market in the next few years.”

The team’s paper, titled ‘Stretchable Wireless System for Sweat pH Monitoring’, is published in Biosensors and Bioelectronics. The research was supported by funding from the European Commission and the Engineering and Physical Sciences Research Council (EPSRC).

Here’s a link to and a citation for the paper,

Stretchable wireless system for sweat pH monitoring by Wenting Dang, Libu Manjakkal, William Taube Navaraj, Leandro Lorenzelli, Vincenzo Vinciguerra. Biosensors and Bioelectronics Volume 107, 1 June 2018, Pages 192–202 [Available online February 2018] https://doi.org/10.1016/j.bios.2018.02.025

This paper is behind a paywall.

University of British Columbia (UBC; Okanagan) and monitor bio-signals

This is a completely other type of wearable tech monitor, from a February 22, 2018 UBC news release (also on EurekAlert) by Patty Wellborn (A link has been removed),

Creating the perfect wearable device to monitor muscle movement, heart rate and other tiny bio-signals without breaking the bank has inspired scientists to look for a simpler and more affordable tool.

Now, a team of researchers at UBC’s Okanagan campus have developed a practical way to monitor and interpret human motion, in what may be the missing piece of the puzzle when it comes to wearable technology.

What started as research to create an ultra-stretchable sensor transformed into a sophisticated inter-disciplinary project resulting in a smart wearable device that is capable of sensing and understanding complex human motion, explains School of Engineering Professor Homayoun Najjaran.

The sensor is made by infusing graphene nano-flakes (GNF) into a rubber-like adhesive pad. Najjaran says they then tested the durability of the tiny sensor by stretching it to see if it can maintain accuracy under strains of up to 350 per cent of its original state. The device went through more than 10,000 cycles of stretching and relaxing while maintaining its electrical stability.

“We tested this sensor vigorously,” says Najjaran. “Not only did it maintain its form but more importantly it retained its sensory functionality. We have further demonstrated the efficacy of GNF-Pad as a haptic technology in real-time applications by precisely replicating the human finger gestures using a three-joint robotic finger.”

The goal was to make something that could stretch, be flexible and a reasonable size, and have the required sensitivity, performance, production cost, and robustness. Unlike an inertial measurement unit—an electronic unit that measures force and movement and is used in most step-based wearable technologies—Najjaran says the sensors need to be sensitive enough to respond to different and complex body motions. That includes infinitesimal movements like a heartbeat or a twitch of a finger, to large muscle movements from walking and running.

School of Engineering Professor and study co-author Mina Hoorfar says their results may help manufacturers create the next level of health monitoring and biomedical devices.

“We have introduced an easy and highly repeatable fabrication method to create a highly sensitive sensor with outstanding mechanical and electrical properties at a very low cost,” says Hoorfar.

To demonstrate its practicality, researchers built three wearable devices including a knee band, a wristband and a glove. The wristband monitored heartbeats by sensing the pulse of the artery. In an entirely different range of motion, the finger and knee bands monitored finger gestures and larger scale muscle movements during walking, running, sitting down and standing up. The results, says Hoorfar, indicate an inexpensive device that has a high-level of sensitivity, selectivity and durability.

Hoorfar and Najjaran are both members of the Okanagan node of UBC’s STITCH (SmarT Innovations for Technology Connected Health) Institute that creates and investigates advanced wearable devices.

The research, partially funded by the Natural Sciences and Engineering Research Council, was recently published in the Journal of Sensors and Actuators A: Physical.

Here’s a link to and a citation for the paper,

Low-cost ultra-stretchable strain sensors for monitoring human motion and bio-signals by Seyed Reza Larimi, Hojatollah Rezaei Nejad, Michael Oyatsi, Allen O’Brien, Mina Hoorfar, Homayoun Najjaran. Sensors and Actuators A: Physical Volume 271, 1 March 2018, Pages 182-191 [Published online February 2018] https://doi.org/10.1016/j.sna.2018.01.028

This paper is behind a paywall.

Final comments

The term ‘wearable tech’ covers a lot of ground. In addition to sensors, there are materials that harvest energy, detect poisons, etc.  making for a diverse field.

Humans can distinguish molecular differences by touch

Yesterday, in my December 18, 2017 post about medieval textiles, I posed the question, “How did medieval artisans create nanoscale and microscale gilding when they couldn’t see it?” I realized afterwards that an answer to that question might be in this December 13, 2017 news item on ScienceDaily,

How sensitive is the human sense of touch? Sensitive enough to feel the difference between surfaces that differ by just a single layer of molecules, a team of researchers at the University of California San Diego has shown.

“This is the greatest tactile sensitivity that has ever been shown in humans,” said Darren Lipomi, a professor of nanoengineering and member of the Center for Wearable Sensors at the UC San Diego Jacobs School of Engineering, who led the interdisciplinary project with V. S. Ramachandran, director of the Center for Brain and Cognition and distinguished professor in the Department of Psychology at UC San Diego.

So perhaps those medieval artisans were able to feel the difference before it could be seen in the textiles they were producing?

Getting back to the matter at hand, a December 13, 2017 University of California at San Diego (UCSD) news release (also on EurekAlert) by Liezel Labios offers more detail about the work,

Humans can easily feel the difference between many everyday surfaces such as glass, metal, wood and plastic. That’s because these surfaces have different textures or draw heat away from the finger at different rates. But UC San Diego researchers wondered, if they kept all these large-scale effects equal and changed only the topmost layer of molecules, could humans still detect the difference using their sense of touch? And if so, how?

Researchers say this fundamental knowledge will be useful for developing electronic skin, prosthetics that can feel, advanced haptic technology for virtual and augmented reality and more.

Unsophisticated haptic technologies exist in the form of rumble packs in video game controllers or smartphones that shake, Lipomi added. “But reproducing realistic tactile sensations is difficult because we don’t yet fully understand the basic ways in which materials interact with the sense of touch.”

“Today’s technologies allow us to see and hear what’s happening, but we can’t feel it,” said Cody Carpenter, a nanoengineering Ph.D. student at UC San Diego and co-first author of the study. “We have state-of-the-art speakers, phones and high-resolution screens that are visually and aurally engaging, but what’s missing is the sense of touch. Adding that ingredient is a driving force behind this work.”

This study is the first to combine materials science and psychophysics to understand how humans perceive touch. “Receptors processing sensations from our skin are phylogenetically the most ancient, but far from being primitive they have had time to evolve extraordinarily subtle strategies for discerning surfaces—whether a lover’s caress or a tickle or the raw tactile feel of metal, wood, paper, etc. This study is one of the first to demonstrate the range of sophistication and exquisite sensitivity of tactile sensations. It paves the way, perhaps, for a whole new approach to tactile psychophysics,” Ramachandran said.

Super-Sensitive Touch

In a paper published in Materials Horizons, UC San Diego researchers tested whether human subjects could distinguish—by dragging or tapping a finger across the surface—between smooth silicon wafers that differed only in their single topmost layer of molecules. One surface was a single oxidized layer made mostly of oxygen atoms. The other was a single Teflon-like layer made of fluorine and carbon atoms. Both surfaces looked identical and felt similar enough that some subjects could not differentiate between them at all.

According to the researchers, human subjects can feel these differences because of a phenomenon known as stick-slip friction, which is the jerking motion that occurs when two objects at rest start to slide against each other. This phenomenon is responsible for the musical notes played by running a wet finger along the rim of a wine glass, the sound of a squeaky door hinge or the noise of a stopping train. In this case, each surface has a different stick-slip frequency due to the identity of the molecules in the topmost layer.

In one test, 15 subjects were tasked with feeling three surfaces and identifying the one surface that differed from the other two. Subjects correctly identified the differences 71 percent of the time.

In another test, subjects were given three different strips of silicon wafer, each strip containing a different sequence of 8 patches of oxidized and Teflon-like surfaces. Each sequence represented an 8-digit string of 0s and 1s, which encoded for a particular letter in the ASCII alphabet. Subjects were asked to “read” these sequences by dragging a finger from one end of the strip to the other and noting which patches in the sequence were the oxidized surfaces and which were the Teflon-like surfaces. In this experiment, 10 out of 11 subjects decoded the bits needed to spell the word “Lab” (with the correct upper and lowercase letters) more than 50 percent of the time. Subjects spent an average of 4.5 minutes to decode each letter.

“A human may be slower than a nanobit per second in terms of reading digital information, but this experiment shows a potentially neat way to do chemical communications using our sense of touch instead of sight,” Lipomi said.

Basic Model of Touch

The researchers also found that these surfaces can be differentiated depending on how fast the finger drags and how much force it applies across the surface. The researchers modeled the touch experiments using a “mock finger,” a finger-like device made of an organic polymer that’s connected by a spring to a force sensor. The mock finger was dragged across the different surfaces using multiple combinations of force and swiping velocity. The researchers plotted the data and found that the surfaces could be distinguished given certain combinations of velocity and force. Meanwhile, other combinations made the surfaces indistinguishable from each other.

“Our results reveal a remarkable human ability to quickly home in on the right combinations of forces and swiping velocities required to feel the difference between these surfaces. They don’t need to reconstruct an entire matrix of data points one by one as we did in our experiments,” Lipomi said.

“It’s also interesting that the mock finger device, which doesn’t have anything resembling the hundreds of nerves in our skin, has just one force sensor and is still able to get the information needed to feel the difference in these surfaces. This tells us it’s not just the mechanoreceptors in the skin, but receptors in the ligaments, knuckles, wrist, elbow and shoulder that could be enabling humans to sense minute differences using touch,” he added.

This work was supported by member companies of the Center for Wearable Sensors at UC San Diego: Samsung, Dexcom, Sabic, Cubic, Qualcomm and Honda.

For those who prefer their news by video,

Here’s a link to and a citation for the paper,

Human ability to discriminate surface chemistry by touch by Cody W. Carpenter, Charles Dhong, Nicholas B. Root, Daniel Rodriquez, Emily E. Abdo, Kyle Skelil, Mohammad A. Alkhadra, Julian Ramírez, Vilayanur S. Ramachandran and Darren J. Lipomi. Mater. Horiz., 2018, Advance Article DOI: 10.1039/C7MH00800G

This paper is open access but you do need to have opened a free account on the website.