Tag Archives: psychophysics

Worried your ‘priceless’ art could be ruined? Genomics could be the answer

First, there was the story about art masterpieces turning into soap (my June 22, 2017 posting) and now, it seems that microbes may also constitute a problem. Before getting to the latest research, here’s are some images the researchers are using to illustrate their work,

Caption: Leonardo da Vinci noted that the fore and hind wings of a dragonfly are out of phase — verified centuries later by slow motion photography. Thaler suggests further study to compare individuals and species with high “flicker fusion frequency” ability. Credit: PXFuel

I’m not sure what that has to do with anything but I do love dragonflies. This next image seems more relevant to the research,

Caption: Photo summary of the various artworks sampled for the study “”Characterizing microbial signatures on sculptures and paintings of similar provenance.” Circles indicate swabbed areas on each sample artwork Credit: JCVI

It turns out, the researchers are releasing two pieces of research in the same press release, neither having much to do with the other. They (art conservation rresearch, first and, then, research into vision [hence the dragonfly] and da Vinci’s eyes) are both described in a June 18, 2020 J. Craig Venter Institute (JCVI)-Leonardo Da Vinci DNA Project press release (also on EurekAlert),

A new study of the microbial settlers on old paintings, sculptures, and other forms of art charts a potential path for preserving, restoring, and confirming the geographic origin of some of humanity’s greatest treasures.

Genetics scientists with the J. Craig Venter Institute (JCVI), collaborating with the Leonardo da Vinci DNA Project and supported by the Richard Lounsbery Foundation, say identifying and managing communities of microbes on art may offer museums and collectors a new way to stem the deterioration of priceless possessions, and to unmask counterfeits in the $60 billion a year art market.

Manolito G. Torralba, Claire Kuelbs, Kelvin Jens Moncera, and Karen E. Nelson of the JCVI, La Jolla, California, and Rhonda Roby of the Alameda California County Sheriff’s Office Crime Laboratory, used small, dry polyester swabs to gently collect microbes from centuries-old, Renaissance-style art in a private collector’s home in Florence, Italy. Their findings are published in the journal Microbial Ecology .

The genetic detectives caution that additional time and research are needed to formally convict microbes as a culprit in artwork decay but consider their most interesting find to be “oxidase positive” microbes primarily on painted wood and canvas surfaces.

These species can dine on organic and inorganic compounds often found in paints, in glue, and in the cellulose in paper, canvas, and wood. Using oxygen for energy production, they can produce water or hydrogen peroxide, a chemical used in disinfectants and bleaches.

“Such byproducts are likely to influence the presence of mold and the overall rate of deterioration,” the paper says.

“Though prior studies have attempted to characterize the microbial composition associated with artwork decay, our results summarize the first large scale genomics-based study to understand the microbial communities associated with aging artwork.”

The study builds on an earlier one in which the authors compared hairs collected from people in the Washington D.C., and San Diego, CA. areas, finding that microbial signatures and patterns are geographically distinguishable.

In the art world context, studying microbes clinging to the surface of a work of art may help confirm its geographic origin and authenticity or identify counterfeits.

Lead author Manolito G. Torralba notes that, as art’s value continues to climb, preservation is increasingly important to museums and collectors alike, and typically involves mostly the monitoring and adjusting of lighting, heat, and moisture.

Adding genomics science to these efforts offers advantages of “immense potential.”

The study says microbial populations “were easily discernible between the different types of substrates sampled,” with those on stone and marble art more diverse than wood and canvas. This is “likely due to the porous nature of stone and marble harboring additional organisms and potentially moisture and nutrients, along with the likelihood of biofilm formation.”

As well, microbial diversity on paintings is likely lower because few organisms can metabolize the meagre nutrients offered by oil-based paint.

“Though our sample size is low, the novelty of our study has provided the art and scientific communities with evidence that microbial signatures are capable of differentiating artwork according to their substrate,” the paper says.

“Future studies would benefit from working with samples whose authorship, ownership, and care are well-documented, although documentation about care of works of art (e.g., whether and how they were cleaned) seems rare before the mid-twentieth century.”

“Of particular interest would be the presence and activity of oil-degrading enzymes. Such approaches will lead to fully understanding which organism(s) are responsible for the rapid decay of artwork while potentially using this information to target these organisms to prevent degradation.”

“Focusing on reducing the abundance of such destructive organisms has great potential in preserving and restoring important pieces of human history.”

Biology in Art

The paper was supported by the US-based Richard Lounsbery Foundation as part of its “biology in art” research theme, which has also included seed funding efforts to obtain and sequence the genome of Leonardo da Vinci.

The Leonardo da Vinci DNA Project involves scientists in France (where Leonardo lived during his final years and was buried), Italy (where his father and other relatives were buried, and descendants of his half-brothers still live), Spain (whose National Library holds 700 pages of his notebooks), and the US (where forensic DNA skills flourish).

The Leonardo project has convened molecular biologists, population geneticists, microbiologists, forensic experts, and physicians working together with other natural scientists and with genealogists, historians, artists, and curators to discover and decode previously inaccessible knowledge and to preserve cultural heritage.  

Related news release: Leonardo da Vinci’s DNA: Experts unite to shine modern light on a Renaissance master http://bit.ly/2FG4jJu

Measuring Leonardo da Vinci’s “quick eye” 500 years later.

Could he have played major-league baseball?

Famous art historians and biographers such as Sir Kenneth Clark and Walter Isaacson have written about Leonardo da Vinci’s “quick eye” because of the way he accurately captured fleeting expressions, wings during bird flight, and patterns in swirling water. But until now no one had tried to put a number on this aspect of Leonardo’s extraordinary visual acuity.

David S. Thaler of the University of Basel, and a guest investigator in the Program for the Human Environment at The Rockefeller University, does, allowing comparison of Leonardo with modern measures. Leonardo fares quite well.

Thaler’s estimate hinges on Leonardo’s observation that the fore and hind wings of a dragonfly are out of phase — not verified until centuries later by slow motion photography (see e.g. https://youtu.be/Lw2dfjYENNE?t=44).

To quote Isaacson’s translation of Leonardo’s notebook: “The dragonfly flies with four wings, and when those in front are raised those behind are lowered.”

Thaler challenged himself and friends to try seeing if that’s true, but they all saw only blurs.

High-speed camera studies by others show the fore and hind wingbeats of dragonflies vary by 20 to 10 milliseconds — one fiftieth to one hundredth of a second — beyond average human perception.

Thaler notes that “flicker fusion frequency” (FFF) — akin to a motion picture’s frames per second — is used to quantify and measure “temporal acuity” in human vision.

When frames per second exceed the number of frames the viewer can perceive individually, the brain constructs the illusion of continuous movement. The average person’s FFF is between 20 to 40 frames per second; current motion pictures present 48 or 72 frames per second.

To accurately see the angle between dragonfly wings would require temporal acuity in the range of 50 to 100 frames per second.

Thaler believes genetics will account for variations in FFF among different species, which range from a low of 12 in some nocturnal insects to over 300 in Fire Beetles. We simply do not know what accounts for human variation. Training and genetics may both play important roles.

“Perhaps the clearest contemporary case for a fast flicker fusion frequency in humans is in American baseball, because it is said that elite batters can see the seams on a pitched baseball,” even when rotating 30 to 50 times per second with two or four seams facing the batter. A batter would need Leonardo-esque FFF to spot the seams on most inbound baseballs.  

Thaler suggests further study to compare the genome of individuals and species with unusually high FFF, including, if possible, Leonardo’s DNA.  

Flicker fusion for focus, attention, and affection   

In a companion paper, Thaler describes how Leonardo used psychophysics that would only be understood centuries later — and about which a lot remains to be learned today — to communicate deep beauty and emotion. 

Leonardo was master of a technique known as sfumato (the word derived from the Italian sfumare, “to tone down” or “to evaporate like smoke”), which describes a subtle blur of edges and blending of colors without sharp focus or distinct lines.

Leonardo expert Martin Kemp has noted that Leonardo’s sfumato sometimes involves a distance dependence which is akin to the focal plane of a camera. Yet, at other times, features at the same distance have selective sfumato so simple plane of focus is not the whole answer.

Thaler suggests that Leonardo achieved selective soft focus in portraits by painting in overcast or evening light, where the eyes’ pupils enlarge to let in more light but have a narrow plane of sharp focus. 

To quote Leonardo’s notebook, under the heading “Selecting the light which gives most grace to faces”: “In the evening and when the weather is dull, what softness and delicacy you may perceive in the faces of men and women.”  In dim light pupils enlarge to let in more light but their depth of field decreases.  

By measuring the size of the portrait’s pupils, Thaler inferred Leonardo’s depth of focus. He says Leonardo likely sensed this effect, perhaps unconsciously in the realm of his artistic sensibility. The pupil / aperture effect on depth of focus wasn’t explained until the mid-1800s, centuries after Leonardo’s birth in Vinci, Italy in 1452.

What about selective focus at equal distance? In this case Leonardo may have taken advantage of the fovea, the small area on the back of the eye where detail is sharpest.

Most of us move our eyes around and because of our slower flicker fusion frequency we construct a single 3D image of the world by jamming together many partially in-focus images. Leonardo realized and “froze” separate snapshots with which we construct ordinary perception.

Says Thaler: “We study Leonardo not only to learn about him but to learn about ourselves and further human potential.”

Thaler’s papers (at https://bit.ly/2WZ2cwo and https://bit.ly/2ZBj7Hi) evolved from talks at meetings of the Leonardo da Vinci DNA Project in Italy (2018), Spain and France (2019).

They form part of a collection of papers presented at a recent colloquium in Amboise, France, now being readied for publication in a book: Actes du Colloque International d’Amboise: Leonardo de Vinci, Anatomiste. Pionnier de l’Anatomie comparée, de la Biomécanique, de la Bionique et de la Physiognomonie. Edited by Henry de Lumley, President, Institute of Human Paleontology, Paris, and originally planned for release in late spring, 2020, publication was delayed by the global virus pandemic but should be available at CNRS Editions in the second half of the summer.

Other papers in the collection cover a range of topics, including how Leonardo used his knowledge of anatomy, gained by performing autopsies on dozens of cadavers, to achieve Mona Lisa’s enigmatic smile.

Leonardo also used it to exact revenge on academics and scientists who ridiculed him for lacking a classical education, sketching them with absurdly deformed faces to resemble birds, dogs, or goats. 

De Lumley earlier co-authored a 72-page monograph for the Leonardo DNA Project: “Leonardo da Vinci: Pioneer of comparative anatomy, biomechanics and physiognomy.”.

Here’s a link to and a citation for the paper featuring microbes and art masterpiece,

Characterizing Microbial Signatures on Sculptures and Paintings of Similar Provenance by Manolito G. Torralba, Claire Kuelbs, Kelvin Jens Moncera, Rhonda Roby & Karen E. Nelson. Microbial Ecology (2020) DOI: https://doi.org/10.1007/s00248-020-01504-x Published: 21 May 2020

This paper is open access.

Humans can distinguish molecular differences by touch

Yesterday, in my December 18, 2017 post about medieval textiles, I posed the question, “How did medieval artisans create nanoscale and microscale gilding when they couldn’t see it?” I realized afterwards that an answer to that question might be in this December 13, 2017 news item on ScienceDaily,

How sensitive is the human sense of touch? Sensitive enough to feel the difference between surfaces that differ by just a single layer of molecules, a team of researchers at the University of California San Diego has shown.

“This is the greatest tactile sensitivity that has ever been shown in humans,” said Darren Lipomi, a professor of nanoengineering and member of the Center for Wearable Sensors at the UC San Diego Jacobs School of Engineering, who led the interdisciplinary project with V. S. Ramachandran, director of the Center for Brain and Cognition and distinguished professor in the Department of Psychology at UC San Diego.

So perhaps those medieval artisans were able to feel the difference before it could be seen in the textiles they were producing?

Getting back to the matter at hand, a December 13, 2017 University of California at San Diego (UCSD) news release (also on EurekAlert) by Liezel Labios offers more detail about the work,

Humans can easily feel the difference between many everyday surfaces such as glass, metal, wood and plastic. That’s because these surfaces have different textures or draw heat away from the finger at different rates. But UC San Diego researchers wondered, if they kept all these large-scale effects equal and changed only the topmost layer of molecules, could humans still detect the difference using their sense of touch? And if so, how?

Researchers say this fundamental knowledge will be useful for developing electronic skin, prosthetics that can feel, advanced haptic technology for virtual and augmented reality and more.

Unsophisticated haptic technologies exist in the form of rumble packs in video game controllers or smartphones that shake, Lipomi added. “But reproducing realistic tactile sensations is difficult because we don’t yet fully understand the basic ways in which materials interact with the sense of touch.”

“Today’s technologies allow us to see and hear what’s happening, but we can’t feel it,” said Cody Carpenter, a nanoengineering Ph.D. student at UC San Diego and co-first author of the study. “We have state-of-the-art speakers, phones and high-resolution screens that are visually and aurally engaging, but what’s missing is the sense of touch. Adding that ingredient is a driving force behind this work.”

This study is the first to combine materials science and psychophysics to understand how humans perceive touch. “Receptors processing sensations from our skin are phylogenetically the most ancient, but far from being primitive they have had time to evolve extraordinarily subtle strategies for discerning surfaces—whether a lover’s caress or a tickle or the raw tactile feel of metal, wood, paper, etc. This study is one of the first to demonstrate the range of sophistication and exquisite sensitivity of tactile sensations. It paves the way, perhaps, for a whole new approach to tactile psychophysics,” Ramachandran said.

Super-Sensitive Touch

In a paper published in Materials Horizons, UC San Diego researchers tested whether human subjects could distinguish—by dragging or tapping a finger across the surface—between smooth silicon wafers that differed only in their single topmost layer of molecules. One surface was a single oxidized layer made mostly of oxygen atoms. The other was a single Teflon-like layer made of fluorine and carbon atoms. Both surfaces looked identical and felt similar enough that some subjects could not differentiate between them at all.

According to the researchers, human subjects can feel these differences because of a phenomenon known as stick-slip friction, which is the jerking motion that occurs when two objects at rest start to slide against each other. This phenomenon is responsible for the musical notes played by running a wet finger along the rim of a wine glass, the sound of a squeaky door hinge or the noise of a stopping train. In this case, each surface has a different stick-slip frequency due to the identity of the molecules in the topmost layer.

In one test, 15 subjects were tasked with feeling three surfaces and identifying the one surface that differed from the other two. Subjects correctly identified the differences 71 percent of the time.

In another test, subjects were given three different strips of silicon wafer, each strip containing a different sequence of 8 patches of oxidized and Teflon-like surfaces. Each sequence represented an 8-digit string of 0s and 1s, which encoded for a particular letter in the ASCII alphabet. Subjects were asked to “read” these sequences by dragging a finger from one end of the strip to the other and noting which patches in the sequence were the oxidized surfaces and which were the Teflon-like surfaces. In this experiment, 10 out of 11 subjects decoded the bits needed to spell the word “Lab” (with the correct upper and lowercase letters) more than 50 percent of the time. Subjects spent an average of 4.5 minutes to decode each letter.

“A human may be slower than a nanobit per second in terms of reading digital information, but this experiment shows a potentially neat way to do chemical communications using our sense of touch instead of sight,” Lipomi said.

Basic Model of Touch

The researchers also found that these surfaces can be differentiated depending on how fast the finger drags and how much force it applies across the surface. The researchers modeled the touch experiments using a “mock finger,” a finger-like device made of an organic polymer that’s connected by a spring to a force sensor. The mock finger was dragged across the different surfaces using multiple combinations of force and swiping velocity. The researchers plotted the data and found that the surfaces could be distinguished given certain combinations of velocity and force. Meanwhile, other combinations made the surfaces indistinguishable from each other.

“Our results reveal a remarkable human ability to quickly home in on the right combinations of forces and swiping velocities required to feel the difference between these surfaces. They don’t need to reconstruct an entire matrix of data points one by one as we did in our experiments,” Lipomi said.

“It’s also interesting that the mock finger device, which doesn’t have anything resembling the hundreds of nerves in our skin, has just one force sensor and is still able to get the information needed to feel the difference in these surfaces. This tells us it’s not just the mechanoreceptors in the skin, but receptors in the ligaments, knuckles, wrist, elbow and shoulder that could be enabling humans to sense minute differences using touch,” he added.

This work was supported by member companies of the Center for Wearable Sensors at UC San Diego: Samsung, Dexcom, Sabic, Cubic, Qualcomm and Honda.

For those who prefer their news by video,

Here’s a link to and a citation for the paper,

Human ability to discriminate surface chemistry by touch by Cody W. Carpenter, Charles Dhong, Nicholas B. Root, Daniel Rodriquez, Emily E. Abdo, Kyle Skelil, Mohammad A. Alkhadra, Julian Ramírez, Vilayanur S. Ramachandran and Darren J. Lipomi. Mater. Horiz., 2018, Advance Article DOI: 10.1039/C7MH00800G

This paper is open access but you do need to have opened a free account on the website.