Rosy health and sickly green: color associations play robust role in reading faces

NIH study research uncovers specialized networks in the brain for processing face color.

Two versions of the same photo of a woman. On the left, her skin tone is red. On the right, it’s green.

These face images illustrate how color plays a key role in how faces are read. Both images are manipulated away from normal, by about the same units in color (green in one direction, red in the other). Both color directions may be deemed meaningful in terms of indicating blushing or sickness. NEI

Anyone who has ever sensed that a person is sick simply by looking at their face has experienced the wealth of information conveyed by face color. A new study by the National Eye Institute (NEI), part of the National Institutes of Health, provides evidence that the human brain’s visual system is especially sensitive to the color of faces compared to the colors of other objects or things. Study results were published today in Nature Communications.

“The findings underscore the complexity of color perception. Far from operating as a reflex, color perception involves a set of sophisticated brain operations that ultimately assign value and meaning to what we see,” said the study’s lead investigator, Bevil Conway, Ph.D., head of the NEI Unit on Sensation, Cognition, and Action.

The findings also suggest that social communication cues from faces factored into evolutionary selective pressures that gave rise to trichromatic color vision in our ancestors 23 million years ago.

The study grew out of a curiosity observed in Conway’s lab by graduate students Maryam Hasantash and Rosa Lafer-Sousa. They noticed that under a low-pressure sodium (LPS) lamp, which makes everything appear monochromatic, like a black and white movie with a brownish-yellow filter, everyone looked sick.

Investigating the phenomenon in a controlled setting, 20 people were each presented with 35 visual stimuli under an LPS lamp and again under white light. Visual stimuli included objects that have a characteristic color (oranges, strawberries, tomatoes), objects with arbitrary color (Legos, toy cars), and in-person actors representing a diversity of skin colors. After each item or person was presented, each study participant made a color match using a computer monitor to indicate the color of the stimulus they had just viewed.

As expected, under the white light, people matched oranges to orange, strawberries and tomatoes to reds, and faces and hands to some variation of brown or tannish pink.

Under LPS lighting, all stimuli except faces appeared brownish yellow. By contrast, every single participant matched 100 percent of the actors’ faces to greenish hues. Skin on the hand, neck and forehead, visible through cutouts in a mask, appeared brownish yellow, not green, to participants. Photographs of faces under LPS lighting were also matched to greens, but to a lesser extent. Face photographs in which the features had been scrambled were not matched with green at all.

The hypothesis was that study participants’ memory-based assumptions about color — oranges are orange, strawberries are red — would subtly influence color selection under LPS lighting, with arbitrarily colored objects such as Legos serving as the control.

“Surprisingly, we found no clear evidence of the impact of memory on the color appearance of toys, fruit or non-facial body skin. Meanwhile, significant evidence showed a paradoxical impact of memory on face color since under most circumstances, no one expects a face to be green,” Conway said.

What’s more, the perceived greenish hue of faces under LPS light deviates from what might be expected based on the spectrum of the LPS light itself, which gives a yellowish appearance. In other words, the color people were seeing could not be attributed to the light hitting the eye, but to unconscious inferences about the proper color of faces.

One theory is that in the context of in-person actors’ faces, the LPS lighting created a kind of optical illusion. The eeriness of the lamp’s glow triggered an error signal in the visual system. The theory follows that the illusion occurred because our brains are wired to try to understand what we see by factoring context into our perception. In the context of faces under LPS light, things looked so strange, the brain conjured up an explanation: the actor must be sick, according to the researchers.

“The specificity of this error signal to faces tells us that the brain has special wiring for face color,” Conway said.

Taken together, the findings suggest that human assessment of face color is an essential operation that is inherent in the human visual system. Moreover, the face-color memory effects uncovered in the study appear to be encoded by the L and M cones, the photoreceptors that make trichromatic color vision possible.

Prior work suggests that face processing and color processing are handled by largely separate brain circuits. The present study makes the surprising prediction that face processing and color processing engage some similar brain mechanisms, which provides key information about the high-level operations deep in the cerebral cortex that determine how vision works.

The study was funded by the NEI Intramural Research Program.

This press release describes a basic research finding. Basic research increases our understanding of human behavior and biology, which is foundational to advancing new and better ways to prevent, diagnose, and treat disease. Science is an unpredictable and incremental process— each research advance builds on past discoveries, often in unexpected ways. Most clinical advances would not be possible without the knowledge of fundamental basic research.

NEI leads the federal government’s research on the visual system and eye diseases. NEI supports basic and clinical science programs to develop sight-saving treatments and address special needs of people with vision loss. For more information, visit https://www.nei.nih.gov.

About the National Institutes of Health (NIH): NIH, the nation's medical research agency, includes 27 Institutes and Centers and is a component of the U.S. Department of Health and Human Services. NIH is the primary federal agency conducting and supporting basic, clinical, and translational medical research, and is investigating the causes, treatments, and cures for both common and rare diseases. For more information about NIH and its programs, visit www.nih.gov.

NIH…Turning Discovery Into Health®

Reference

Hasantash M, Lafer-Sousa R, Afraz A, Conway BR. Paradoxical impact of memory on color appearance of faces. July 8, 2019. Nature Communications DOI: 10.1038/s41467-019-10073-8