Live from the brain: Visual cues inform decision to cooperate

HOUSTON – (Feb. 14, 2024) – Eye contact and body language are critical in social interaction, but exactly how the brain uses this information in order to inform behavior in real time is not well understood.

By combining behavioral and wireless eye tracking and neural monitoring, a team of Rice University scientists and collaborators studied how pairs of freely moving macaques interacting in a naturalistic setting use visual cues to guide complex, goal-oriented cooperative behavior. The study published in Nature offers first evidence that the part of the brain that processes visual information ⎯ the visual cortex ⎯ plays an active role in social behavior by providing an executive area ⎯ the prefrontal cortex ⎯ with the signals necessary to generate the decision to cooperate.

“We are the first to use telemetric devices to record neural activity from multiple cortical populations in the visual and prefrontal cortex while animals explore their environment and interact with one another,” said Valentin Dragoi, a professor of electrical and computer engineering at Rice and the Rosemary and Daniel J. Harrison III Presidential Distinguished Chair in Neuroprosthetics at Houston Methodist. “When primates, including humans, interact, we make eye contact and use body language to indicate to conspecifics what we want to do.

“Until now, we didn’t know how what we are looking at guides our decision to cooperate or not, because of our inability to measure oculomotor events and correlate them with what neurons are doing in that instant. Because the technology was not there, that knowledge was just unattainable.”

Most of what neuroscience has learned about the neural underpinnings of cognition originated from studies in which animals were restrained and performing a task in isolation in response to artificial stimuli on a computer screen rather than during actual interaction with peers in a more naturalistic environment. The ability to track neural activity as animals move and behave freely represents a significant step forward in neuroscience research and promises to shed new light on the inner workings of the brain.

“This has been the golden dream of neuroscientists for a long time ⎯ to record from neurons on the fly while the animal is free-moving,” said Dragoi, who also serves as scientific director of the Center for Neural Systems Restoration, a joint Houston Methodist-Rice venture dedicated to neuroscience research and treatment innovation. “We tracked populations of neurons in the visual cortex ⎯ the part of the brain that extracts information about vision ⎯ and the prefrontal cortex ⎯ an executive area that encodes our decision to carry out certain actions.”

In the experiment, two pairs of macaques were observed over the course of several weeks as they learned to work together for food reward. Each trial had the monkeys moving freely about an enclosure, separated by a clear divider. The monkeys had previously learned that pressing a button causes a snack tray to come within reach, but during trials, this only happened if the animals pressed the button simultaneously. As the macaques’ cooperation skills improved, the frequency with which they scoped out socially relevant cues ⎯ their partner, the snack tray ⎯ was found to increase prior to their acting in concert.

“This technology allows us to differentiate between active and passive vision,” Dragoi said. “Active vision is when we act on a stimulus we’re looking at with a purpose in mind. When I’m engaged in social interaction, I’m acting in some way, extracting visual information and using that information to cooperate. Our main finding is getting to see how sensory neuron populations extract information, transmit it to an executive area and how they synchronize in real time to underlie the decision to cooperate.”

Both Dragoi and Behnaam Aazhang, Rice’s J.S. Abercrombie Professor of Electrical and Computer Engineering, emphasized the critical contributions of Melissa Franch, lead author on the study, a former Ph.D. student in Dragoi’s lab and now a postdoctoral researcher at Baylor College of Medicine, and Sudha Yellapantula, a Rice doctoral alumna of Aazhang’s group who is now working as a research professional in the health care industry.

“They deserve a lot of credit,” said Aazhang, who also serves as director of the Rice Neuroengineering Initiative and co-director of the Center for Neural Systems Restoration.

“This work is very interdisciplinary and involves a complex experimental design intended to test the hypothesis that the visual frontal cortex has an important role in social behavior,” Aazhang added. “Many animals are not very social, but primates are, which was an important factor in the research, given the nature of the hypothesis.”

It turns out that expressions like “staring daggers” and “seeing eye-to-eye” are more than just a quirk of the English language: We now have evidence that the visual cortex and the prefrontal cortex work in concert to achieve complex behaviors like cooperation.

The research was supported by the National Institutes of Health (U01NS108680, 1F31MH125451).

-30-

This release can be found online at news.rice.edu.

Follow Rice News and Media Relations via Twitter @RiceUNews.

Peer-reviewed paper:

Visuo-frontal interactions during social learning in freely moving macaques | Nature | DOI: 10.1038/s41586-024-07084-x

Authors: Melissa Franch, Sudha Yellapantula, Arun Parajuli, Natasha Kharas, Anthony Wright, Behnaam Aazhang and Valentin Dragoi

https://www.nature.com/articles/s41586-024-07084-x

Image downloads:

https://news-network.rice.edu/news/files/2024/02/Nature_illustration_Pickering_02132024-4b99b14514553ed5.jpg
(Illustration by Alese Pickering/Rice University)

https://news-network.rice.edu/news/files/2024/02/240208_Dragoi_Fitlow_001-0370784cf7eb3145.jpg
CAPTION: Valentin Dragoi is a professor of electrical and computer engineering at Rice, the Rosemary and Daniel J. Harrison III Presidential Distinguished Chair in Neuroprosthetics at Houston Methodist and scientific director of the Center for Neural Systems Restoration. (Photo by Jeff Fitlow/Rice University)

https://news-network.rice.edu/news/files/2024/02/Nature_02132024_Dragoi-1911706095da6a99.jpg
CAPTION: Temporal responses of simultaneously recorded neurons in visual cortex during the perception of natural images. (Image courtesy of Valentin Dragoi/Rice University)

https://news-network.rice.edu/news/files/2024/02/190507_Behnaam_Aazhang-0016-dbd4b79b6e3de208.jpg
CAPTION: Behnaam Aazhang is Rice’s J.S. Abercrombie Professor of Electrical and Computer Engineering, director of the Rice Neuroengineering Initiative and co-director of the Center for Neural Systems Restoration. (Photo by Jeff Fitlow/Rice University)

Related stories:

Houston Methodist, Rice launch Center for Neural Systems Restoration:
https://news.rice.edu/news/2024/houston-methodist-rice-launch-center-neural-systems-restoration

Links:

Center for Neural Systems Restoration: https://centerforneuralprosthetics.org/

Rice Neuroengineering Initiative: https://neuroengineering.rice.edu/

Bioscience Research Collaborative: https://brc.rice.edu/

George R. Brown School of Engineering: https://engineering.rice.edu/

About Rice:

Located on a 300-acre forested campus in Houston, Rice University is consistently ranked among the nation’s top 20 universities by U.S. News & World Report. Rice has highly respected schools of architecture, business, continuing studies, engineering, humanities, music, natural sciences and social sciences and is home to the Baker Institute for Public Policy. With 4,574 undergraduates and 3,982 graduate students, Rice’s undergraduate student-to-faculty ratio is just under 6-to-1. Its residential college system builds close-knit communities and lifelong friendships, just one reason why Rice is ranked No. 1 for lots of race/class interaction, No. 2 for best-run colleges and No. 12 for quality of life by the Princeton Review. Rice is also rated as a best value among private universities by Kiplinger’s Personal Finance.