News Release

Investigating human interaction: When we are in sync

For the first time, a research group from the University of Trento in collaboration with Singapore has combined artificial intelligence techniques and neuroimaging measurements on two people simultaneously. The results of their work were the subject of a

Peer-Reviewed Publication

Università di Trento

Bringing research from the lab to the home, from a controlled environment to real life. A way to understand human interaction. With the continuous evolution of technology, its potential grows, driving both scientific exploration and real-world applications. In this sense, the authors of this study have made a step forward to understand what happens at the brain level when two people come into contact and interact with each other, such as during a conversation, when giving each other a gift, or in other situations of cooperation.
The methodology and results are described in an article, "Emotional Content and Semantic Structure of Dialogues are associated with Interpersonal Neural Synchrony in the Prefrontal Cortex", which has recently been published in the scientific journal NeuroImage.
The paper was authored by Alessandro Carollo and Gianluca Esposito (corresponding authors), Massimo Stella and Andrea Bizzego of the University of Trento (Department of Psychology and Cognitive Science) as part of an international collaboration with Mengyu Lim of the Nanyang Technological University of Singapore.
Their work has shed new light on the association between the way in which people communicate, in terms of emotions and language, and their brain activity.
"For the first time, we have combined AI techniques to neuroimaging measurements obtained on two people at the same time. We have worked in a laboratory setting, but we tried to create less controlled situations than usual, so that each participating couple was free to invent a dialogue as well as to imagine giving each other a gift and being surprised to receive it," says Alessandro Carollo, first author of the study.
The research, which was conducted in the laboratories of the Department of Psychology and Cognitive Science of the University of Trento in Rovereto, involved 42 pairs of participants (84 individuals), aged between 18 and 35 years old.
"We combined artificial intelligence techniques with the most advanced brain imaging technology to study how emotions and the structure of language influence brain activity in interactions. This study reveals that, when two people interact, their brain activity is synchronized, especially in the prefrontal cortex. Emotional content and the structure of language are connected to this neural synchrony," explains Gianluca Esposito.
The dialogues were transcribed by hand, then artificial intelligence techniques were used to encode the transcriptions and obtain emotional and syntactic/semantic indexes of the conversations.
For neuroimaging measurements, functional near-infrared spectroscopy (fNIRS) was used.
This technique is similar to an electroencephalogram, but is less invasive than magnetic resonance imaging and other methods, and is capable of recording the dynamics of hemoglobin, the molecule that carries oxygen in the blood, in different brain areas. With a light source, which emits beams of photons, and a photodetector placed on a helmet, the amount of light absorbed by hemoglobin is measured and brain activity is thus evaluated.
Alessandro Carollo explains: "It is an easy-to-carry and lightweight technique: it only takes a small box with a pair of caps and their cables. Then you plug it into a laptop computer and that is all you need to study human interactions."
He continues: "The goal is to bring research from the lab to the home, from the controlled environment to real life, where people are free to talk to each other and interact."
The contribution of the research team is promising.
Gianluca Esposito states: "The best approach seems to be the transdisciplinary one, which integrates emotional content and semantic/syntactic information. The results obtained on neuronal synchronization have a number of interesting implications. The study shows that emotions and language structure influence our conversations and the neural processes that then guide how we interact with each other. This opens up new avenues for research into human interactions. We think of interactions between parent and child, between partners, friends, or simply two strangers who find themselves interacting by chance."

About the article
"Emotional Content and Semantic Structure of Dialogues are associated with Interpersonal Neural Synchrony in the Prefrontal Cortex" (DOI https://doi.org/10.1016/j.neuroimage.2025.121087) has been published by the open access scientific journal NeuroImage.
The corresponding authors are Alessandro Carollo (who is also the first author) and Gianluca Esposito. The other authors are Massimo Stella and Andrea Bizzego, of UniTrento, and Mengyu Lim of the Nanyang Technological University of Singapore.


Disclaimer: AAAS and EurekAlert! are not responsible for the accuracy of news releases posted to EurekAlert! by contributing institutions or for the use of any information through the EurekAlert system.