How movement affects the way the brain processes sound and sight

A research team at the Institute for Basic Science (IBS) has uncovered a fundamental principle of how the brain prioritizes vision and hearing differently depending on whether we are still or in motion. The study, led by Dr. LEE Seung-Hee, Associate Director of the IBS Center for Synaptic Brain Dysfunctions and Associate Professor at KAIST, provides new insights into how movement alters the brain's sensory decision-making process.

In daily life, we constantly process visual (sight) and auditory (sound) information to navigate the world. For instance, when watching a movie, our brain seamlessly integrates images and sounds to create a complete experience. However, when moving—such as when walking on a busy street—our brain may prioritize visual information over sound.

Until now, it was unclear how the brain decides which sense to prioritize in different situations. This is particularly relevant for individuals with sensory processing disorders such as autism or schizophrenia, where the brain may struggle to integrate sensory information correctly. Understanding how the brain naturally shifts between sensory inputs could lead to better treatments for these conditions.

To investigate this phenomenon, the research team conducted behavioral experiments on mice while tracking real-time brain activity using miniature microscopes and optogenetics (a method that uses light to control neurons). The mice were trained to respond to both visual and auditory cues while running on a treadmill.

The researchers found that when the mice were stationary, their brains relied more on sound to make decisions. However, when they were moving, their brains shifted to prioritize vision.

Further analysis revealed the specific brain circuits responsible for this switch:

- The posterior parietal cortex (PPC), a key region for decision-making, played a central role in prioritizing sensory information. When the PPC was turned off, mice could no longer make decisions based on visual cues and relied more on sound instead.

- The secondary motor cortex (M2) acted as a "sensory gatekeeper." When the mice were moving, M2 sent inhibitory signals to the auditory cortex, blocking auditory signals from reaching the PPC. This effectively made vision the dominant sense during motion.

- Despite this suppression, the auditory cortex continued processing sounds, meaning the brain was adjusting how it integrates sensory information rather than completely ignoring sound.

This study demonstrates that the brain does not treat all sensory inputs equally at all times—instead, it dynamically adjusts depending on movement and environmental needs. When stationary, sound is more useful for detecting nearby events, while vision takes priority during movement because it is more reliable for navigation.

This discovery could have important implications for understanding and treating sensory processing disorders, where the brain may struggle to properly filter and prioritize sensory inputs.

Dr. LEE Seung-Hee, the study’s lead researcher, emphasized the significance of the findings, stating, "Our study reveals how the brain flexibly shifts between vision and hearing based on behavior. This natural adaptability is crucial for survival, and understanding it could help us develop better treatments for individuals with sensory integration difficulties."