Contextual signals in visual cortex:How sounds, state, and task setting shape how we see

Abstract

What we see is not always what we get. Even though the light that hits the retina might convey the same images, how visual information is processed and what we eventually do with it depend on many contextual factors. In this thesis, we show in a series of experiments how the sensory processing of the same visual input in the visual cortex of mice is affected by our internal state, movements, other senses and any task we are performing. We found that recurrent activity originating within higher visual areas modulates activity in the primary visual cortex (V1) and selectivity amplifies weak compared to strong sensory-evoked responses. Second, visual stimuli evoked similar early activity in V1, but later activity strongly depended on whether mice were trained to report the visual stimuli, and on the specific task. Specifically, adding a second modality to the task demands extended the temporal window during which V1 was causally involved in visual perception. Third, we report that not only visual stimuli but also sounds led to strong responses in V1, composed of distinct auditory-related and motor-related activity. Finally, we studied the role of Posterior Parietal Cortex in an audiovisual change detection task. Despite extensive single-neuron and population-level encoding of task-relevant visual and auditory stimuli, as well as upcoming behavioral responses, optogenetic inactivation did not affect task performance. Whereas these contextual factors have previously been studied in isolation, we obtain a more integrated understanding of how factors beyond visual information determine what we actually see