PUBLIC / RESEARCH STORY · SOCIAL IDENTITY

How does your brain know who someone is?

How the hippocampus connects faces, voices, and social relationships.

Wild common marmoset

The question

Imagine recognizing someone you know across a room. You can recognize them by their face. You can recognize them by their voice when you can’t see them. But your brain doesn’t normally treat those as two unrelated pieces of information. They are both the same person.

How does the brain transform completely different sensory signals—a face and a voice—into an abstract representation of who someone is?

How we did it

We recorded individual neurons from the hippocampus while marmosets saw photographs and heard calls from familiar animals in their social environment. Sometimes they saw only a face, sometimes heard only a voice, and sometimes saw a face while simultaneously hearing either the matching or a different individual’s voice.

What we found

We discovered neurons in the marmoset hippocampus that represent the identity of other individuals across different senses. Some neurons responded selectively to a particular marmoset whether the animal saw that individual’s face or heard its voice. This means that the neurons were not simply responding to a particular image or sound. Instead, they carried information about the identity of the individual producing those sensory signals.

We also found that other hippocampal neurons were sensitive to whether a face and voice belonged to the same individual. At the level of larger neural populations, patterns of activity allowed us to identify which marmoset was being represented, even when the sensory information changed from visual to auditory. These population responses contained additional information about social relationships, including whether individuals belonged to the same family group.

Together, these findings suggest that the hippocampus helps construct representations of other individuals that extend beyond their immediate sensory features. Rather than storing faces and voices as unrelated pieces of information, the hippocampus can integrate them into a representation of a familiar individual and that individual’s place within a social network. This provides a neural mechanism through which the brain can recognize others across different situations and sensory experiences.

The hippocampus doesn’t simply remember what someone looks like or sounds like. It can represent who they are.

Why it matters

The ability to connect a face, a voice, and past experience to the same person is fundamental to memory and social life. These functions depend on medial temporal-lobe systems that are among the earliest and most severely affected in disorders such as Alzheimer’s disease and other forms of dementia, where recognizing people and maintaining knowledge about relationships can progressively deteriorate.

By identifying how the primate brain links different sensory cues to a common representation of identity, this work provides a mechanistic framework for asking how disease disrupts the representations that allow us to know who someone is. That could ultimately help connect changes measured in neural circuits to clinically meaningful losses of memory, recognition, and social knowledge.

Explore the science