Previous neuroimaging studies identified the fusiform face area (FFA) in the ventral visual cortex as a region specialized in the visual processing of faces. Here, we tested whether the FFA was recruited during face perception using a prosthesis substituting vision by audition (PSVA). Using functional magnetic resonance imaging in blindfolded volunteers, we compared the brain activation patterns during the recognition of faces, man-made objects and meaningless images with the PSVA. Face-related activation foci were found in occipito-temporal brain areas, including the fusiform gyrus in and around the FFA. The object recognition task activated a larger occipito-temporal network including the same coordinates as face, whereas meaningless images did not recruit any visual brain area. We conclude that perception provided by sensory substitution involves the same brain structures as direct vision, indicating a specific functional organization of these brain areas to allow perception of faces or man-made objects independently of the sensory modality.