Prolonged exposure to a stimulus results in a subsequent perceptual bias. This perceptual adaptation aftereffect occurs not only for simple stimulus features but also for high-level stimulus properties (e.g., faces’ gender, identity and emotional expressions). Recent studies on aftereffects demonstrate that adaptation to human bodies can modulate face perception because these stimuli share common properties. Those findings suggest that the aftereffect is not related to the physical property of the stimulus but to the great number of semantic attributes shared by the adapter and the test. Here, we report a novel cross-category adaptation paradigm with both silhouette face profiles (Experiment 1.1) and frontal view faces (Experiment 2) as adapters, testing the aftereffects when viewing an androgynous test body. The results indicate that adaptation to both silhouette face profiles and frontal view faces produces gender aftereffects (e.g., after visual exposure to a female face, the androgynous body appears as more male and vice versa). These findings confirm that high-level perceptual aftereffects can occur between cross-categorical stimuli that share common properties.