Individuals with autism spectrum disorder (ASD) suffer from hyperesthesia/hypoesthesia as well as difficulties in social interaction. To understand the underlying mechanism for atypical perception and its influence on social decits, we computationally analyzed the process of how atypical perception is elicited in social contexts. Our experiment employed visual and audio processing techniques to let ASD participants reproduce their experiences, and thus enabled us to objectively and quantitatively evaluate them. Our experimental results revealed several common patterns in their perception: high contrast and intensity associated with brightness, no color and blurring caused by movement, and so on. Potential physiological and neural causes for these symptoms are discussed to understand the underlying mechanism. Moreover, we developed a head-mounted display system reproducing ASD’s visual world based on our findings. Our system enables researchers to investigate the impact of atypical perception on social abilities.