Human languages vary widely in the combination and balance of phonetic cues used to encode speech sounds, a source of non-native accents in second language learners. It has been hypothesized that repeated exposure to an accent leads to adaptive perceptual changes in native listeners through multidimensional distributional learning. Although this hypothesis is highly influential, it has rarely been tested against the complexity of naturally produced accented speech, and for a period longer than a single-session experiment. The current large-scale (N = 338), five-session experiment goes beyond this status-quo to examine the adaptation of native American English listeners to naturally produced Mandarin-accented English. A repeated exposure-test design was used to characterize adaptive changes in perception from the first few minutes to over the course of three weeks. The results reveal that behavioral changes can be predicted by listeners’ sensitivity to changes in phonetic cue distributions. Possible joint contributions of early-stage auditory normalization and later-stage decision processes are discussed.