The neural substrate underlying cognitive impairments after chemotherapy is largely unknown. Here, we investigated very late (>9 years) effects of adjuvant high-dose chemotherapy on brain white and gray matter in primary breast cancer survivors (n = 17) with multimodal magnetic resonance imaging (MRI). A group of breast cancer survivors who did not receive chemotherapy was scanned for comparison (n = 15). Neuropsychological tests demonstrated cognitive impairments in the chemotherapy group. Diffusion tensor imaging (DTI) with tract-based spatial statistics showed that chemotherapy was associated with focal changes in DTI values indicative for reduced white matter integrity. Single voxel proton MR spectroscopy (1H-MRS) in the left centrum semiovale (white matter) showed a reduction of N-acetylasparate/creatine indicative of axonal injury. Voxel-based morphometry demonstrated a reduction of gray matter volume that overlapped with fMRI hypoactivation (as reported in a previous publication) in posterior parietal areas and colocalized with DTI abnormalities. Also, DTI correlated with 1H-MRS only in the chemotherapy group. These results converge to suggest that high-dose adjuvant chemotherapy for breast cancer is associated with long-term injury to white matter, presumably reflecting a combination of axonal degeneration and demyelination, and damage to gray matter with associated functional deficits. Hormonal treatment with tamoxifen may also have contributed to the observed effects, although results from other studies indicate that it is unlikely that tamoxifen is solely or largely responsible. Using this multimodality approach we provide for the first time insight into the neural substrate underlying cognitive impairments following systemic administration of cytotoxic agents many years after treatment. © 2011 Wiley Periodicals, Inc.