The Earth’s mantle is heterogeneous as a result of early planetary differentiation and subsequent crustal recycling during plate tectonics. Radiogenic isotope signatures of mid-ocean ridge basalts have been used for decades to map mantle composition, defining the depleted mantle endmember. These lavas, however, homogenize via magma mixing and may not capture the full chemical variability of their mantle source. Here, we show that the depleted mantle is significantly more heterogeneous than previously inferred from the compositions of lavas at the surface, extending to highly enriched compositions. We perform high-spatial-resolution isotopic analyses on clinopyroxene and plagioclase from lower crustal gabbros drilled on a depleted ridge segment of the northern Mid-Atlantic Ridge. These primitive cumulate minerals record nearly the full heterogeneity observed along the northern Mid-Atlantic Ridge, including hotspots. Our results demonstrate that substantial mantle heterogeneity is concealed in the lower oceanic crust and that melts derived from distinct mantle components can be delivered to the lower crust on a centimetre scale. These findings provide a starting point for re-evaluation of models of plate recycling, mantle convection and melt transport in the mantle and the crust.