Due to the low temporal resolution of BOLD-fMRI, imaging studies on human brain function have almost exclusively focused on instantaneous correlations within the data. Developments in hardware and acquisition protocols, however, are offering data with higher sampling rates that allow investigating the latency structure of BOLD-fMRI data. In this study we describe a method for analyzing the latency structure within BOLD-fMRI data and apply it to resting-state data of 94 participants from the Human Connectome Project. The method shows that task-positive and task-negative networks are integrated through traveling BOLD waves within early visual cortex. The waves are initiated at the periphery of the visual field and propagate towards the fovea. This observation suggests a mechanism for the functional integration of task-positive and task-negative networks, argues for an eccentricity-based view on visual information processing, and contributes to the emerging view that resting-state BOLD-fMRI fluctuations are superpositions of inherently spatiotemporal patterns.