Molecular comparisons of populations diverging into ecologically different environments often reveal strong differentiation in localized genomic regions, with the remainder of the genome being weakly differentiated. This pattern of heterogeneous genomic divergence, however, is rarely connected to direct measurements of fitness differences among populations. We here do so by performing a field enclosure experiment in threespine stickleback fish residing in a lake and in three replicate adjoining streams, and displaying weak yet heterogeneous genomic divergence between these habitats. Tracking survival over 29 weeks, we consistently find that lake genotypes transplanted into the streams suffer greatly reduced viability relative to local stream genotypes and that the performance of F1 hybrid genotypes is intermediate. This observed selection against migrants and hybrids combines to a total reduction in gene flow from the lake into streams of around 80%. Overall, our study identifies a strong reproductive barrier between parapatric stickleback populations, and cautions against inferring weak fitness differences between populations exhibiting weak overall genomic differentiation.