Heterozygosity-fitness correlations (HFCs) have been used to understand the complex interactions between inbreeding, genetic diversity and evolution. Although frequently reported for decades, evidence for HFCs was often based on underpowered studies or inappropriate methods, and hence their underlying mechanisms are still under debate. Here, we used 6,100 genome-wide Single Nucleotide Polymorphisms (SNPs) to test for general and local effect HFCs in maritime pine (Pinus pinaster Ait.), an iconic Mediterranean forest tree. Survival was used as a fitness proxy, and HFCs were assessed at a four-site common garden under contrasting environmental conditions (total of 16,288 trees). We found no significant correlations between genome-wide heterozygosity and fitness at any location, despite variation in inbreeding explaining a substantial proportion of the total variance for survival. However, four SNPs (including two non-synonymous mutations) were involved in significant associations with survival, in particular in the common gardens with higher environmental stress, as shown by a novel heterozygosity-fitness association test at the species-wide level. Fitness effects of SNPs involved in significant HFCs were stable across maritime pine gene pools naturally growing in distinct environments. These results led us to dismiss the general effect hypothesis and suggested a significant role of heterozygosity in specific candidate genes for increasing fitness in maritime pine. Our study highlights the importance of considering the species evolutionary and demographic history and different spatial scales and testing environments when assessing and interpreting heterozygosity-fitness correlations.