Background Inbreeding increases homozygosity and exposes deleterious recessive alleles, generally decreasing the fitness of inbred individuals. Interestingly, males and females are usually affected differently by inbreeding, though the more vulnerable sex depends on the species and trait measured. Results We used the soil-dwelling nematode Caenorhabditis remanei to examine sex-specific inbreeding depression across nine lineages, five levels of inbreeding, and hundreds of thousands of progeny. Female nematodes consistently suffered greater fitness losses than their male counterparts, especially at high levels of inbreeding. Conclusions These results suggest that females experience stronger selection on genes contributing to reproductive traits. Inbreeding depression in males may be further reduced by sex chromosome hemizygosity, which affects the dominance of some mutations, as well as by the absence of sexual selection. Determining the relative contributions of sex-specific expression, genes on the sex chromosomes, and the environment they are filtered through—including opportunities for sexual selection—may explain the frequent though inconsistent records of sex differences in inbreeding depression, along with their implications for conservation and the evolution of mating systems.