Negative frequency-dependent selection (NFDS) has been shown to maintain polymorphism in a diverse array of traits. The action of NFDS has been confirmed through modelling, experimental approaches, and genetic analyses. In this study, we investigated NFDS in the wild using morph-frequency changes spanning a 20-year period from over 30 dimorphic populations of Datura wrightii. In these populations plants either possess glandular (sticky) or non-glandular (velvety) trichomes, and the ratio of these morphs varies substantially among populations. Our method provided evidence that NFDS, rather than drift or migration, is the primary force maintaining this dimorphism. Most populations that were initially dimorphic remained dimorphic, and the overall mean and variance in morph frequency did not change over time. Furthermore, morph-frequency differences were not related to geographic distances. Together, these results indicate that neither directional selection, drift, or migration played a substantial role in determining morph frequencies. However, as predicted by negative frequency-dependent selection, we found that the rare morph tended to increase in frequency, leading to a negative relationship between the change in the frequency of the sticky morph and its initial frequency. In addition, we found that morph-frequency change over time was significantly correlated with the damage inflicted by two herbivores: Lema daturaphila and Tupiochoris notatus. The latter is a specialist on the sticky morph and damage by this herbivore was greatest when the sticky morph was common. The reverse was true for L. daturaphila, such that damage increased with the frequency of the velvety morph. These findings suggest that these herbivores contribute to balancing selection on the observed trichome dimorphism.