Natural populations are exposed to seasonal variation in environmental factors that simultaneously affect several demographic rates (survival, development, reproduction). The resulting covariation in these rates determines population dynamics, but accounting for its numerous biotic and abiotic drivers is a significant challenge. Here, we use a factor-analytic approach to capture partially unobserved drivers of seasonal population dynamics. We use 40 years of individual-based demography from yellow-bellied marmots (Marmota flaviventer) to fit and project population models that account for seasonal demographic covariation using a latent variable. We show that this latent variable, by producing positive covariation among winter demographic rates, depicts a measure of environmental quality. Simultaneous, negative responses of winter survival and reproductive-status change to declining environmental quality result in a higher risk of population quasi-extinction, regardless of summer demography where recruitment takes place. We demonstrate how complex environmental processes can be summarized to understand population persistence in seasonal environments.