When species within guilds perform similar ecological roles, functional redundancy can buffer ecosystems against species loss. Using data on the frequency of interactions between fish and fruit, we assessed whether co-occurring frugivores provide redundant seed dispersal services in three species-rich Neotropical wetlands. Our study revealed that frugivorous fishes have generalized diets; however, large-bodied fishes had greater seed dispersal breadth than small species, in some cases, providing seed dispersal services not achieved by smaller fish species. As overfishing disproportionately affects big fishes, the extirpation of these species could cause larger secondary extinctions of plant species than the loss of small specialist frugivores. To evaluate the consequences of frugivore specialization for network stability, we extracted data from 39 published seed dispersal networks of frugivorous birds, mammals and fish (our networks) across ecosystems. Our analysis of interaction frequencies revealed low frugivore specialization and lower nestedness than analyses based on binary data (presence–absence of interactions). In that case, ecosystems may be resilient to loss of any given frugivore. However, robustness to frugivore extinction declines with specialization, such that networks composed primarily of specialist frugivores are highly susceptible to the loss of generalists. In contrast with analyses of binary data, recently developed algorithms capable of modelling interaction strengths provide opportunities to enhance our understanding of complex ecological networks by accounting for heterogeneity of frugivore–fruit interactions.