Tests of phenotypic convergence can provide evidence of adaptive evolution, and the popularity of such studies has grown in recent years due to the development of novel, quantitative methods for identifying and measuring convergence. These methods include the commonly applied C1–C4 measures of Stayton (2015), which measure morphological distances between lineages, and Ornstein-Uhlenbeck (OU) model-fitting analyses, which test whether lineages converged on shared adaptive peaks. We test the performance of C-measures and other convergence measures under various evolutionary scenarios and reveal a critical issue with C-measures: they often misidentify divergent lineages as convergent. We address this issue by developing novel convergence measures— Ct1–Ct4-measures —that calculate distances between lineages at specific points in time, minimizing the possibility of misidentifying divergent taxa as convergent. Ct-measures are most appropriate when focal lineages are of the same or similar geologic ages (e.g., extant taxa), meaning that the lineages’ evolutionary histories include considerable overlap in time. Beyond C-measures, we find that all convergence measures are influenced by the position of focal taxa in phenotypic space, with morphological outliers often statistically more likely to be measured as strongly convergent. Further, we mimic scenarios in which researchers assess convergence using OU models with a priori regime assignments (e.g., classifying taxa by ecological traits) and find that multiple-regime OU models with phenotypically divergent lineages assigned to a shared selective regime often outperform simpler models. This highlights that model support for these multiple-regime OU models should not be assumed to always reflect convergence among focal lineages of a shared regime. Our new Ct1–Ct4-measures provide researchers with an improved comparative tool, but we emphasize that all available convergence measures are imperfect, and researchers should recognize the limitations of these methods and use multiple lines of evidence to test convergence hypotheses.

This Dryad submission includes many simulated datasets and a Wolfram's Mathematica notebook with a custom script used to produce the simulations. See the README file, included Mathematica file, and associated publication for more information.