Skip to main content
Dryad logo

Data from: Exploratory and confirmatory research in the open science era

Citation

Nilsen, Erlend B.; Bowler, Diana; Linnell, John (2020), Data from: Exploratory and confirmatory research in the open science era, Dryad, Dataset, https://doi.org/10.5061/dryad.z612jm686

Abstract

1. Applied ecological research is increasingly inspired by the Open Science movement. However, new challenges about how we define our science when biodiversity data is being shared and re-used are not solved. Among these challenges is the risk associated with blurring the distinction between research that mainly seeks to explore patterns with no a-priori articulated hypotheses (exploratory research), and research that explicitly tests a-priori formulated hypotheses (confirmatory research).

2. A rapid screening of a random selection of peer-reviewed articles suggests that neither experimental protocols nor hypothesis-testing sensu stricto are common in applied ecological research. In addition, most experiments are carried out on small spatial scales, which contrast with current global policy needs and research trends towards addressing large spatial and temporal scales. This latter trend make it unfeasible for policy to rely mainly on insights gained from experimental research.

3. To solve fundamental local, regional and global societal challenges, we need both exploratory and confirmatory research, and the fundamental (but different) role that hypothesis-testing and prediction play in applied ecological research should be revaluated.

4. A clearer distinction between exploratory and confirmatory research could be facilitated by allocating journal sections to different types of research; embracing new tools offered by the open science era, such as pre-registration of hypothesis; establishing new systems where post-hoc hypotheses emerging through exploration can also be registered for later testing; and more broad adoption of causal inference methods that foster more structured testing of hypotheses about causal mechanisms from observational biodiversity data.

5. Synthesis and applications. To gain the full benefits from the open science era, researchers, funding bodies and journal editors should explicitly consider incentives that encourage openness about methods and approaches, as well as value the full plurality of scientific approaches needed to address questions in conservation science.

Methods

A full description of the dataset, including data collection and the procedures for random selection of papers to include, is given in Appendix 1 accompanying in the paper. There is also additional suppelementary information available at the OSF registration located at https://doi.org/10.17605/OSF.IO/W3S49

Funding

Norges Forskningsråd, Award: 251112