Update! New and much expanded curation framework (version 4.2.0) soon to be released (from current version 3.0.1).
Here's what's new:
- Improved framing of the goal of our curation framework: To establish the provisional trustworthiness of published effects by quantifying their analytic reproducibility/robustness, replicability, and generalizability.
- Elaboration on why traditional meta-analyses cannot establish provisional trustworthiness of effects because of the impossible accounting of publication bias, QRPs, (un)intentional exploitation of design & analytic flexibility, and their unknowable interactions.
- Clearer articulation of our working replication taxonomy and updated figure.
- New workflow (and new diagram) for gauging and quantifying "analytic reproducibility" of a published result (with significant help from Wolf Vanpaemel).
- Clearer articulation (and new diagram) of general workflow for gauging and quantifying replicability and generalizability of published effects within evidence collections.
- Calibration of framework to reality via curation of Bem's (2011) retroactive recall effect, for original instantiation of effect (Study 8) and a method generalization (Study 9).
- Better examples applying framework to different kinds of replications in psychology (two examples demonstrating method generalizations, one example demonstrating population generalizations, and another demonstrating analytic reproducibility and robustness).
Sincerely,
Curate Science Team
|
|
|
|
