University of Leicester
Browse
1-s2.0-S0010945223002964-main.pdf (3.26 MB)

We Don’t Know What You Did Last Summer. On the Importance of Transparent Reporting of Reaction Time Data Pre-processing

Download (3.26 MB)
journal contribution
posted on 2024-01-08, 17:15 authored by Hannah Dorothea Loenneker, Erin M Buchanan, Ana Martinovici, Maximilian A Primbs, Mahmoud Medhat Elsherif, Bradley J Baker, Leonie A Dudda, Dušica Filipović Đurđević, Ksenija Mišić, Hannah K Peetz, Jan Philipp Röer, Lars Schulze, Lisa Wagner, Julia Katharina Wolska, Corinna Kührt, Ekaterina Pronizius

 

In behavioral, cognitive, and social sciences, reaction time measures are an important source of information. However, analyses on reaction time data are affected by researchers' analytical choices and the order in which these choices are applied. The results of a systematic literature review, presented in this paper, revealed that the justification for and order in which analytical choices are conducted are rarely reported, leading to difficulty in reproducing results and interpreting mixed findings. To address this methodological shortcoming, we created a checklist on reporting reaction time pre-processing to make these decisions more explicit, improve transparency, and thus, promote best practices within the field. The importance of the pre-processing checklist was additionally supported by an expert consensus survey and a multiverse analysis. Consequently, we appeal for maximal transparency on all methods applied and offer a checklist to improve replicability and reproducibility of studies that use reaction time measures.

 

History

Author affiliation

School of Psychology and Vision Science, University of Leicester

Version

  • VoR (Version of Record)

Published in

Cortex

Volume

172

Pagination

14-37

Publisher

Elsevier BV

issn

0010-9452

Copyright date

2024

Available date

2024-01-08

Language

en

Usage metrics

    University of Leicester Publications

    Categories

    Licence

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC