University of Leicester
Browse

Evaluating the Pedagogical Effectiveness of Study Preregistration in the Undergraduate Dissertation

Download (560.13 kB)
journal contribution
posted on 2024-02-29, 13:19 authored by M Pownall, CR Pennington, E Norris, M Juanchich, D Smailes, S Russell, D Gooch, TR Evans, S Persson, MHC Mak, L Tzavella, R Monk, T Gough, CSY Benwell, M Elsherif, E Farran, T Gallagher-Mitchell, LT Kendrick, J Bahnmueller, E Nordmann, M Zaneva, K Gilligan-Lee, M Bazhydai, A Jones, J Sedgmond, I Holzleitner, J Reynolds, J Moss, D Farrelly, AJ Parker, K Clark
Research shows that questionable research practices (QRPs) are present in undergraduate final-year dissertation projects. One entry-level Open Science practice proposed to mitigate QRPs is “study preregistration,” through which researchers outline their research questions, design, method, and analysis plans before data collection and/or analysis. In this study, we aimed to empirically test the effectiveness of preregistration as a pedagogic tool in undergraduate dissertations using a quasi-experimental design. A total of 89 UK psychology students were recruited, including students who preregistered their empirical quantitative dissertation (n = 52; experimental group) and students who did not (n = 37; control group). Attitudes toward statistics, acceptance of QRPs, and perceived understanding of Open Science were measured both before and after dissertation completion. Exploratory measures included capability, opportunity, and motivation to engage with preregistration, measured at Time 1 only. This study was conducted as a Registered Report; Stage 1 protocol: https://osf.io/9hjbw (date of in-principle acceptance: September 21, 2021). Study preregistration did not significantly affect attitudes toward statistics or acceptance of QRPs. However, students who preregistered reported greater perceived understanding of Open Science concepts from Time 1 to Time 2 compared with students who did not preregister. Exploratory analyses indicated that students who preregistered reported significantly greater capability, opportunity, and motivation to preregister. Qualitative responses revealed that preregistration was perceived to improve clarity and organization of the dissertation, prevent QRPs, and promote rigor. Disadvantages and barriers included time, perceived rigidity, and need for training. These results contribute to discussions surrounding embedding Open Science principles into research training.

History

Citation

Pownall M, Pennington CR, Norris E, et al. Evaluating the Pedagogical Effectiveness of Study Preregistration in the Undergraduate Dissertation. Advances in Methods and Practices in Psychological Science. 2023;6(4). doi:10.1177/25152459231202724

Author affiliation

School of Psychology, University of Leicester

Version

  • VoR (Version of Record)

Published in

Advances in Methods and Practices in Psychological Science

Volume

6

Issue

4

Publisher

SAGE Publications

issn

2515-2459

eissn

2515-2467

Copyright date

2023

Available date

2024-02-29

Language

en

Deposited by

Dr Mams Elsherif

Deposit date

2024-02-13

Usage metrics

    University of Leicester Publications

    Categories

    No categories selected

    Licence

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC