Very excited to have @mirbabineau and my #RegisteredrReport stage2 accepted to Developmental Science! As one of the reviewers said, this is probably one of the first RRs to be accepted in developmental science, and we learned a lot in the process.
This thread will not be about the study itself, I& #39;ll have a separate thread for that, but about the experience of doing a RR in developmental psychology.
First of all, writing the paper is my favorite part of a project. Getting to write even before running the experiment made me even more excited to finally see the results.
The stage 1 review really improved our design. Reviewers were fast, thorough, and it showed that they felt they have a stake in the study& #39;s results.
Our original design was probably easier for toddlers to do, but if it would have worked, it would have alternative explanations, while the improved design wouldn& #39;t.
We also switched to a Bayesian analysis with sequential testing thanks to a reviewer. This pushed us to finally start learning to do these analyses, which I have been wanting to do for a long time.
Spoiler: we found support for H0, which could have multiple explanations. As a reviewer pointed out, our original discussion was read as a post mortem. A sad discussion of our disappointment.
The reviewers lifted us off the floor. They asked for cool simulations, declared as exploratory in the results section. Again I learned valuable #R skills.
They asked for a broader discussion of what a RR in developmental psychology means. E.g., @annemscheel& #39;s finding that most RRs find negative results. It made our discussion much better.
I presented these results at #BUCLD44 as we believe we can also learn from negative results. Two amazing researchers proposed to run an additional experiment with me, which we believe will disentangle possible explanation for our null results.
Overall I loved the experience and would do it again as soon as possible - I think you all should try it sometime https://abs.twimg.com/emoji/v2/... draggable="false" alt="😉" title="Zwinkerndes Gesicht" aria-label="Emoji: Zwinkerndes Gesicht">
You can follow @NaomiHavron.
Tip: mention @twtextapp on a Twitter thread with the keyword “unroll” to get a link to it.

Latest Threads Unrolled: