Read on Twitter
I recently gave a 2-hour "crash course" about #OpenScience to postgrad students @DurhamPsych
I received optimistic comments from students about the materials they were assigned to (see below
)
On the discussion board and in-class discussion, the students express that 1/
I received optimistic comments from students about the materials they were assigned to (see below
)On the discussion board and in-class discussion, the students express that 1/
- replication crisis shouldn't be taken to mean that psych sci is broken; such perspective feels like a cop out instead of trying to make it better
- there are societal consequences if failure to replicate continues
- preregistration is a helpful tool to help u plan out study 2/
- there are societal consequences if failure to replicate continues
- preregistration is a helpful tool to help u plan out study 2/
For this class, I was inspired by @OrbenAmy 's syllabus https://www.amyorben.com/docs/syllabus.pdf that uses several platforms to talk about this topic.
Here is how the class was structured:
First, the students read the 2015 @OSFramework paper:
https://science.sciencemag.org/content/349/6251/aac4716.full?ijkey=1xgFoCnpLswpk&keytype=ref&siteid=sci 3/
Here is how the class was structured:
First, the students read the 2015 @OSFramework paper:
https://science.sciencemag.org/content/349/6251/aac4716.full?ijkey=1xgFoCnpLswpk&keytype=ref&siteid=sci 3/
Second, the students listened to the NPR podcast to learn a/b different experts' takes on the crisis
A few students that spoke up during in-class meeting were not convinced by the argument that low replication rate is due to hidden moderators
https://www.npr.org/transcripts/477921050 4/
A few students that spoke up during in-class meeting were not convinced by the argument that low replication rate is due to hidden moderators
https://www.npr.org/transcripts/477921050 4/
Third, he students then read the two papers discussing how flexibility in analytical decisions can influence findings, one by Gelman & Loken (2014) and...5/
https://go.gale.com/ps/anonymous?id=GALE%7CA389260653&sid=googleScholar&v=2.1&it=r&linkaccess=abs&issn=00030996&p=AONE&sw=w
https://go.gale.com/ps/anonymous?id=GALE%7CA389260653&sid=googleScholar&v=2.1&it=r&linkaccess=abs&issn=00030996&p=AONE&sw=w
Third cont.) the other one by Silberzahn et al. (2018)
https://journals.sagepub.com/doi/full/10.1177/2515245917747646
6/
https://journals.sagepub.com/doi/full/10.1177/2515245917747646
6/
Fourth, they read @cruwelli et al's (2019) "Seven easy steps to Open Science" to learn about different practices and initiatives
https://econtent.hogrefe.com/doi/full/10.1027/2151-2604/a000387
7/
https://econtent.hogrefe.com/doi/full/10.1027/2151-2604/a000387
7/
After completing above activities, we met virtually to go over the OSF preregistration form, highlighting components that need to be specified: hypotheses, study design, sampling plan, measures, analysis plan.
I mentioned 2 reflections from my own experience w prereg: 8/
I mentioned 2 reflections from my own experience w prereg: 8/
A) Make sure to get feedback from others for your preregistration to prevent situations where you preregister an inappropriate analysis for your study.
B) Unfortunately there is currently no clear incentive to separate high-quality prereg from low-quality (aka broad) prereg 9/
B) Unfortunately there is currently no clear incentive to separate high-quality prereg from low-quality (aka broad) prereg 9/
I used point B to transition to introducing @RegReports where the incentive (aka publication) is built in as part of the process. I connected them to this twitter thread by @EmmaHendersonRR 10/ https://twitter.com/EmmaHendersonRR/status/1318458715742371840?s=20
7) It is exciting to hear that @DurhamPsych students are interested in more opportunities to continue learning about this.
We are in Year 2 of running the Open Science journal club, and we are organising a symposium in November so look out for info to register for the event!
We are in Year 2 of running the Open Science journal club, and we are organising a symposium in November so look out for info to register for the event!
