Would you sign your name to your peer review?
Since March 2019, @CircOutcomes has offered “Signed Reviews” as a voluntary program.
Here’s what we& #39;ve found so far...
1/
Since March 2019, @CircOutcomes has offered “Signed Reviews” as a voluntary program.
Here’s what we& #39;ve found so far...
1/
It is uncommon but not rare for authors to use "Signed Reviews"...
About 10% sign their critiques...
2/
About 10% sign their critiques...
2/
Decisions with at least 1 "Signed Review" are different. But not dramatically so...
- Fewer "Reject" Decisions overall (44% vs 50%)
- More "Reject & Transfer" Decisions (24% vs 12%)
3/
- Fewer "Reject" Decisions overall (44% vs 50%)
- More "Reject & Transfer" Decisions (24% vs 12%)
3/
Thankfully not a single "complaint" from an author or reviewer...(a big but apparently unfounded worry we had at the beginning)...
4/
4/
Few anecdotal observations...
- Many reviewers sign some but not all their reviews
- Mixed bag of women & men, senior & junior folks
- "Signed Reviews" feel richer, more thoughtful
5/
- Many reviewers sign some but not all their reviews
- Mixed bag of women & men, senior & junior folks
- "Signed Reviews" feel richer, more thoughtful
5/
Evidence suggests open peer review doesn& #39;t improve individual reviews or decisions (see below) & it may bias against junior researchers scared to be honest...
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1114535/
6/">https://www.ncbi.nlm.nih.gov/pmc/artic...
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1114535/
6/">https://www.ncbi.nlm.nih.gov/pmc/artic...
But open peer review does seem ethically better & certainly avoids the awful feeling of an anonymous "R3" burner account trolling you...
For now we will continue to offer this program & monitor its role in our review process...We& #39;d love feedback.
@CircOutcomes
Fin/
For now we will continue to offer this program & monitor its role in our review process...We& #39;d love feedback.
@CircOutcomes
Fin/