When a scientist says "This paper doesn& #39;t show this" or "We don& #39;t have enough evidence to say"

They are not saying it& #39;s wrong. Or that it will never be shown. They are saying we all need to be really careful how we interpret this.

#COVID19 #SARSCoV2

1/13
This *seems* simple but it& #39;s misinterpreted *all the time*.

Ex: When I say "we don& #39;t know for sure if masks are beneficial at population level" I am not saying "masks don& #39;t work" or "we& #39;ll never know if masks work." I& #39;m not even weighing in on policy decisions on masks.

2/13
I& #39;m simply saying, "we don& #39;t have evidence for this, so let& #39;s not pretend we do." That doesn& #39;t mean it& #39;s wrong. It means *we don& #39;t know yet.*

This is really critical and important in science. And you& #39;ll see scientists stepping in to clarify this *a lot.*

3/13
Often they get taken to town for suggesting the idea behind study is "wrong." That& #39;s not what they& #39;re saying. They& #39;re saying we can& #39;t say that idea is *right* from this study.

We might find the exact same thing in future, through better/different work - we might not.

4/13
Scientists may get accused later of "getting it wrong" when in actuality what they were saying is "THIS doesn& #39;t prove X". That doesn& #39;t mean another study won& #39;t prove X later -- & scientists aren& #39;t claiming that.
This really bothers me.

5/13
There are also limits on *what* we can tell from studies, which often get lost in media. The viral load/pathogenicity/mutations study from today being a good example: https://twitter.com/NathanGrubaugh/status/1252562768068304898

This">https://twitter.com/NathanGru... is outside of my field so I can& #39;t comment much on the methods.

6/13
What I *can* say (& matches Nathan above) is that it& #39;s very, very hard to extrapolate from virulence in Vero cells to #COVID19 disease severity in humans.

The study may not be "bad" - but it is easily over-interpreted in the current #SARSCoV2-media-frenzy & public interest

7/13
Again, this is different from saying "none of these mutations influence disease severity." What is being said is "this does not tell us how mutations impact disease in humans."

A lot of people now like to jump in with & #39;common sense& #39; - but this isn& #39;t how science works!

8/13
And trust me - you are glad it works this way! You are glad that treatments, medicines, & protocols aren& #39;t based on & #39;common sense& #39; from a monkey-cell study.

It is *literally our job* to know where to draw the line on & #39;what we know.& #39;

9/13
Studies like the above may indeed still be interesting first steps to guide us - but they are a long way from what they often end up portrayed in comments, social media, & mainstream media. (Watch out for this!)

10/13
Other studies may be hopelessly wrong in design/execution/interpretation, but later their conclusion may be proven correct by a better/different method. That doesn& #39;t make the original study any less wrong or uninformative.

11/13
So when a scientist says "this doesn& #39;t show this" or "we don& #39;t know" - please try to remember to pause & evaluate this for what it is - a caution to *watch out* - the evidence isn& #39;t here yet!

But I have great faith in science - we& #39;re moving so incredibly fast right now!

12/13
We *will* find the answers to many of the questions we have today. We are working together so well, so openly, so fast on #COVID19 #SARSCoV2

But it& #39;s worth waiting for the real, hard evidence. We& #39;ll all benefit more from it! https://abs.twimg.com/emoji/v2/... draggable="false" alt="👏🏻" title="Clapping hands sign (light skin tone)" aria-label="Emoji: Clapping hands sign (light skin tone)">https://abs.twimg.com/emoji/v2/... draggable="false" alt="🙌🏻" title="Raising hands (light skin tone)" aria-label="Emoji: Raising hands (light skin tone)">

13/13
You can follow @firefoxx66.
Tip: mention @twtextapp on a Twitter thread with the keyword “unroll” to get a link to it.

Latest Threads Unrolled: