Finally read this paper in detail. Overall very compelling case for abandoning small individual/group differences studies with neuroimaging data. https://twitter.com/smarek0502/status/1297154759556763649">https://twitter.com/smarek050...
Results are reminiscent of @nicebread303 "corridor of stability" work https://www.nicebread.de/at-what-sample-size-do-correlations-stabilize/">https://www.nicebread.de/at-what-s... and @GaelVaroquaux "cross validation failure" https://hal.inria.fr/hal-01545002 ">https://hal.inria.fr/hal-01545... - but nice to see these phenomena demonstrated so strikingly at this scale in real data
Suggestions:
1) Would be nice to plot positive predictive value alongside error rates in Figure 2
1) Would be nice to plot positive predictive value alongside error rates in Figure 2
2) I& #39;m concerned that rigorous motion exclusion could result in restricted range and/or Berkson& #39;s paradox. Would be nice to see more detail about how distributions of behavioral/demographic variables are affected by exclusion.
Definitely shows the immense value of large shared datasets - big kudos to the ABCD and HCP teams for making this possible through their data sharing efforts!