36: Statistical inconsistencies in published research
Everything Hertz27 Tammi 2017

36: Statistical inconsistencies in published research

In episode 34 we covered a blog post that highlighted questionable analytical approaches in psychology. That post mentioned four studies that resulted from this approach, which a team of researchers took a closer look into. Dan and James discuss the statistical inconsistencies that the authors reported in a recent preprint.

Some of the topics covered:

  • Trump (of course)
  • A summary of the preprint
  • The GRIM test to detect inconsistencies
  • The researchers that accidently administered the equivalent of 300 cups of coffee to study participants
  • How do we prevent inconsistent reporting?
  • 21 word solution for research transparency
  • Journals mandating statistical inconsistency checks, such as 'statcheck'

Links

The pre-print
https://peerj.com/preprints/2748/

'The grad student that didn't say no' blog post
http://www.brianwansink.com/phd-advice/the-grad-student-who-never-said-no

The caffeine study
http://www.bbc.com/news/uk-england-tyne-38744307

Tobacco and Alcohol Research Group lab handbook (see page 6 for open science practices)
http://www.bris.ac.uk/media-library/sites/expsych/documents/targ/TARG%20Handbook%20161128.pdf

21 word solution
http://spsp.org/sites/default/files/dialogue_26(2).pdf

Facebook page
https://www.facebook.com/everythinghertzpodcast/

Twitter account
https://www.twitter.com/hertzpodcast

Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(195)

195: Living meta-analysis

195: Living meta-analysis

We discuss how living meta‑analyses—meta‑analyses that are continuously updated as new studies appear—can cut research waste and keep evidence current. We also chat about how using synthetic research ...

14 Tammi 37min

194: Author verification

194: Author verification

We discuss whether preprint servers and journals should require author identity verification for submitting manuscripts. This would probably speed up the submission process, but is this worth the pote...

10 Marras 202544min

193: The pop-up journal

193: The pop-up journal

Dan and James chat about a a new 'pop-up journal' concept for addressing specific research questions. They also answer a listener question from a journal grammar editor and discuss a new PNAS article ...

7 Elo 202559min

192: Outsourcing in academia

192: Outsourcing in academia

Dan and James answer listener questions on outsourcing in academia and differences in research culture between academic institutions and commercial institutions. Social media links Dan on Bluesky ...

1 Heinä 202547min

191: Cleaning up contaminated medical treatment guidelines

191: Cleaning up contaminated medical treatment guidelines

James and Dan discuss James' newly funded 'Medical Evidence Project', whose goal is to find questionable medical evidence that is contaminating treatment guidelines. Links James' blog post from las...

3 Kesä 202548min

190: What happens when you pay reviewers?

190: What happens when you pay reviewers?

We chat about two new studies that took different approaches for evaluating the impact of paying reviewers on peer review speed and quality. Links James' 450 movement proposal The paper from Critic...

2 Huhti 202544min

189: Crit me baby, one more time

189: Crit me baby, one more time

Dan and James discuss a recent piece that proposes a post-publication review process, which is triggered by citation counts. They also cover how an almetrics trigger could be alternatively used for a ...

2 Maalis 202553min

188: Double-blind peer review vs. scientific integrity

188: Double-blind peer review vs. scientific integrity

Dan and James discuss a recent editorial which argues that double-blind peer review is detrimental to scientific integrity. Links The editorial from Christopher Mebane: https://doi.org/10.1093/etoj...

30 Tammi 202554min

Suosittua kategoriassa Tiede

rss-poliisin-mieli
rss-mita-tulisi-tietaa
tiedekulma-podcast
docemilia
rss-tiedetta-vai-tarinaa
rss-bios-podcast
rss-duodecim-lehti
rss-hereilla
rss-lapsuuden-rakentajat-podcast
utelias-mieli
radio-antro
hippokrateen-vastaanotolla
filocast-filosofian-perusteet