Afleveringen
-
We want scientists to be paragons of objectivity. At the very least, we want them to tell us whoâs paying their bills. But it turns out that in some fields of research, the norms about reporting financial conflicts of interest are all over the place. Scientists making big money from after-dinner speeches about their research often donât think itâs at all relevant to disclose.
In this episode of The Studies Show, Tom and Stuart look at the evidence on how funding affects the outcomes of scientific researchâand discuss whether scientists need to be a lot more transparent about where their money comes from.
Show notes
* 2017 meta-analysis of the impact of funding source (for-profit vs. non-profit) on medical randomised trials
* Tomâs Nature article on undisclosed financial conflicts in psychology research
* New Angela Duckworth paper with no COI statement
* Unconvincing ethics article on COI disclosures and public trust
* Scientist declares his membership of the Scottish Socialist Party in an article about Margaret Thatcher
* Ioannidis article on conflicts of interest in nutrition research
Credits
The Studies Show is produced by Julian Mayers at Yada Yada Productions.
This is a public episode. If youâd like to discuss this with other subscribers or get access to bonus episodes, visit www.thestudiesshowpod.com/subscribe -
This week, as a gift for New Yearâs Eve, weâre opening up a previously-paywalled episode so that everyone can listen. Itâs our episode from April 2024 on âYouth gender medicine & the Cass Reviewâ. Since the show notes were previously behind the paywall, theyâre copied below.
If youâd like to listen to all our paywalled episodesâwhich are of course ad-free, like this oneâyou can subscribe by visiting thestudiesshowpod.com.
Normal service will be resumed next week. Happy New Year!
Show notes
* The Cass Reviewâs final report
* List of systematic reviews from University of York researchers that were commissioned by the Cass Review
* Hannah Barnes on why the Tavistock gender identity clinic was forced to close
* VICE interview with a Tavistock doctor, including information on patient numbers
* Original Dutch single-case study on puberty blockers
* Somewhat larger Dutch study of puberty blockers from 2011
* The âEarly Interventionâ study from England (not published until 2021)
* Article thatâs critical of the âcis-supremacyâ in the Cass Review
* BMJ editorial on the Cass Review
* Billy Bragg claims that the Cass Review only included 2 studies out of 102
* Owen Jonesâs video where he claims studies were âarbitrarilyâ excluded from the report
* Fact-checking post from Benjamin Ryan, covering some of the criticisms of the Cass Report
* Hilary Cass interviewed by The Times
* Episode of BBC More or Less that addresses some of the criticisms
* 2020 study on the small proportion of medical treatments where thereâs strong evidence
* More recent (2022) study by the same authors finding an even more depressing picture: âMore than 9 in 10 healthcare interventions studied within recent Cochrane Reviews are not supported by high-quality evidence, and harms are under-reportedâ
* The book Medical Nihilism
* The BMJ review of the book, quoted in the episode
Credits
The Studies Show is produced by Julian Mayers at Yada Yada Productions.
This is a public episode. If youâd like to discuss this with other subscribers or get access to bonus episodes, visit www.thestudiesshowpod.com/subscribe -
Zijn er afleveringen die ontbreken?
-
In this final episode of 2024, Tom and Stuart talk about the most exciting scientific breakthroughs of the year⊠but temper it with some of the worst episodes of scientific fraud and misconduct, too. Then, just as a bonus, they address some of the biggest errors made in episodes of The Studies Show in 2024, too.
Thank you so much for listening in 2024. If you arenât one already, please consider becoming a paid subscriber to support the podcast and get access to all the episodes. In any case, weâll see you for more The Studies Show in the New Year!
The Studies Show is sponsored by GiveWell, the non-profit aimed at making charitable donations as effective as possible. If youâre the kind of person who wants solid evidence that the money you donate is having an important effect on peopleâs lives, GiveWell is where you should be looking.
You can get your donation matched up to $100 if youâre a first-time donor on GiveWell. Just go to the website (GiveWell.org), then click âDonateâ. When you make your donation, say you heard about GiveWell on a podcast, and enter âThe Studies Showâ to let them know we sent you. Then youâll see the donation matched.
Show notes
* Saloni Dattaniâs âFive Medical Breakthroughs in 2024â post
* Gavin Leechâs âBreakthroughs of 2024â thread on Twitter
* Stuartâs monthly bad science newsletter
Credits
The Studies Show is produced by Julian Mayers at Yada Yada Productions.
This is a public episode. If youâd like to discuss this with other subscribers or get access to bonus episodes, visit www.thestudiesshowpod.com/subscribe -
In this âfunâ, festive episode of The Studies Show, Tom and Stuart discuss two waysâone man-made, one naturalâthat our species might be wiped off the planet.
The first is âmirror lifeâ, a science-fiction-sounding threat that hardly anyone had heard of until last week, when a group of concerned scientists wrote an open letter arguing that this is a technology that should never be developed. The second is the eruption of a supervolcano, which has a scarily high likelihood of happening in the next century⊠and for which scientists say weâre âwoefully underpreparedâ. Have a cheery Christmas!
Hereâs your chance to do some clear, measurable good this Christmas. Weâre pleased to say that weâre being sponsored by GiveWell, the non-profit organisation who use evidence to work out which charities are the most impactful and effective. The really good news is that theyâll match any donation up to $100 for first-time donors who tell them at the checkout that they heard about GiveWell on a podcast, and then choose THE STUDIES SHOW. Go to GiveWell.org and click âdonateâ to get started.
Show notes
* Mirror life:
* The 300-page full Stanford report
* Science perspective piece on the risks of mirror life
* Asimov Press explainer article
* Supervolcanoes:
* I HATE ICELAND!
* Nature piece from 2022 about our âwoefulâ level of preparation for a massive volcanic eruption
* 1816, the âyear without a summerâ
* Evidence against the idea that Mt. Tambora nearly drove humans to extinction
* 2024 paper thatâs sceptical of global cooling beyond 1.5 degrees C
* 2023 paper with a much more pessimistic scenario
* Two useful discussions (first, second) of the effects of supervolcanoes on the Effective Altruism forum
* 2018 article on what interventions might prevent or mitigate supervolcanic eruptions
Credits
The Studies Show is produced by Julian Mayers at Yada Yada Productions.
This is a public episode. If youâd like to discuss this with other subscribers or get access to bonus episodes, visit www.thestudiesshowpod.com/subscribe -
This is a free preview of a paid episode. To hear more, visit www.thestudiesshowpod.com
Rather unexpectedly, the idea of separate sports for males and females has become massively controversialâa major flashpoint in the culture wars, and even in the recent US election.
So what does the evidence say? Is it fair if trans women (who are biologically male) compete with females in sports like swimming, or even boxing? How much sporting performance does a lifetime of testosterone grant you? In this paid-only episode of The Studies Show, Tom and (confirmed sport-hater) Stuart look at the evidence on male vs. female sport performanceâand discuss whether the argument is really more about ethics and politics than scientific evidence.
-
Patrick Bateman. Hannibal Lecter. Ted Bundy. The guy who used to live downstairs from me. Psychopaths, every one. Except defining psychopathy, let alone measuring it, turns out to be surprisingly controversial among psychologists and forensic scientists.
In this episode of The Studies Show, Tom and Stuart look at the latest attempts to define and model psychopathy, the evidence on the questionnaires used to measure it, and whether The Sopranos was right in saying that therapy only makes psychopaths worse.
Our sponsor for the next month is GiveWell. Theyâre the org that helps you work out the most effective, life-saving ways to donate to charity. The great news is that, if you havenât donated with GiveWell before, theyâve offered to match your charitable donations up to $100. That is, if you donate $100 to an effective charity, itâll instantly be doubled. What are you waiting for? All you have to do is go to GiveWell.org, click âDonateâ, and when youâre at the checkout choose PODCAST and enter THE STUDIES SHOW.
Show notes
* The Society for the Scientific Study of Psychopathy strongly criticise Jon Ronsonâs book The Psychopath Test
* 2021 Nature Reviews Disease Primers article on psychopathy
* Critical discussion of whether the psychopath label should be applied to children
* Christopher Patrickâs review of psychopathy research and discussion of his âtriarchicâ model of psychopathy
* 2020 review-of-reviews on whether psychopathy checklist scores predict violence, therapy outcomes, or remorse
* The 2020 letter from âconcerned expertsâ about PCL-R scores and institutional violence
* Review on psychopathy scores and âdangerousnessâ from 2022
* The controversial 1992 study on iatrogenic effects on psychopaths in therapy
* âAre psychopathy assessments ethical?â
Credits
The Studies Show is produced by Julian Mayers at Yada Yada Productions.
This is a public episode. If youâd like to discuss this with other subscribers or get access to bonus episodes, visit www.thestudiesshowpod.com/subscribe -
Among patients hospitalized for COVID, smokers had better outcomes. Among people with cardiovascular disease, those with obesity live longer. Among NBA basketballers, taller players donât do any better. These are all facts. But the interpretation you might immediately draw is completely wrong.
It turns out that these findings (and many more) might be due to the weird and under-discussed phenomenon of âcollider biasâ. Everyone whoâs interested in scientific methods knows what a confounder isâbut do they know what a collider is? In this episode of The Studies Show, Tom and Stuart attempt to explain.
Weâre delighted to announce our sponsor for the next month: GiveWell. Theyâre the organisation who use rigorous evidence to point you towards the highest-impact charities. Want to make sure your donation goes as far as possible, maximising the lives that youâll save and improve? GiveWell.org is the place to go.
And hereâs a fantastic opportunity: if youâre a new donor, GiveWell will match up to $100 of your charitable donation if you go to GiveWell.org, then choose âPODCASTâ and enter âThe Studies Showâ at checkout.
Show notes
* French study on COVID and smoking rates
* French doctors handing out nicotine patches during the pandemic
* Review of 13 studies in China showing lower smoking rates in those hospitalised for COVID
* Among heart attack sufferers, smokers have better subsequent health
* Obesity linked to improved survival among patients with a wide range of diseases
* Within the NBA, tall basketball players do no better than short ones
* Standardized testing doesnât predict how well graduate physics students do
* The same but for biology
* The same but for STEM in general
* Do neurotic people actually live longer, once you correct for self-rated health?
* Julia Rohrerâs blog article on collider bias, using the conscientiousness/IQ relation
* The âcollider scopeâ paper - one of the best explanations of the phenomenon
* Article on âthe obsesity paradoxâ
* Follow-up arguing that it might not be a paradox at all
Credits
The Studies Show is produced by Julian Mayers at Yada Yada Productions.
This is a public episode. If youâd like to discuss this with other subscribers or get access to bonus episodes, visit www.thestudiesshowpod.com/subscribe -
Is Robert F. Kennedy, Jr., just a big crank? Well, yes. But is he nevertheless correct in his specific claims about the harms of water fluoridation? Itâs long been argued that itâs no longer necessary, and that it might have the scary adverse effect of lowering childrenâs IQs. In this episode of The Studies Show, Tom and Stuart look at the evidence.
While theyâre at it, Tom and Stuart ask whether thereâs evidence for several other dentistry-related claims. Regular check-ups; flossing; fillings; fluoride toothpasteâis your dentist just b**********g you about any or all of these?
[This podcast was recorded just before Donald Trump selected RFK Jr. as his candidate for US Health Secretary, but that makes the episode even more relevant].
The Studies Show is brought to you by Works in Progress magazine. If youâre an optimist who enjoys reading about how things have gotten better in the past, and how we might make them better in the futureâthen itâs the magazine for you. Find it at worksinprogress.co.
Show notes
* RFK Jr.âs tweet about how the new Trump administration will remove fluoride from the US water supply
* US National Research Councilâs 2006 report on fluoridation
* 2023 meta-analysis on water fluoridation and IQ
* Letter co-authored by Stuart, criticising a bad study on fluoride and IQ in pregnant women and their babies
* The original study
* Review of fluoridation and cancer risk
* 2000 UK NHS review of fluoridation and cancer risk
* 2022 UK Government report on the link of water fluoridation to various different medical conditions
* 2024 Cochrane Review on fluoridation and preventing tooth decay
* Review of guidelines from the Journal of the American Dental Association
* 2020 randomised controlled trial on fillings in childrenâs teeth
* The Cochrane Library on the evidence for specific intervals between dental appointments (e.g. 6 months)
* The American Dental Association guidelines on flossing, and the NHS ones
* 2019 Cochrane review of RCTs of flossing
* The ADA and NHS guidelines on brushing with fluoride toothpaste
* 2019 Cochrane review on brushing and fluoride
* Claims about cardiac health being related to dental health
* Study of 1m people in Korea on cardiac health and tooth loss
* 2020 meta-analysis of cardiac and dental health
* The study included in the meta-analysis by Chen, Chen, Lin, and Chen
* Claims about dental health and cancer
* 2020 review of the literature
* 2024 Ars Technica story on dentists over-selling their services
* 2019 Atlantic piece: âIs Dentistry a Science?â
* 2013 piece in the Washington State Dental News magazine on âcreative diagnosisâ
* Articles in the British Dental Journal and JAMA Internal Medicine both arguing that evidence-based medicine has left dentistry behind
Credits
The Studies Show is produced by Julian Mayers at Yada Yada Productions.
This is a public episode. If youâd like to discuss this with other subscribers or get access to bonus episodes, visit www.thestudiesshowpod.com/subscribe -
This is a free preview of a paid episode. To hear more, visit www.thestudiesshowpod.com
You mightâve noticed it: a lot of celebrities have recently been talking or writing about their diagnosis of adult ADHD. The way they discuss it, as soon as they discovered they had ADHD everything made sense: their distractibility, their difficulties following instructions, their restlessness, and so on.
But is adult ADHD a real psychiatric condition? How does it differ from childhood ADHD? And (whisper it) might some people actually be faking having ADHD? In this episode of The Studies Show, Tom and Stuart cast a sceptical eye over this very âtrendyâ diagnosis.
By the way, if youâre a paying subscriber, you can add the RSS feed of this podcast to your favourite podcast app so you donât just have to access the paid-only episodes via the Substack page. You can find out how to do so at this link.
-
In a desperate attempt to be relevant given the US Election, Tom and Stuart dedicate this episode of The Studies Show to talking about government investment in science. How bad is it if politicians cut the science budget? Exactly how much do you get back for every pound or dollar spent on scienceâand how is that even calculated in the first place?
The Studies Show is brought to you by Works in Progress magazineâa journal of science, history, and technology that discusses the secrets behind human progress. You can read their published essays at worksinprogress.co, or their shorter pieces on their Substack at worksinprogress.news.
Show notes
* Natureâs editorial: âThe world needs a President who respects evidenceâ
* Trumpâs science budget cuts: NIH/EPA, CDC
* Natureâs editorial on the âsurge in far-right partiesâ in Europe cutting the science budget
* Tomâs 2015 BuzzFeed News article on science budget cuts in the UK
* Article on Argentinian science budget cuts under Javier Milei
* Andre Geim and Nancy Rothwellâs 2024 Guardian article on how ÂŁ1 of science funding gets you ÂŁ12 back
* Jonathan Haskel and Stian Westlakeâs book, Capitalism Without Capital
* Haskelâs 2014 paper finding a ÂŁ4 return on investment for every ÂŁ1 spent on science
* 2024 UK National Centre for Universities and Business report finding that ÂŁ1 of science investment leads to ÂŁ3-4 of private investment
Credits
The Studies Show is produced by Julian Mayers at Yada Yada Productions. Weâre grateful to Jonathan Haskel for talking to us for this episode; as always, any mistakes are our own.
This is a public episode. If youâd like to discuss this with other subscribers or get access to bonus episodes, visit www.thestudiesshowpod.com/subscribe -
WoooOOOOOoooOOOOOoooo, itâs that time of year again! Itâs Halloween, so itâs time for The Studies Show hosts to face their fears, and read the research from one of the weirdest areas of science, parapsychology.
This time itâs all about psychic mediums. What does it mean to test whether someone can talk to the dead? Are we any better at doing it now than we were 100 years ago at the height of âspiritualismâ? And what do the most recent results tell us about the existence of the afterlife?
Happy Halloween! đ
This week, The Studies Show is brought to you by Semafor, the online newletter service that gives you everything you need to know about politics, business, economics, and much more in the form of email newsletters. This week we talked about Ben Smithâs newsletter on a topic thatâs just as scary as Halloween: the US Presidential Election. You can find it and more excellent newsletters at www.semafor.com/newsletters.
Show notes
* Alfred Russel Wallaceâs âDefence of Modern Spiritualismâ
* Article on Darwinâs views on spiritualism
* Peter Lamontâs book on Daniel Dunglas Home
* Sarcastic sceptical article on William Crookesâs botched investigation of Home
* Video of James Randi debunking the medium Peter Popoff
* Ray Hymanâs classic paper on cold reading
* 2021 meta-analysis on mediumship
* New Italian mediumship paper from 2022
* 2023 review on âIs Biological Death Final?â with discussion of the Drake Equation for parapsychology
Credits
The Studies Show is produced by Julian Mayers at Yada Yada Productions.
This is a public episode. If youâd like to discuss this with other subscribers or get access to bonus episodes, visit www.thestudiesshowpod.com/subscribe -
Philip Zimbardo, the psychologist whoâs best known for running the Stanford Prison Experiment in 1971, died last week. Thatâs a good excuse to discuss his legacy: what did his famous experiment tell us about the power of the situation to make normal people commit evil and sadistic acts?
In this episode of The Studies Show, Tom and Stuart go back to the original report of one of the most famous psychology studies of all time, and then see how the experiment is looking after more than 50 years of discussion and debate (spoiler: not good).
The Studies Show is brought to you by Semafor. You can sign up for their variety of online newsletters that give you in-depth information in digestible chunks. This week, we discussed the Semafor Business newsletter with Liz Hoffman, which included an interview with an electric vehicle company CEO whoâs making a bet, after something of a downturn, that EVs really are the future.
Show notes
* The first academic paper to describe the Stanford Prison Experiment, from 1973
* More details on the study, including the prisonersâ ârebellionâ, on Zimbardoâs website
* The first critique from 2019, from social psychologists
* The second critique from 2019, from Thibault le Texier
* Zimbardoâs response to the critiques
* Zimbardo on the Abu Ghraib prison torture during the Iraq War
* Zimbardoâs cringeworthy BBC interview on the effects of videogames
* Guardian critique of Zimbardoâs videogame claims by Pete Etchells
Credits
The Studies Show is produced by Julian Mayers at Yada Yada Productions.
This is a public episode. If youâd like to discuss this with other subscribers or get access to bonus episodes, visit www.thestudiesshowpod.com/subscribe -
This is a free preview of a paid episode. To hear more, visit www.thestudiesshowpod.com
Itâs a constant source of online controversy: surrogacy. A âmedical ethicsâ issue like this wouldnât usually be a case for The Studies Show, except that science is often brought into the argument.
Is it really true, as anti-surrogacy campaigners claim, that both the surrogate mother and the baby suffer serious physical and psychological problems, in large part caused by the traumatic separation after birth? In this paid-only episode, Tom and Stuart find out. To listen to the full episode and read the show notes, become a subscriber at thestudiesshowpod.com.
-
Whatâs the secret of living to 100? Well, it might be living in a âBlue Zoneâ: one of the handful of places around the world where there are apparently loads of centenarians. Except, as has been argued recently, Blue Zones might be a load of nonsense.
In this epside of The Studies Show, relative spring chickens Tom and Stuart look at some of the recent controversies in demography. Is there a limit to the human lifespan? Did someone really live 122 years? And how could researchers not have noticed the glaring problems with the whole idea of Blue Zones?
The Studies Show is brought to you by our new sponsor: Semafor. Theyâre a purveyor of high-quality newsletters offering in-depth information in digestible chunks (and they happen to be Tomâs employer). This week, we looked at Semafor Technology, in which Reed Albergotti interviewed will.i.am on AI and the future of music.
Show notes
* âMillions Now Living Will Never Dieâ
* Nature paper on âEvidence for limits to the human lifespanâ
* Stuartâs response letter
* Saul Newmanâs critique
* Guardian article and Retraction Watch article on the resulting controversy
* 2020 New Yorker article on Jeanne Calment, the 122-year-old woman
* 2004 paper on âBlue Zonesâ; 2013 paper
* Blue Zones website and âLive to 100â cookbook
* Blue Zones food guidelines
* Saul Newmanâs paper (2024 version) critiquing Blue Zones and supercentenarian research
* Saul Newman wins the Ig Nobel Prize
Credits
* The Studies Show is produced by Julian Mayers at Yada Yada Productions.
This is a public episode. If youâd like to discuss this with other subscribers or get access to bonus episodes, visit www.thestudiesshowpod.com/subscribe -
There are an awful lot of things to worry about in the world. Are âsuperbugsâ among them? That is, how worried should we be that bacteria will develop resistance to our best antibiotics, meaning infections will run rampant and even basic surgery is out of the question?
In this episode of The Studies Show, Tom and Stuart wash their hands and then dig in to the evidence on the coming antimicrobial crisis. Exactly how many deaths can we expect from untreatable resistant infections? Turns out the question is, ahem, resistant to easy answers. (Sorry).
The Studies Show is brought to you by Works in Progress magazine. Every issue, every article, gives you a new perspective on a topic you thought you knew about, or a totally new topic to think about. In their most recent issue, you can read about inflation, ancient scrolls and AI, genetic engineering, and the evolution of coffee. Weâre grateful that they support the podcast; you can read their whole site for free at worksinprogress.co.
Show notes
* Andreas BĂ€umler on âthe coming microbial crisisâ
* Possible source for how many people used to die in surgery
* BMJ article on the evidence (or lack of) showing that completing an antibiotic course is necessary
* Satirical post on how the length of a course is calculated
* Our World In Data on how many people die from cancer each year
* UK Government review of antimicrobial resistance (from 2014), giving the 10m figure.
* More mentions of 10m here (NHS), and here (Guardian)
* 2016 paper in PLOS Medicine criticising the modelling that led to the 10m figure
* September 2024 paper in the Lancet with a more up-to-date calculation
* EU report on how MRSA rates dropped
* Article on the wildly successful UK attempt to cut MRSA infections
* Study on how many antibiotics are in the clinical âpipelineâ
* Thread on studies showing that using antibiotics prophylactically cut child mortality in sub-Sarahan Africa by 14%
Credits
* The Studies Show is produced by Julian Mayers at Yada Yada Productions.
This is a public episode. If youâd like to discuss this with other subscribers or get access to bonus episodes, visit www.thestudiesshowpod.com/subscribe -
Been feeling a little strange lately? A bit impulsive, maybe? Feeling a sudden urge to get a pet cat? Sorry to say it, but maybe youâre infected with a scary mind control parasite: specifically, the paraside Toxoplasma gondii.
Or⊠maybe not. It turns out that, despite popular belief, the supposed behavioural effects of T. gondii are supported by very weak scientific evidence. In this episode of The Studies Show, Tom and Stuart explain.
The Studies Show is sponsored by Works in Progress magazine. Itâs the no.1 destination online if youâre interested in âProgress Studiesâ: research on how things got better in the past and might get better in future. Whether itâs medical technology, construction materials, or policy innovation, you can read detailed essays on it at worksinprogress.co.
Show notes
* Alex Tabbarokâs review of Parasite, arguing people took the wrong lessons from the film
* Zombie ant fungus description
* Theory for how the horsehair worm affects its host
* Scepticism about whether it involves âmind controlâ
* Description of acute toxoplasmosis
* Tiny study on rats and cat urine
* Well-cited (but also tiny) PNAS study on rats, mice, and cat urine
* Review of toxoplasma and behavioural effects
* Very useful sceptical article about toxoplasmaâs effects on rodent and human behaviour (source of the quotes on Alzheimerâs)
* Another (somewhat older) sceptical article
* Study on getting humans to smell cat (and other) urine
* Preprint on (self-reported!) toxoplasma infection and psychological traits
* Initial, smaller entrepreneurship study
* Later, larger entrepreneurship study (from Denmark)
* Meta-analysis on whether childhood cat exposure is related to schizophrenia
* Dunedin Cohort Study paper on toxoplasma and life outcomes
* âThe Toxoplasma of Rageâ on Slate Star Codex
Credits
* The Studies Show is produced by Julian Mayers at Yada Yada Productions.
This is a public episode. If youâd like to discuss this with other subscribers or get access to bonus episodes, visit www.thestudiesshowpod.com/subscribe -
This is a free preview of a paid episode. To hear more, visit www.thestudiesshowpod.com
A while back, The Studies Show covered the question of whether smartphones and social media cause mental health problems. Amazingly, that podcast didnât settle the issue, and the debate has continuedâand continued rather acrimoniously.
Psychologistsâmost notably Jonathan Haidtâare currently laying into each other, analysing, re-analysing, and meta-analysing datasets to try and work out whether âitâs the phonesâ. In this paid-only episode of The Studies Show, Tom and Stuart explain the story so far, and in the process get very disappointed by their heroes.
If you want to hear the whole episode and read the show notes, itâs easy to become a paid subscriber at thestudiesshowpod.com.
-
Itâs in a peer-reviewed paper, so it must be true. Right? Alas, you can only really hold this belief if you donât know about the peer-review system, and scientific publishing more generally.
Thatâs why, in this episode of The Studies Show, Tom and Stuart break down the traditional scientific publishing process, discuss how it leads science astray, and talk about the ways in which, if we really cared, we could make it better.
The Studies Show is brought to you by Works in Progress magazine. Their new September 2024 issue is out now, and is brimming with fascinating articles including one on lab-grown diamonds, one on genetically-engineered mosquitoes, and one on the evolution of drip coffee. Check it out at worksinprogress.co.
Show Notes
* A history of Philosophical Transactions, the oldest scientific journal
* Hooke (1665) on âA Spot in One of the Belts of Jupiterâ
* The original paper proposing the h-index
* Useful 2017 paper on perverse incentives and hypercompetition in science
* Goodhartâs Law
* Bad behaviour by scientists:
* What is a âpredatory journalâ?
* Science investigates paper mills and their bribery tactics
* The best example yet seen of salami slicing
* Brief discussion of citation manipulation
* Elisabeth Bik on citation rings
* The recent discovery of sneaked citations, hidden in the metadata of a paper
* The Spanish scientist who claims to publish a scientific paper every two days
* Science report on the fake anemone paper that the journal didnât want to retract
* Transcript of Ronald Fisherâs 1938 lecture in which he said his famous line about statisticians only being able to offer a post-mortem
* 2017 Guardian article about the strange and highly profitable world of scientific publishing
* Brian Nosekâs 2012 âscientific utopiaâ paper
* Stuartâs 2022 Guardian article on how we could do away with scientific papers altogether
* The new Octopus platform for publishing scientific resaerch
* Roger Giner-Sorollaâs article on âaesthetic standardsâ in scientific publishing and how they damage science
* The Transparency and Openness Practices guidelines that journals can be rated on
* Registered Reports - a description, and a further discussion from Chris Chambers
* 2021 paper showing fewer positive results in Registered Reports compared with standard scientific publication
Credits
The Studies Show is produced by Julian Mayers at Yada Yada Productions.
This is a public episode. If youâd like to discuss this with other subscribers or get access to bonus episodes, visit www.thestudiesshowpod.com/subscribe -
Okay, itâs time to finally answer the question: is drinking booze good or bad? Is there really a âJ-curveâ, such that itâs bad to drink zero alcohol, good to drink a little, and then bad to drink any more than that? What exactly is the âsafe levelâ of alcohol consumption, and why do the meta-analyses on this topic all seem to tell us entirely different things?
In this episode of The Studies Show, Tom and Stuart get very badly intoxicatedâwith statistics.
Weâre sponsored by Works in Progress magazine. Thereâs no better place online to find essays on the topic of âProgress Studiesââthe new field that digs deep into the data on how scientific and technological advances were made in the past, and tries to learn the lessons for the future. Check them out at worksinprogress.co.
Show notes
* Media reports say alcohol is good! Oh no wait, itâs bad. Oh, sorry, itâs actually good! No, wait, actually bad. And so on, ad infinitum
* The three conflicting meta-analyses:
* 2018 in The Lancet (âno safe levelâ)
* 2022 in The Lancet (the J-curve returns)
* 2023 in JAMA Network Open (using âoccasional drinkersâ as the comparison)
* Some of the press coverage about the J-curve age differences
* David Spiegelhalterâs piece comparing the two Lancet meta-analyses
* Tomâs piece on the idea of âsafe drinkingâ
Credits
The Studies Show is produced by Julian Mayers at Yada Yada Productions. Weâre very grateful to Sir David Spiegelhalter for talking to us about this episode (as ever, any errors are ours alone).
This is a public episode. If youâd like to discuss this with other subscribers or get access to bonus episodes, visit www.thestudiesshowpod.com/subscribe -
Everyone knows your brain hasnât finished maturing until youâre 25. Thatâs so well-known, in fact, that some countries (like Scotland) have built it into their criminal justice system, giving lower sentences to under-25sâeven very violent onesâon account of their immature brains.
But in this episode of The Studies Show, Tom and Stuart discuss what the evidence really says about when the brain maturesâand the trickiness of linking important policy decisions to the science.
The Studies Show is brought to you by Works in Progress magazine, who donât just have their magazine (at worksinprogress.co), but also have a Substack with a range of extra articles. Itâs all thoughtful, thought-provoking stuffâand its all free. Find it at worksinprogress.news.
Show notes
* The three Scottish criminal cases:
* âGolf club thug spared jail over ageâ
* Community service not jail for rape (and the conviction later quashed)
* 3 year-jail sentence for rape
* The Scottish Sentencing Council guidelines from 2022
* The commissioned review by University of Edinburgh on brain maturation
* Useful 2022 Nature paper on structural âbrain charts for the human lifespanâ
* 2024 preprint on the lifespan trajectory of functional brain activation for cognitive control
* 2023 paper with 10,000 people aged 8-35 measured on executive function tests
* BBC Science Focus article by Dean Burnett on the âbrain matures at age 25â idea
* âThe myth of the 25-year-old brainâ in Slate
* Stuartâs i article from last year on the Scottish Sentencing Council
Credits
The Studies Show is produced by Julian Mayers at Yada Yada Productions.
This is a public episode. If youâd like to discuss this with other subscribers or get access to bonus episodes, visit www.thestudiesshowpod.com/subscribe - Laat meer zien
