{"id":246597,"date":"2026-10-13T19:06:39","date_gmt":"2026-10-13T19:06:39","guid":{"rendered":"https:\/\/yogaesoteric.net\/?p=246597"},"modified":"2026-10-13T19:06:39","modified_gmt":"2026-10-13T19:06:39","slug":"the-vast-majority-of-published-psychology-and-human-behaviour-studies-are-false","status":"publish","type":"post","link":"https:\/\/yogaesoteric.net\/en\/the-vast-majority-of-published-psychology-and-human-behaviour-studies-are-false\/","title":{"rendered":"The vast majority of published psychology and human behaviour studies are false"},"content":{"rendered":"<p><em>An alarming amount of poor-quality academic and scientific research has been discovered in recent years. Inconsistent research results, based on poor methodologies or of limited practical impact, are too often turned into big, broad, but unreliable claims \u2013 which are then amplified by politicians or the media to support a narrative or campaign.<\/em><\/p>\n<p><em>Social science studies are no exception. The vast majority of psychology research claims are false. Until the incentives for research transform, the public will continue to be fed a steady diet of bold claims about human behaviour built on an unsteady foundation.<\/em><\/p>\n<p><em><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-246604\" src=\"https:\/\/yogaesoteric.net\/wp-content\/uploads\/2026\/10\/studies1.jpg\" alt=\"\" width=\"560\" height=\"314\" srcset=\"https:\/\/yogaesoteric.net\/wp-content\/uploads\/2026\/10\/studies1.jpg 739w, https:\/\/yogaesoteric.net\/wp-content\/uploads\/2026\/10\/studies1-300x168.jpg 300w\" sizes=\"auto, (max-width: 560px) 100vw, 560px\" \/><\/em><strong>Why So Many Social Science Claims Are False<\/strong><\/p>\n<p>One of the most urgent questions facing society today is the potential impact of AI on education and labour markets. So, it\u2019s no surprise that two scientists attempted to provide an answer, producing a meta-analysis suggesting that incorporating ChatGPT in schooling dramatically improved student outcomes. Social media and online <a href=\"https:\/\/aiadvisoryboards.wordpress.com\/2025\/05\/10\/the-effect-of-chatgpt-on-students-learning-performance-learning-perception-and-higher-order-thinking-insights-from-a-meta-analysis-may-2025\/\">sources<\/a> promoted the 2025 study as a beacon of bright light.<\/p>\n<p>The problem is that the researchers\u2019 conclusions were later found to be unreliable, and the study was <a href=\"https:\/\/www.nature.com\/articles\/s41599-026-07310-z\">retracted<\/a> in April \u2013 another blow to the public\u2019s faith in science.<\/p>\n<p>Scientists are increasingly chasing answers to big questions in fields from health care to climate change to AI. The academic research industry incentivises them to produce the biggest possible findings that make for splashy headlines and career promotions. But such discoveries are rare in science and, too often, the result is widespread exaggeration, dodgy methods and miscommunication.<\/p>\n<p>\u201c<em>The incentive structure of modern science is such that a \u2018simplify, then exaggerate\u2019 strategy has become dominant, even if only tacitly<\/em>,\u201d according to a recent <a href=\"https:\/\/online.ucpress.edu\/collabra\/article\/7\/1\/24091\/117222\/A-Call-for-Greater-Modesty-in-Psychology-and\">academic review<\/a>. \u201c<em>To get published in leading journals, to be awarded grants and to be hired as a postdoc or faculty member, a system-wide bias for novelty, exaggeration and storytelling has emerged<\/em>.\u201d<\/p>\n<p>An alarming amount of poor-quality academic and scientific research has been discovered in recent years. Hindawi, formerly a part of major science publisher Wiley, <a href=\"https:\/\/katinamagazine.org\/content\/article\/open-knowledge\/2026\/what-the-collapse-of-hindawi-reveals-systemic-risk\">had to retract<\/a> thousands of science articles, many of them alleged to have been produced by paper mills that generate reams of reports of studies that never existed.<\/p>\n<p>While cases of outright fraud have received wide attention, a more subtle infection has spread within the research community: Research results that are inconsistent, based on poor methodologies or are of limited practical impact are too often turned into big, broad, but unreliable claims that, over time, reduce public confidence in science.<\/p>\n<p>Several recent high-profile retractions of scientific papers highlight how broad scientific claims can be built upon questionable data. A <a href=\"https:\/\/retractionwatch.com\/2026\/06\/29\/sex-pay-ban-paper-sweden-retraction-journal-population-economics\/#more-135218\">recent paper<\/a> asserted that banning sex work increases rapes. The sex work paper got significant attention on virtual communication networks before some scholars pointed out they couldn\u2019t replicate the findings. In another major case, economists estimated that climate change would have a devastating economic toll on the world in a paper that was widely covered and influential in banking. However, it was ultimately <a href=\"https:\/\/archive.is\/20251211074834\/https:\/www.nytimes.com\/2025\/12\/03\/business\/economy\/study-climate-damage-retracted.html#selection-831.5-831.58\">retracted<\/a> after other scholars alleged major errors.<\/p>\n<p>In each case, science sleuths found that the dramatic claims did not reflect reality. While the number of retractions has soared over the past two decades to several thousand a year, according to the watchdog group Retraction Watch, experts believe only a small fraction of questionable work gets caught.<\/p>\n<p><strong>Flip a Coin<\/strong><\/p>\n<p>Lee Jussim, distinguished professor of psychology at Rutgers University and frequent critic of social science, has estimated that the vast majority of psychology research claims are false. He also noted that the ability of psychology to replicate most findings is no better than a coin toss.<\/p>\n<p>At the core of the crisis is a broken system that pressures researchers to produce more and more papers in high-profile journals that favour bold rather than incremental (or null) findings. The incentives include:<\/p>\n<ul>\n<li>Academic reward systems that grant promotions, tenure and grant funding to researchers based on the number of publications and bold claims they produce rather than thoughtful scholarship.<\/li>\n<li>Journals that often attract subscription dollars and news attention for flashy findings.<\/li>\n<li>News media that win subscriptions and clicks with dramatic, often surprising claims about human behaviour.<\/li>\n<li>Politicians who cherry-pick alarmist science claims to promote their favourite policies while overlooking contradictory evidence.<\/li>\n<\/ul>\n<p>\u201c<em>The growing competition and \u2018publish or perish\u2019 culture in academia might conflict with the objectivity and integrity of research, because it forces scientists to produce \u2018publishable\u2019 results at all costs<\/em>,\u201d Daniele Fanelli, a meta-scientist at Heriot-Watt University and the London School of Economics, noted in a recent paper.<\/p>\n<p>The system set up to tamp down sensationalism and flawed findings \u2013 peer review \u2013 is so overwhelmed by the flood of research papers in recent years that it can\u2019t begin to pull all the weeds from the garden of science. Peer reviewers are busy scholars who are mostly unpaid and stretched too thin, even with the help of emerging AI tools that have their own problems with accuracy. One recent paper estimated that, in any given year, peer reviewers collectively work the equivalent of 15,000 years on scientific papers, which, if actually paid, would cost about $2.5 billion for US, Chinese and UK reviewers alone.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-246598\" src=\"https:\/\/yogaesoteric.net\/wp-content\/uploads\/2026\/10\/money2.avif\" alt=\"\" width=\"560\" height=\"328\" srcset=\"https:\/\/yogaesoteric.net\/wp-content\/uploads\/2026\/10\/money2.avif 1630w, https:\/\/yogaesoteric.net\/wp-content\/uploads\/2026\/10\/money2-300x176.avif 300w, https:\/\/yogaesoteric.net\/wp-content\/uploads\/2026\/10\/money2-1024x600.avif 1024w, https:\/\/yogaesoteric.net\/wp-content\/uploads\/2026\/10\/money2-768x450.avif 768w, https:\/\/yogaesoteric.net\/wp-content\/uploads\/2026\/10\/money2-1536x900.avif 1536w, https:\/\/yogaesoteric.net\/wp-content\/uploads\/2026\/10\/money2-357x210.avif 357w\" sizes=\"auto, (max-width: 560px) 100vw, 560px\" \/><\/p>\n<p>Even when errors are detected, correcting and retracting papers is a contentious process that often takes years. Publishers and editors fear reputational damage and lawsuits from researchers, providing few incentives for correcting the record even if fraud is suspected.<\/p>\n<p><strong>Numbers Game<\/strong><\/p>\n<p>A common type of research exaggeration stems from the promotion of \u201c<em>statistically significant<\/em>\u201d findings. The seriousness of the phrase may lead the public to interpret the findings as reliable and practically useful. But often that\u2019s not the case. That\u2019s because most social science and medical findings are very weak, so weak they might be produced by methodological flaws (or <a href=\"https:\/\/meehl.umn.edu\/sites\/meehl.umn.edu\/files\/files\/147appraisingamending.pdf\">crud<\/a>) in those studies. Scientists are nonetheless incentivised to highlight the supposed importance of statistically significant studies in order to get attention, even if they don\u2019t warrant it.<\/p>\n<p>As an analogy, consider the difference between a butterfly and an anvil landing on one\u2019s head. Both exert measurable weight on the head and, as such, both produce \u201c<em>statistically significant<\/em>\u201d results. But the magnitude of impact, the effect size, differs enormously. Most people would be far more concerned to avoid an anvil landing on their head than a butterfly. That\u2019s why \u201c<em>statistically significant<\/em>\u201d tells us nothing about the practical importance of a finding.<\/p>\n<p>Even a finding with a standard effect size may not be reliable. For instance, social psychologist Daryl Bem <a href=\"https:\/\/www.apa.org\/pubs\/journals\/features\/psp-a0021524.pdf\">published<\/a> a report in one of the American Psychological Association\u2019s leading journals suggesting that many ordinary people had extrasensory perception (ESP) or the ability to predict the future. Such an implausible finding raised considerable controversy at the time.<\/p>\n<p>The problem was that Bem used weak research methods common throughout the social sciences to publish impossible results. Long a defender of ESP, Bem had in an <a href=\"https:\/\/koestlerunit.wordpress.com\/wp-content\/uploads\/2015\/06\/bem-honorton-1994.pdf\">earlier paper<\/a> explicitly noted that the effects of ESP appeared similar to findings in other areas of psychology, saying, \u201c<em>The mean effect size is quite respectable in comparison with other controversial research areas of human performance<\/em>.\u201d Bem did not respond to requests for comment.<\/p>\n<p>Professor Fanelli said that poor training and unrealistic expectations help explain why social scientists miscommunicate data. \u201c<em>I think that part of a useful cultural transformation would be towards a greater understanding and acceptance of the limitations of social science<\/em>,\u201d Fanelli said in an email. \u201c<em>Instead, a lot of it seems to have in some ways reinforced what was deemed the \u2018cult of statistical significance,\u2019 a mechanical and simplistic use of [statistical significance] as a paragon of validity<\/em>.\u201d<\/p>\n<p>Behind this presentation of hyped results is an academic publishing industry of five big companies with handsome profit margins. The Big Five, as they are known (Elsevier, Sage, Springer Nature, Taylor &amp; Francis and Wiley), along with research grant funders, academic tenure evaluations, and the media incentivise scholars to stretch for the dramatic and oversell weak results. In science, a negative finding that shows no effect is as important as a positive one. But few negative findings get published.<\/p>\n<p>Policymakers tend to make the situation worse. Catherine Knibbs, a psychotherapist and founder of Children and Tech, had been involved in some of the conversations around the controversial UK push for social media bans for youth under 16. She suggests policymakers often approach science with set conclusions, not open questions, and appear incurious about data that doesn\u2019t fit their agendas.<\/p>\n<p>\u201c<em>To be honest I feel science is complex and whilst I love that about it, I [feel] quite alone in this<\/em>,\u201d Knibbs said in an email. \u201c<em>People are often skimming the stats and looking for [evidence that confirms their beliefs]. Not many people have time to slow down and use their slower cognisant processes<\/em>.\u201d<\/p>\n<p><strong>Pushing for Reform<\/strong><\/p>\n<p>The good news is that a growing number of researchers are pushing for reforms that could improve the integrity of scientific findings. One promising sign is the growth of the \u201c<em>open science movement<\/em>,\u201d which encourages the pre-registration of studies. This reduces the ability of researchers to mangle their data analysis to produce preferred results. And the movement\u2019s promotion of greater data transparency allows for more confirmation of findings.<\/p>\n<p>Brian Nosek, a professor of psychology at the University of Virginia who is leading the open science movement, struck a hopeful tone. \u201c<em>My most optimistic take is that we have established a stronger culture of self-scrutiny and continuous improvement<\/em>,\u201d he said. \u201c<em>I don\u2019t know how successful the practice modifications have been, but I believe that experimenting with new research methods and committing to evaluating what works and what doesn\u2019t will lead us in positive directions<\/em>.\u201d<\/p>\n<p>Some scholars are breaking away from the Big Five academic publishers by beginning their own non-profit scientific journals. In <a href=\"https:\/\/www.nature.com\/articles\/d41586-023-01391-5\">some cases<\/a>, this has been the result of exorbitant fees that journals charge authors for making papers public. A new <a href=\"https:\/\/retractionwatch.com\/2026\/07\/31\/federal-lawsuit-major-publishers-article-processing-charges-false-claims-act\/#more-135556\">federal legal<\/a> case likewise accuses the Big Five of defrauding the government through unreasonable publishing charges, often paid for by government grants. Aside from the financial costs taken on by scholars, independent journals also potentially free scholars from a heavy focus on positive findings or publication bias.<\/p>\n<p>A small number of research institutions are also aiming to directly address some of the problematic incentives. In awarding promotions and tenure, they are putting less emphasis on the number of papers that researchers produce and the prestige of the journals where they are published. Instead, the quality of the paper is what counts.<\/p>\n<p>Professor Ric Ferraro, editor of <em>Current Psychology<\/em>, emphasised that not all scholars or journals are bad actors. Some aim to do what is right and produce solid research. But breaking this cycle of perverse incentives will be difficult, as too many benefit from it, from scholars and academic journals to news media and politicians.<\/p>\n<p>Until the incentives for research transform more broadly, the public will continue to be fed a steady diet of bold claims about human behaviour built on an unsteady foundation.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>yogaesoteric<br \/>\nOctober 13, 2026<\/strong><\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>An alarming amount of poor-quality academic and scientific research has been discovered in recent years. Inconsistent research results, based on poor methodologies or of limited practical impact, are too often turned into big, broad, but unreliable claims \u2013 which are then amplified by politicians or the media to support a narrative or campaign. Social science [&hellip;]<\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_uf_show_specific_survey":0,"_uf_disable_surveys":false,"footnotes":""},"categories":[1180],"tags":[],"class_list":["post-246597","post","type-post","status-publish","format-standard","hentry","category-information-control-for-social-manipulation-3480-en"],"_links":{"self":[{"href":"https:\/\/yogaesoteric.net\/en\/wp-json\/wp\/v2\/posts\/246597","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/yogaesoteric.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/yogaesoteric.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/yogaesoteric.net\/en\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/yogaesoteric.net\/en\/wp-json\/wp\/v2\/comments?post=246597"}],"version-history":[{"count":1,"href":"https:\/\/yogaesoteric.net\/en\/wp-json\/wp\/v2\/posts\/246597\/revisions"}],"predecessor-version":[{"id":246607,"href":"https:\/\/yogaesoteric.net\/en\/wp-json\/wp\/v2\/posts\/246597\/revisions\/246607"}],"wp:attachment":[{"href":"https:\/\/yogaesoteric.net\/en\/wp-json\/wp\/v2\/media?parent=246597"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/yogaesoteric.net\/en\/wp-json\/wp\/v2\/categories?post=246597"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/yogaesoteric.net\/en\/wp-json\/wp\/v2\/tags?post=246597"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}