Credibilidad o barbarie: cómo la crisis de replicación ha desatado una revolución en Psicología y otras ciencias

Óscar Lecuona; Guido Corradi; Ariadna Angulo Brunet; Eduardo García Garzón

Credibilidad o barbarie: cómo la crisis de replicación ha desatado una revolución en Psicología y otras ciencias

Oscar Lecuona de la Cruz ^[1] ; Guido Corradi ^[2] ; Ariadna Angulo-Brunet ^[3] ; Eduardo García-Garzón ^[4]
1. [1] Universidad Complutense de Madrid
  
  Universidad Complutense de Madrid
  
  Madrid, España
2. [2] Universidad Villanueva
  
  Universidad Villanueva
  
  Madrid, España
3. [3] Universitat Oberta de Catalunya
  
  Universitat Oberta de Catalunya
  
  Barcelona, España
4. [4] Shakers, S. L.
Mostrar afiliaciones +
Localización: Acción psicológica, ISSN 1578-908X, Vol. 22, Nº. 1, 2025 (Ejemplar dedicado a: Nuevos avances metodológicos en Psicología / Belén Fernández Castilla (aut.), José Ángel Martínez Huertas (aut.)), págs. 115-136
Idioma: español
DOI: 10.5944/ap.22.1.43231
Títulos paralelos:
- Credibility or barbarism: How the replication crisis sparked a revolution in psychology and other sciences
Enlaces
- Texto completo
Resumen
- español
  La ciencia actual vive tiempos críticos y revolucionarios. El surgimiento de la “crisis de replicación” ha supuesto un reto estructural histórico, junto con mala práxis científica y problemas derivados con una estructura de incentivos perversa en el sistema de publicaciones. Como respuesta, se han propuesto diversas reformas en la comunidad científica conocidas como la “revolución de la credibilidad”. En este artículo revisamos estos sucesos, su cronología, características principales, y su relación entre ellos. De esta forma, buscamos divulgar y formar a los lectores en las nuevas prácticas de la comunidad científica en Psicología y otras ciencias para producir y consumir una ciencia más íntegra y replicable. En definitiva, concienciar y formar parte de una mejor comunidad científica para los retos del siglo XXI.
- English
  Current science is experiencing critical and revolutionary times. The emergence of the "replication crisis" has posed a historical structural challenge, alongside issues of scien-tific malpractice and problems stemming from a perverse incentive structure in scientific publishing. In response, various reforms have been engaged within the scientific community, known as the "credibility revolution". This ar-ticle reviews these events, how they developed, their main characteristics, and their interconnections. In doing so, we aim to inform and educate readers about these aspects. In addition, we propose new Best Research Practices in the scientific community in psychology and other fields to produce and consume more replicable and credible sci-ence. Ultimately, we seek to raise awareness and encour-age participation in a better scientific community to meet the challenges of the 21st century.
Referencias bibliográficas
- Aczel, B., Szaszi, B. y Holcombe, A. O. (2021). A Billion-Dollar Donation: Estimating the Cost of Researchers’ Time Spent on Peer Review....
- Alipourfard, N., Arendt, B., Benjamin, D. M., Benkler, N., Bishop, M., Burstein, M., Bush, M., Caverlee, J., Chen, Y., Clark, C., Dreber Almenberg,...
- Al-Khatib, A. y Teixeira da Silva, J. A. (2016). Stings, Hoaxes and Irony Breach the Trust Inherent in Scientific Publishing. Publishing Research...
- Anderson, S. F. y Liu, X. (2023). Questionable Research Practices and Cumulative Science: The Consequences of Selective Reporting on Effect...
- Ansede, M. (2024, octubre 16). La editorial Springer Nature retira 75 estudios del rector de Salamanca y sus colaboradores por prácticas fraudulentas....
- Baker, M. (2016). 1,500 Scientists Lift the Lid on Reproducibility. Nature, 533(7604), 452–454. https://doi.org/10.1038/533452a
- Bartoš, F., Maier, M., Shanks, D. R., Stanley, T. D., Sladekova, M. y Wagenmakers, E.-J. (2023). Meta-analyses in Psychology often Overestimate...
- BBC Mundo. (2024, Noviembre). Quién es Robert Kennedy Jr., el activista antivacunas y heredero de la dinastía Kennedy al que Trump elige para...
- Bem, D. J. (2011). Feeling the Future: Experimental Evidence for Anomalous Retroactive Influences on Cognition and Affect. Journal of Personality...
- Bem, D., Tressoldi, P., Rabeyron, T., y Duggan, M. (2015). Feeling the Future: A Meta-Analysis of 90 Experiments on the Anomalous Anticipation...
- Benjamin, D. J., Berger, J. O., Johannesson, M., Nosek, B. A., Wagenmakers, E.-J., Berk, R., Bollen, K. A., Brembs, B., Brown, L., Camerer,...
- Berberi, I., y Roche, D. G. (2022). No Evidence that Mandatory Open Data Policies Increase Error Correction. Nature Ecology & Evolution,...
- Bernal, I. y Perakakis, P. (2023). No-pay Publishing: Use Institutional Repositories. Nature, 619(7971), 698–698. https://doi.org/10.1038/d41586-023-02315-z
- Brainard, J. (2023). Fast-growing Open-Access Journals Stripped of coveted Impact Factors. Science, 379(6639), 1283–1284. https://doi.org/10.1126/science.adi0098
- Brembs, B., Button, K., y Munafò, M. (2013). Deep Impact: Unintended Consequences of Journal Rank. Frontiers in Human Neuroscience, 7, Artículo...
- Brembs, B., Huneman, P., Schönbrodt, F., Nilsonne, G., Susi, T., Siems, R., Perakakis, P., Trachana, V., Ma, L. y Rodriguez-Cuadrado, S. (2023)....
- Bohannon, J. (2016). About 40% of economics experiments fail replication survey. Science, 3. https://www.science.org/content/article/about-40-economics-experiments-fail-replication-survey
- Boyce, V., Prystawski, B., Abutto, A. B., Chen, E. M., Chen, Z., Chiu, H., Ergin, I., Gupta, A., Hu, C., Kemmann, B., Klevak, N., Lua, V....
- Butler, L.-A., Matthias, L., Simard, M.-A., Mongeon, P. y Haustein, S. (2023). The Oligopoly’s Shift to Open Access: How the Big Five Academic...
- Camerer, C. F., Dreber, A., Forsell, E., Ho, T.-H., Huber, J., Johannesson, M., Kirchler, M., Almenberg, J., Altmejd, A., Chan, T., Heikensten,...
- Cardeña, E. (2018). The Experimental Evidence for Parapsychological Phenomena: A Review. American Psychologist, 73(5), 663–677. https://doi.org/10.1037/amp0000236
- Catazaro, M. (2023). Saudi Universities Entice Top Scientists to Switch Affiliations—Sometimes with Cash. Nature, 617(7961), 446–447. https://doi.org/10.1038/d41586-023-01523-x
- Chu, J. S. G. y Evans, J. A. (2021). Slowed Canonical Progress in large Fields of Science. Proceedings of the National Academy of Sciences,...
- Cobey, K. D., Lalu, M. M., Skidmore, B., Ahmadzai, N., Grudniewicz, A. y Moher, D. (2018). What is a Predatory Journal? A Scoping Review....
- Doyen, S., Klein, O., Pichon, C. L. y Cleeremans, A. (2012). Behavioral Priming: It's All in the Mind, but Whose Mind? PloS one, 7(1),...
- Edwards, M. A. y Roy, S. (2017). Academic Research in the 21st Century: Maintaining Scientific Integrity in a Climate of Perverse Incentives...
- Fleerackers, A., Ratcliff, C. L., Wicke, R., King, A. J. y Jensen, J. D. (2024). Public Understanding of Preprints: How Audiences Make Sense...
- Enserink, M. (2012). Final Report: Stapel Affair Points to Bigger Problems in Social Psychology. Science. https://www.science.org/content/article/final-report-stapel-affair-points-bigger-problems-social-psychology
- Eronen, M. I. y Bringmann, L. F. (2021). The Theory Crisis in Psychology: How to Move Forward. Perspectives on Psychological Science, 16(4),...
- Errington, T. M., Mathur, M., Soderberg, C. K., Denis, A., Perfito, N., Iorns, E. y Nosek, B. A (2021). Investigating the Replicability of...
- Feynman, R. P. (1998). Cargo Cult Science*. En J. Williams (Ed.), The Art and Science of Analog Circuit Design (pp. 55–61). Newnes. https://doi.org/10.1016/B978-075067062-3/50008-X
- Flake, J. K., y Fried, E. I. (2020). Measurement Schmeasurement: Questionable Measurement Practices and How to Avoid Them. Advances in Methods...
- Forozish, A. O. (2024). How the Credibility Revolution Created a Paradigm Shift. Available at SSRN 4744474. https://doi.org/10.2139/ssrn.4744474
- Gertler, P., Galiani, S. y Romero, M. (2018). How to Make Replication the Norm. Nature, 554(7693), 417–419. https://doi.org/10.1038/d41586-018-02108-9
- Gerrits, R. G., Jansen, T., Mulyanto, J., van den Berg, M. J., Klazinga, N. S. y Kringos, D. S. (2019). Occurrence and Nature of Questionable...
- Giner-Sorolla, R. (2012). Science or Art? How Aesthetic Standards Grease the Way through the Publication Bottleneck but Undermine Science....
- Gomez, C. J., Herman, A. C. y Parigi, P. (2022). Leading Countries in Global Science Increasingly Receive more Citations than other Countries...
- Greenland, S., Senn, S. J., Rothman, K. J., Carlin, J. B., Poole, C., Goodman, S. N. y Altman, D. G. (2016). Statistical Tests, P Values,...
- Grossmann, A. y Brembs, B. (2021). Current Market Rates for Scholarly Publishing Services. F1000Research, 10, 20. https://doi.org/10.12688/f1000research.27468.2
- Hardwicke, T. E. y Wagenmakers, E.-J. (2023). Reducing Bias, Increasing Transparency, and Calibrating Confidence with Preregistration. Nature...
- Haig, B. D. (2017). Tests of Statistical Significance Made Sound. Educational and Psychological Measurement, 77(3), 489–506. https://doi.org/10.1177/0013164416667981
- Hussey, I., Alsalti, T., Bosco, F., Elson, M. y Arslan, R. (2025). An Aberrant Abundance of Cronbach’s Alpha Values at. 70. Advances in Methods...
- Ioannidis, J. P. A. (2005). Why Most Published Research Findings are False. PLOS Medicine, 2(8), Artículo e124. https://doi.org/10.1371/journal.pmed.0020124
- Ioannidis, J. P. A. (2008). Why Most Discovered True Associations are Inflated. Epidemiology, 19(5), 640–648. https://doi.org/10.1097/EDE.0b013e31818131e7
- Jarke, H., Anand-Vembar, S., Alzahawi, S., Andersen, T. L., Bojanić, L., Carstensen, A., Feldman, G., Garcia-Garzon, E., Kapoor, H., Lewis,...
- Jobst, L. J., Bader, M. y Moshagen, M. (2023). A tutorial on assessing statistical power and determining sample size for structural equation...
- Kang, H. (2021). Sample size determination and power analysis using the G*Power software. Journal of Educational Evaluation for Health Professions,...
- Kekecs, Z., Palfi, B., Szaszi, B., Szecsi, P., Zrubka, M., Kovacs, M., Bakos, B. E., Cousineau, D., Tressoldi, P., Schmidt, K., Grassi, M.,...
- Klein, R. A., Vianello, M., Hasselman, F., Adams, B. G., Adams, R. B., Jr., Alper, S., Aveyard, M., Axt, J. R., Babalola, M. T., Bahník, Š.,...
- Korbmacher, M., Azevedo, F., Pennington, C. R., Hartmann, H., Pownall, M., Schmidt, K., Elsherif, M., Breznau, N., Robertson, O., Kalandadze,...
- Kruschke, J. K. (2021). Bayesian Analysis Reporting Guidelines. Nature Human Behaviour, 5(10), 1282-1291. https://doi.org/10.1038/s41562-021-01177-7
- Lakens, D. (2022). Sample Size Justification. Collabra: Psychology, 8(1), Artículo 33267. https://doi.org/10.1525/collabra.33267
- Lakens, D. (2024). When and how to deviate from a preregistration. Collabra: Psychology, 10(1), Artículo 117094. https://doi.org/10.1525/collabra.117094
- Lakens, D., Hilgard, J. y Staaks, J. (2016). On the Reproducibility of Meta-Analyses: Six Practical Recommendations. BMC Psychology, 4(1),...
- Lakens, D., Mesquida, C., Rasti, S., y Ditroilo, M. (2024). The benefits of preregistration and registered reports. Evidence-Based Toxicology,...
- Leitgöb, H., Seddig, D., Asparouhov, T., Behr, D., Davidov, E., De Roover, K., Jak, S., Meitinger, K., Menold, N., Muthén, B., Rudnev, M.,...
- Liverpool, L. (2023). AI Intensifies Fight against ‘Paper Mills’ that churn out Fake Research. Nature, 618(7964), 222–223. https://doi.org/10.1038/d41586-023-01780-w
- Maddi, A. y Sapinho, D. (2023). On the Culture of Open Access: The Sci-hub paradox. Scientometrics, 128(10), 5647–5658. https://doi.org/10.1007/s11192-023-04792-5
- Maier, M., y Lakens, D. (2022). Justify your Alpha: A Primer on two Practical Approaches. Advances in Methods and Practices in Psychological...
- Mayo, D. G. (2018). Statistical Inference as Severe Testing: How to get Beyond the Statistics Wars. Cambridge University Press.
- Mayoni, S. (2022, diciembre 12). Scientific publishers are reaping huge profits from the work of researchers, and the universities are paying...
- McShane, B. B., Gal, D., Gelman, A., Robert, C. y Tackett, J. L. (2019). Abandon Statistical Significance. The American Statistician, 73(sup1),...
- Mole, B. (2024, enero 22). Top Harvard cancer researchers accused of scientific fraud; 37 studies affected. Ars Technica. https://arstechnica.com/science/2024/01/top-harvard-cancer-researchers-accused-of-scientific-fraud-37-studies-affected/
- Nagy, T., Hergert, J., Elsherif, M., Wallrich, L., Schmidt, K., Waltzer, T., Payne, J. W., Gjoneska, B., Seetahul, Y., Wang, Y. A., Scharfenberg,...
- Nelson, L. D., Simmons, J. y Simonsohn, U. (2018). Psychology’s Renaissance. Annual Review of Psychology, 69(1), 511–534. https://doi.org/10.1146/annurev-psych-122216-011836
- Nuijten, M. B. y Wicherts, J. M. (2024). Implementing Statcheck during Peer Review is Related to a Steep Decline in Statistical-Reporting...
- Nielsen, M. W. y Andersen, J. P. (2021). Global citation inequality is on the rise. Proceedings of the National Academy of Sciences of the...
- Nosek, B. A., Hardwicke, T. E., Moshontz, H., Allard, A., Corker, K. S., Dreber, A., Fidler, F., Hilgard, J., Kline Struhl, M., Nuijten, M....
- Nosek, B. A., Spies, J. R. y Motyl, M. (2012). Scientific Utopia: II. Restructuring Incentives and Practices to Promote Truth over Publishability....
- Open Science Collaboration. (2015). Estimating the Reproducibility of Psychological Science. Science, 349(6251), Artículo aac4716 https://doi.org/10.1126/science.aac4716
- Park, M., Leahey, E. y Funk, R. J. (2023). Papers and Patents are Becoming Less Disruptive over time. Nature, 613(7942), 138–144. https://doi.org/10.1038/s41586-022-05543-x
- Parsons, S. (2022). Exploring Reliability Heterogeneity with Multiverse Analyses: Data Processing Decisions Unpredictably Influence Measurement...
- Parsons, J. A., Alperin, J. P., Bishop, D. V. M., Bowman, T. D., Crick, T., de Rijcke, S., Fortunato, S., Frassl, M. A., Guggenheim, C., Hahnel,...
- Pek, J. y Flora, D. B. (2018). Reporting Effect Sizes in Original Psychological Research: A Discussion and Tutorial. Psychological Methods,...
- Perakakis, P. (2021, mayo 3). ¿Qué son los «transformative agreements» y qué necesitamos saber antes de utilizarlos? Pandelis Perakakis. https://pandelisperakakis.info/2021/05/03/que-son-los-transformative-agreements-y-que-necesitamos-saber-antes-de-utilizarlos/
- Retraction Watch (2015, junio 16) The Retraction Watch Leaderboard. https://retractionwatch.com/the-retraction-watch-leaderboard/. Accedido...
- Retraction Watch. (2024, marzo 18). Papers and peer reviews with evidence of ChatGPT writing. Retraction Watch. https://retractionwatch.com/papers-and-peer-reviews-with-evidence-of-chatgpt-writing/....
- Rosenthal, R. (1979). The File Drawer Problem and Tolerance for Null Results. Psychological Bulletin, 86(3), 638–641. https://doi.org/10.1037/0033-2909.86.3.638
- Ruggeri, K., Većkalov, B., Bojanić, L., Andersen, T. L., Ashcroft-Jones, S., Ayacaxli, N., Barea-Arroyo, P., Berge, M. L., Bjørndal, L. D.,...
- Schiavone, S. R., y Vazire, S. (2023). Reckoning with our Crisis: An agenda for the Field of Social and Personality Psychology. Perspectives...
- Silverstein, P., Elman, C., Montoya, A., McGillivray, B., Pennington, C. R., Harrison, C. H., Steltenpohl, C. N., Röer, J. P., Corker, K....
- Simmons, J. P., Nelson, L. D. y Simonsohn, U. (2011). False-positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows...
- Simonsohn, U., Nelson, L. D. y Simmons, J. P. (2014). P-curve: A Key to the File-Drawer. Journal of Experimental Psychology: General, 143(2),...
- Simonsohn, U., Nelson, L. y Simmons, J. (2023, septiembre 1). [113] Data Litigada: Thank You (And An Update). Data Colada. https://datacolada.org/113
- Stagge, J. H., Rosenberg, D. E., Abdallah, A. M., Akbar, H., Attallah, N. A. y James, R. (2019). Assessing Data Availability and Research...
- Steegen, S., Tuerlinckx, F., Gelman, A. y Vanpaemel, W. (2016). Increasing Transparency through a Multiverse Analysis. Perspectives on Psychological...
- Stokel-Walker, C. (2023). ChatGPT listed as author on Research Papers: Many Scientists Disapprove. Nature, 613(7945), 620–621. https://doi.org/10.1038/d41586-023-00107-z
- The Economist. (2023) There is a Worrying amount of Fraud in Medical Research. https://www.economist.com/science-and-technology/2023/02/22/there-is-a-worrying-amount-of-fraud-in-medical-research
- Weissgerber, T. L., Milic, N. M., Winham, S. J. y Garovic, V. D. (2015). Beyond Bar and Line Graphs: Time for a New Data Presentation Paradigm....
- Tsui, A. S. (2022). From Traditional Research to Responsible Research: The Necessity of Scientific Freedom and Scientific Responsibility for...
- UNESCO. (2022). Understanding open science—UNESCO Biblioteca Digital (UNESCO open science toolkit, p. 6) [Factsheet]. https://doi.org/10.54677/UTCD9302
- Van den Akker, O. R., van Assen, M. A. L. M., Bakker, M., Elsherif, M., Wong, T. K. y Wicherts, J. M. (2024). Preregistration in Practice:...
- Van Noorden, R. (2023a). Medicine is Plagued by Untrustworthy Clinical Trials. How many Studies are Faked or Flawed? Nature, 619(7970), 454–458....
- Van Noorden, R. (2023b). More than 10,000 research papers were retracted in 2023—A new record. Nature, 624(7992), 479–481. https://doi.org/10.1038/d41586-023-03974-8
- Vazire, S. (2018). Implications of the Credibility Revolution for Productivity, Creativity, and Progress. Perspectives on Psychological Science,...
- Walker, R. y Rocha da Silva, P. (2015). Emerging Trends in Peer Review—A Survey. Frontiers in Neuroscience, 9, Artículo 169. https://doi.org/10.3389/fnins.2015.00169
- Wagenmakers, E.-J., Marsman, M., Jamil, T., Ly, A., Verhagen, J., Love, J., Selker, R., Gronau, Q. F., Šmíra, M., Epskamp, S., Matzke, D.,...
- Wagner III, J. A. (2022). The Influence of Unpublished Studies on Results of Recent Meta-Analyses: Publication Bias, the File Drawer Problem,...
- Wang, H., Chen, Y., Lin, Y., Abesig, J., Wu, I. X. y Tam, W. (2021). The Methodological Quality of Individual Participant Data Meta-Analysis...
- White, N., Parsons, R., Collins, G. y Barnett, A. (2023). Evidence of Questionable Research Practices in Clinical Prediction Models. BMC Medicine,...
- Wingen, T., Berkessel, J. B. y Dohle, S. (2022). Caution, preprint! Brief Explanations Allow Nonscientists to Differentiate between Preprints...
- Wolfram, D., Wang, P., Hembree, A. y Park, H. (2020). Open Peer Review: Promoting Transparency in Open Science. Scientometrics, 125(2), 1033–1051....
- Wood, B. D. K., Müller, R. y Brown, A. N. (2018). Push Button Replication: Is Impact Evaluation Evidence for International Development Verifiable?...
- Youyou, W., Yang, Y. y Uzzi, B. (2023). A Discipline-wide Investigation of the Replicability of Psychology Papers over the past Two Decades....
- Zong, Q., Xie, Y. y Liang, J. (2020). Does open Peer Review Improve Citation Count? Evidence from a Propensity Score Matching Analysis of...