Multi-site replications in social psychology: Reflections, implications, and future directions

• Baumeister, Roy F ^[1] ; Bushman, Brad J ^[2] ; Tice, Dianne M ^[3]
  1. [1] University of Queensland

     University of Queensland

     Australia

     
  2. [2] Ohio State University

     Ohio State University

     City of Columbus, Estados Unidos

     
  3. [3] Brigham Young University

     Brigham Young University

     Estados Unidos

     

  Mostrar afiliaciones +
• Localización: The Spanish Journal of Psychology, ISSN 1138-7416, Nº 26, 2023
• Idioma: inglés
• DOI: 10.1017/SJP.2023.6
• Enlaces
  • Texto completo
• Resumen

  • Social psychology findings have fared poorly in multi-site replication attempts. This article considers and evaluates multiple factors that may contribute to such failures, other than the “crisis” assumption that most of the field’s published research is so badly flawed that it should be dismissed wholesale. Low engagement by participants may reduce replicability of some findings (while not affecting certain others). Incentives differ between original researchers and replicators. If multi-site replications are indeed biased toward failure, this may have a damaging effect on the field’s ability to build correct theories.

• Referencias bibliográficas
  • Bargh, J. A., & Melnikoff, D. (2019). Does physical warmth prime social warmth? Social Psychology, 50(3), 207–210. http://doi.org/10.1027/1864-9335/a000387
  • Baumeister, R. F., Bratslavsky, E., Finkenauer, C., & Vohs, K. D. (2001). Bad is stronger than good. Review of General Psychology, 5,...
  • Baumeister, R. F., & Tice, D. M. (2022). Ego depletion is the best replicated finding in all of social psychology. Scholarly Journal of...
  • Baumeister, R. F., Tice, D. M., & Bushman, B. J. (in press). A review of multi-site replication projects in social psychology: Is it viable...
  • Baumeister, R. F., Vohs, K. D., & Funder, D. C. (2007). Psychology as the science of self-reports and finger movements: Whatever happened...
  • Corker, K. S., Arnal, J. D., Bonfiglio, D. B. V., Curran, P. G., Chartier, C. R., Chopik, W. J., Guadagno, R. E., Kimbrough, A. M., Schmidt,...
  • Dai, W., Yang, T., White, B. X., Palmer, R., Sanders, E., McDonald, J. A., & Albarracín, D. (in press). Priming behavior: A meta-analysis...
  • Dang, J. (2016). Commentary: A multilab preregistered replication of the ego-depletion effect. Frontiers in Psychology, 7, Article 1155. http://doi.org/10.3389/fpsyg.2016.01155
  • Dang, J., Barker, P., Baumert, A., Bentvelzen, M., Berkman, E., Buchholz, N., Buczny, J., Chen, Z., De Cristofaro, V., de Vries, L., Dewitte,...
  • Danziger, S., Levav, J., & Avnaim-Pesso, L. (2011). Extraneous factors in judicial decisions. PNAS, 108, 6889–6892. http://doi.org/10.1073/pnas.1018033108
  • DeWall, C. N., & Baumeister, R. F. (2007). From terror to joy: Automatic tuning to positive affective information following mortality...
  • Ebersole, C. R., Alaei, R., Atherton, O. E., Bernstein, M. J., Brown, M., Chartier, C. R., Chung, L. Y., Hermann, A. D., Joy-Gaba, J. A.,...
  • Ebersole, C. R., Atherton, O. E., Belanger, A. L., Skulborstad, H. M., Allen, J. M., Banks, J. B., Baranski, E., Bernstein, M. J., Bonfiglio,...
  • Fay, A. J., & Maner, J. K. (2020). Interactive effects of tactile warmth and ambient temperature on the search for social affiliation....
  • Friese, M., Loschelder, D. D., Gieseler, K., Frankenbach, J., & Inzlicht, M. (2019). Is ego depletion real? An analysis of arguments....
  • Gailliot, M. T., Schmeichel, B. J., & Baumeister, R. F. (2006). Self-regulatory processes defend against the threat of death: Effects...
  • Galiani, S., Gertler, P., & Romero, M. (2017). Incentives for replication in economics. (Working Paper 23576). National Bureau of Economic...
  • Garrison, K. E., Finley, A. J., & Schmeichel, B. J. (2019). Ego depletion reduces attention control: Evidence from two high-powered preregistered...
  • Gray, K., & Wegner, D. M. (2009). Moral typecasting: Divergent perceptions of moral agents and moral patients. Journal of Personality...
  • Hagger, M. S., Chatzisarantis, N. L. D., Alberts, H., Anggono, C. O., Batailler, C., Birt, A. R., Brand, R., Brandt, M. J., Brewer, G., Bruyneel,...
  • Hauser, D. J., Ellsworth, P. C., & Gonzalez, R. (2018). Are manipulation checks necessary? Frontiers in Psychology, 9, Article 998. http://doi.org/10.3389/fpsyg.2018.00998
  • Hurley, P. J. (2015). Ego depletion: Applications and implications for auditing research. Journal of Accounting Literature, 35, 47–76. http://doi.org/10.1016/j.acclit.2015.10.001
  • Ito, H., Barzykowski, K., Grzesik, M., Gülgöz, S., Gürdere, C., Janssen, S. M. J., Khor, J., Rowthorn, H., Wade, K. A., Luna, K., Albuquerque,...
  • Jacowitz, K. E., & Kahneman, D. (1995). Measures of anchoring in estimation tasks. Personality and Social Psychology Bulletin, 21(11),...
  • Karau, S. J., & Williams, K. D. (1995). Social loafing: Research findings, implications, and future directions. Current Directions in...
  • Keller, T., & Kiss, H. J. (2021). Do exhausted primary school students cheat more? A randomized field experiment. PLOS ONE, 16(12), Article...
  • Kerr, G., Schultz, D. E., Kitchen, P. J., Mulhern, F. J., & Beede, P. (2015). Does traditional advertising theory apply to the digital...
  • Klein, R. A., Cook, C. L., Ebersole, C. R., Vitiello, C., Nosek, B. A., Hilgard, J., Ahn, P. H., Brady, A. J., Chartier, C. R., Christopherson,...
  • Klein, R. A., Ratliff, K. A., Vianello, M., Adams, R. B. Jr., Bahník, Š., Bernstein, M. J., Bocian, K., Brandt, M. J., Brooks, B., Brumbaugh,...
  • Klein, R. A., Vianello, M., Hasselman, F., Adams, B. G., Adams, R. B. Jr., Alper, S., Aveyard, M., Axt, J. R., Babalola, M. T., Bahník, Š.,...
  • Kühnen, U. (2010). Manipulation checks as manipulation: Another look at the ease-of-retrieval heuristic. Personality and Social Psychology...
  • Lord, C. G., Lepper, M. R., & Preston, E. (1984). Considering the opposite: A corrective strategy for social judgment. Journal of Personality...
  • Luttrell, A., Petty, R. E., & Xu, M. (2017). Replicating and fixing failed replications: The case of need for cognition and argument quality....
  • Muraven, M., & Baumeister, R. F. (1997). Suicide, sex, terror, paralysis, and other pitfalls of reductionist self-preservation theory....
  • Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349, Article 6251. http://doi.org/10.1126/science.aac4716
  • Oppenheimer, D. M., Meyvis, T., & Davidenko, N. (2009). Instructional manipulation checks: Detecting satisficing to increase statistical...
  • Philpot, L. M., Khokhar, B. A., Roellinger, D. L., Ramar, P., & Ebbert, J. O. (2018). Time of day is associated with opioid prescribing...
  • Pyszczynski, T., Greenberg, J., & Solomon, S. (1997). Why do we need what we need? A terror management perspective on the roots of human...
  • Schmeichel, B. J., Gailliot, M. T., Filardo, E.-A., McGregor, I., Gitter, S., & Baumeister, R. F. (2009). Terror management theory and...
  • Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis...
  • Tice, D., Baumeister, R., Crawford, J., Allen, K.-A., & Percy, A. (2021). Student belongingness in higher education: Lessons for professors...
  • Tierney, J., & Baumeister, R. F. (2019). The power of bad: How the negativity effect rules us and how we can rule it. Penguin.
  • Trinh, P., Hoover, D. R., & Sonnenberg, F. A. (2021). Time-of-day changes in physician clinical decision making: A retrospective study....
  • Vohs, K. D., Schmeichel, B. J., Lohmann, S., Gronau, Q. F., Finley, A. J., Ainsworth, S. E., Alquist, J. L., Baker, M. D., Brizi, A., Bunyi,...
  • von Hippel, W. (2018). The social leap. HarperCollins.
  • Webb, M., & Tangney, J. (in press). Too good to be true: Bots and other bad data from Mechanical Turk. Perspectives on Psychological Science.
  • Weingarten, E., Chen, Q., McAdams, M., Yi, J., Hepler, J., & Albarracín, D. (2016). From primed concepts to action: A meta-analysis of...
  • Williams, L. E., & Bargh, J. A. (2008). Experiencing physical warmth promotes interpersonal warmth. Science, 322(5901), 606–607. http://doi.org/10.1126/science.1162548