Effects of the heterogeneity of the variances on reliability generalization: an example with the beck depression invetory

• Autores: Juan Botella Ausina, Graciela Ponte
• Localización: Psicothema, ISSN-e 1886-144X, ISSN 0214-9915, Vol. 23, Nº. 3, 2011, págs. 516-522
• Idioma: inglés
• Enlaces
  • Texto completo (pdf)
• Dialnet Métricas: 5 Citas
• Resumen

  • Efectos de la heterogeneidad de las varianzas en la generalización de la fiabilidad: un ejemplo con el Inventario de Depresión de Beck.Los estudios de Generalización de la Fiabilidad (GF) analizan estimaciones de la fiabilidad de las puntuaciones de un test proporcionadas por un conjunto de estudios. Como normalmente sus objetivos y diseños son extremadamente variados, sus muestreos de individuos obedecen a esquemas muy diferentes. Consecuentemente, las varianzas de las puntuaciones serán más heterogéneas de lo esperado por mera fluctuación aleatoria. Hay dos problemas principales asociados a esta fuente potencial de heterogeneidad que se deberían tener presentes. Primero, la heterogeneidad ha sido normalmente identificada subjetivamente, de forma poco rigurosa. Segundo, una vez identificada no se ha tenido en cuenta en los análisis posteriores. En trabajos previos se han propuesto formas de afrontar ambos problemas. Se resumen esos procedimientos y se aplican a un conjunto de 65 estudios independientes que aportan estimaciones de la consistencia interna del Inventario de Depresión de Beck. Los resultados muestran porqué cualquier estudio de GF debería tener en cuenta la heterogeneidad de las varianzas. Aparte de ésta, la única fuente que explica adicionalmente una varianza significativa en los coeficientes es la versión: la segunda y tercera versiones del test implican incrementos significativos de la consistencia. Se discuten las consecuencias de ignorar la heterogeneidad de las varianzas.

• Referencias bibliográficas
  • Aasen, A. (2001). An empirical investigation of depression symptoms: Norms, psychometric characteristics and factor structure of the Beck...
  • Al-Musawi, N.M. (2001). Psychometric properties of the Beck Depression Inventory-II with university students in Bahrain. Journal of Personality...
  • Arnau, R.C., Meagher, M.W., Norris, M.P., & Bramson, R. (2001). Psychometric evaluation of the Beck Depression Inventory II with primary...
  • Barnes, L.L.B., Harp, D., & Jung, W.S. (2002). Reliability generalization of scores on the Spielberger State-Trait Anxiety Inventory....
  • Beck, A.T., Steer, R.A., Ball, R., & Ranieri, W.F. (1996). Comparison of Beck Depression Inventories-IA and II in psychiatric outpatients....
  • Beck, A.T., Rush, A.J., Shaw, B.F., & Emery, G. (1979). Cognitive Therapy of Depression. Guilford, New York.
  • Beck, A.T., Steer, R.A., & Brown, G.K. (1996). Manual for Beck Depression Inventory-II. San Antonio, TX: Psychological Corporation.
  • Beck, A.T., Ward, C.H., Mendelson, M., Mock, J., & Erbaugh, J. (1961). An inventory for measuring depression. Archives of General Psychiatry,...
  • Bernal, G., Bonilla, J., & Santiago, J. (1995). Confiabilidad interna y validez de construcción lógica de dos instrumentos para medir...
  • Bonett, D.G. (2002). Sample size requirements for testing and estimating coefficient alpha. Journal of Educational and Behavioral Statistics,...
  • Borenstein, M., Hedges, L.V., Higgins, J.P.T., & Rothstein, H.R. (2009). Introduction to meta-analysis. Chichester, UK: John Wiley and...
  • Botella, J., & Gambara, H. (2002). Qué es el meta-análisis. Madrid: Biblioteca Nueva.
  • Botella, J., & Suero, M. (in press). Managing heterogeneity of variances in studies of internal consistency generalization. Methodology.
  • Botella, J., Suero, M., & Gambara, H. (2010). Psychometric inferences from a meta-analysis of reliability and internal consistency coefficients....
  • Buhlmann, U., Etco, N.L., & Wilhelm, S. (2006). Emotion recognition bias for contempt and anger in body dysmorphic disorder. Journal of...
  • Cahill, J., Barkham, M., Stiles, W.B., Twigg, E., Hardy, G.E., Rees, A., & Evans, C. (2006). Convergent validity of the CORE measures...
  • Carmody, D.P. (2005). Psychometric characteristics of the Beck Depression Inventory-II with college students of diverse ethnicity. International...
  • Coelho, R., Martins, A., & Barros, H. (2001). Clinical profiles relating gender and depressive symptoms among adolescents ascertained...
  • Coles, M.E., Gibb, B.E., & Heimberg, R.G. (2002). Psychometric evaluation of the Beck Depression Inventory in adults with social anxiety...
  • Cooper, H. (1998). Synthesizing research (3a ed.). Thousand Oaks, CA: Sage pub.
  • Cooper, H., & Hedges, L.V. (1994). The handbook of research synthesis. Nueva York: Russell Sage Foundation.
  • Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. New York: Holt, Rinehart and Winston.
  • Cronbach, L.J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334.
  • Dimitrov, D.M. (2002). Reliability: Arguments for multiple perspectives and potential problems with generalization across studies. Educational...
  • Dozois, D., Dobson, K.S., & Ahnberg, J.L. (1998). A psychometric evaluation of the Beck Depression Inventory II. Psychological Assessment,...
  • Endler, N.S., Rutherford, A., & Denisoff, E. (1999). Beck Depression Inventory: Exploring its dimensionality in a nonclinical population....
  • Falck, R.S., Wang, J., Carlsin, R.G., & Siegal, H.A. (2006). Prevalence and correlates of current depressive symptomatology among a community...
  • Feldt, L.S., & Brennan, R.L. (1989). Reliability. In R.L. Linn (ed.), Educational measurement (pp. 105-146). Nueva York: MacMillan.
  • Geisner, I.M., Neighbors, C., & Larimer, M.E. (2006). A randomized clinical trial of a brief, mailed intervention for symptoms of depression....
  • Ghassemzadeh, H., Mojtabai, R., Karamghadiri, N., & Ebrahimkhani, N. (2005). Psychometric properties of a Persian language version of...
  • Gorenstein, C., Andrade, L., Guerra Vieira Filho, A.H., Tung, T.C., & Artes, R. (1999). Psychometric properties of the Portuguese version...
  • Grothe, K.B., Dutton, G.R., Jones, G.N., Bodenlos, J., Ancona, M., & Brantley, P.J. (2005). Validation of the Beck Depression Inventory...
  • Hedges L.V., & Olkin, I. (1985). Statistical methods of meta-analysis. Orlando, Academic Press.
  • Hedges, L.V., & Vevea, J.L. (1998). Fixed- and random-effects models in meta-analysis. Psychological Methods, 3, 486-504.
  • Hee Yoo, S., Matsumoto, D., & LeRoux, J.A. (2006). The influence of emotion recognition and emotion regulation on intercultural adjustment....
  • Henson, R.K., Kogan, L.R., & Vacha-Haase, T. (2001). A reliability generalization study of the Teacher Efficacy Scale and related instruments....
  • Hewitt, P.L., & Norton, G.R. (1993). The Beck Anxiety Inventory: A psychometric analysis. Psychological Assessment, 5(4), 408-412.
  • Judd, C.M., & McClelland, G.H. (1989). Data analysis: A model comparison approach. San Diego, CA: Horcourt Brace Jovanovich.
  • Kashdan, T.B., Elhai, J.D., & Frueh, B.C. (2006). Anhedonia and emotional numbing in combat veterans with PTSD. Behaviour Research and...
  • Kim, Y., Pilkonis, P.A., Frank, E., Thase, M.E., & Reynolds, T.F. (2002). Differential functioning of the Beck Depression Inventory in...
  • Kojima, M., Furukawa, T.A., Takahashic, H., Kawai, M., Nagaya, T., & Tokudome, S. (2002). Cross-cultural validation of the Beck Depression...
  • Krefetz, D.G., Steer, R.A., & Gulab, N.A. (2002). Convergent validity of the Beck Depression Inventory-II with the Reynolds Adolescent...
  • Lewandowski, K.E., Barrantes-Vidal, N., Nelson-Gray, R.O., Clancy, C., Kepley, H.O., & Kwapil, T.R. (2006). Anxiety and depression symptoms...
  • Lipsey, M.W., & Wilson, D.B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage pub.
  • Lord, F.M., & Novick, M.R. (1968). Statistical theories of mental tests scores. Reading, Mass.: Addison-Wesley.
  • Luciano, J.V., Algarabel, S., Tomás J.M., & Martínez, J.L. (2005). Development and validation of the thought control ability questionnaire....
  • Manne, S., Ostroff, J., Martini, R., Mee, L., Sexson, S., Nereo, N., DuHamel, K., Parsons, S., Williams, S., Lewis, J., Vickberg, S.J., &...
  • Maxwell, S.E., & Delaney, H.D. (1990). Designing experiments and analyzing data: A model comparison perspective. Belmont, CA: Wadsworth.
  • McDade-Montez, E.A., Christensen, A.J., Cvengros, J.A., & Lawton, W.J. (2006). The role of depression symptoms in dialysis withdrawal....
  • Miles, A., McManus, C., Feinmann, C., Glover, L., Harrison, S., & Pearce, S. (2001). The factor structure of the BDI in facial pain and...
  • Moulds, M.L., & Kandris, E. (2006). The effect of practice on recall of negative material in dysphoria. Journal of Affective Disorders,...
  • Osman, A., Kopper, B.A., Barrios, F., Gutiérrez, P.M., & Bagge, C.L. (2004). Reliability and validity of the Beck Depression Inventory-II...
  • Otto, K., Boos, A., Dalbert, C., Shöps, D., & Hover, J. (2006). Posttraumatic symptoms, depression and anxiety of flood victims: The impact...
  • Penley, J.A., Wiebe, J.S., & Nwosu, A. (2003). Psychometric properties of the Spanish Beck Depression Inventory-II in a medical sample....
  • Radnitz, C.L., McGrath, R.E., Tirch, D.D., Willard, J., Strumolo, L.P., Festa, J., Binks, M., Broderick, C.P., Schlein, I.S., Walczak, S.,...
  • Rassin, E., & van Rootselaar, A.F. (2006). From dissociation to trauma? Individual differences in dissociation as predictor of 'trauma'...
  • Rodríguez, M.C., & Maeda, Y. (2006). Meta-analysis of Coefficient Alpha. Psychological Methods, 11(3), 306-322.
  • Ruscio, A.M., & Ruscio, J. (2002). The latent structure of analogue depression: Should the Beck Depression Inventory be used to classify...
  • Sanz, J., & Vázquez, C. (1998). Fiabilidad, validez y datos normativos del Inventario para la Depresión de Beck. Psicothema, 10(2), 303-318.
  • Sanz, J., Navarro, M.E., & Vázquez, C. (2003). Adaptación española del Inventario para la Depresión de Beck-II (BDI-II): 1. Propiedades...
  • Sato, T., & McCann, D. (2000). Sociotropy-autonomy and the Beck Depression Inventory. European Journal of Psychological Assessment, 16(1),...
  • Sawilowsky, S.S. (2000). Psychometrics versus datametrics: Comment on Vacha-Hasse's «reliability generalization» method and some EPM editorial...
  • Skorikov, V.B., & Vandervoort, D.J. (April, 2003). Relationships between the underlying constructs of the Beck Depression Inventory and...
  • Sloan, D.M., Marx, B.P., Bradley, M.M., Strauss, C.C., Lang, P.J., & Cuthbert, B.C. (2002). Examining the high-end specificity of the...
  • Sprinkle, S.D., Lurie, D., Insko, S.L., Atkinson, G., Jones, G.L., Logan, A.R., & Bissada, N.N. (2002). Criterion validity, severity cut...
  • Steer, R.A., Ball, R., Ranieri, W.F., & Beck, A.T. (1999). Dimensions of the Beck Depression Inventory-II in clinically depressed outpatients....
  • Steer, R.A., Clark, D.A., Beck, A.T., & Ranieri, W.F. (1998). Common and specific dimensions of self-reported anxiety and depression:...
  • Steer, R.A., Ranieri, W.F., Kumar, G., & Beck, A.T. (2003). Beck Depression Inventory-II items associated with self-reported symptoms...
  • Steer, R.A., Rissmiller, D.J., & Beck, A.T. (2000). Use of the Beck Depression Inventory-II with depressed geriatric inpatients. Behaviour...
  • Stice, E., Orjada, K., & Tristan, J. (2006). Trial of a psycho educational eating disturbance intervention for college women: A replication...
  • Storch, E.A., Roberti, J.W., & Roth, D.A. (2004). Factor structure, concurrent validity and internal consistency of the Beck Depression...
  • Sun, R.C.; Hui, E.K., & Watkins, D. (2006). Towards a model of suicidal ideation for Hong Kong Chinese adolescents. Journal of Adolescence,...
  • Tolin, D.F., Worhunsky, P., & Maltby, N. (2006). Are «obsessive» beliefs specific to OCD? A comparison across anxiety disorders. Behaviour...
  • Vacha-Haase, T. (1998). Reliability generalization: Exploring variance in measurement error affecting score reliability across studies. Educational...
  • Vázquez, C., & Sanz, J. (1997). Fiabilidad y valores normativos de la versión española del Inventario para la Depresión de Beck, 1978....
  • Vázquez, C., & Sanz, J. (1999). Fiabilidad y validez de la version española del Inventario para la Depresión de Beck de 1978 en pacientes...
  • Viinamaki, H., Tanskanen, A., Honkalampi, K., Koivumaa-Honkanen, H., Haatainen, K., Kaustio, O., & Hintikka, J. (2004). Is the Beck Depression...
  • Walter, L.J., Maresman, J.F., Kramer, T.L., & Evans, R.B. (2003). The Depression-Arkansas Scale: A validation study of a new brief depression...
  • Weeks, J.W., & Heimberg, R.G. (2005). Evaluation of the psychometric properties of the Beck Depression Inventory in a non-elderly adult...
  • Whisman, M.A., Pérez, J.E., & Ramel, W. (2000). Factor structure of the Beck Depression Inventory-second edition (BDI-II) in a student...
  • Yin, P., & Fan, X. (2000). Assessing the reliability of Beck Depression Inventory scores: Reliability generalization across studies. Educational...