Evidencias sobre la Validez de Contenido: Avances Teóricos y Métodos para su Estimación

• Ignacio Pedrosa ^[1] ; Javier Suárez Álvarez ^[1] ; Eduardo García Cueto ^[1]
  1. [1] Universidad de Oviedo

     Universidad de Oviedo

     Oviedo, España

     
• Localización: Acción psicológica, ISSN 1578-908X, Vol. 10, Nº. 2, 2013 (Ejemplar dedicado a: Validación de Contenido desde metodologías cualitativas y cuantitativas), págs. 3-18
• Idioma: español
• DOI: 10.5944/ap.10.2.11820
• Títulos paralelos:
  • Content Validity Evidences: Theoretical Advances and Estimation Methods
• Enlaces
  • Texto completo
• Dialnet Métricas: 161 Citas
• Resumen
  • español

    La finalidad de este trabajo ha sido realizar una revisión sobre la evolución histórica de la validez de contenido, así como presentar algunos de los métodos de estudio más utilizados para su estimación. El concepto de validez de contenido ha sido objeto de un largo proceso de modificaciones desde su origen. Sin embargo, estos cambios han estado focalizados en qué el tipo de evidencias se deben presentar para su estudio y los métodos más adecuados para encontrar dichas evidencias. Sin embargo, su definición se ha mantenido estable a lo largo del tiempo. En la actualidad, la validez de contenido se considera condición necesaria (aunque no suficiente) para realizar interpretaciones de las puntuaciones en los tests. Finalmente, la combinación de métodos tanto cualitativos como cuantitativos se entiende como el procedimiento más completo a la hora de realizar un estudio de validez de contenido en profundidad. Dentro de los primeros, destaca el índice IVC como el que, además de ser el más empleado actualmente, presenta los mayores beneficios respecto a las diferentes alternativas propuestas a lo largo de los años. Respecto a los segundos, la Teoría de la Generalizabilidad se entiende como el procedimiento más exhaustivo y cercano a la estimación de la validez de contenido en sí.

  • English

    The purpose of this paper has been to carry out a review of the historical evolution of one aspect of test validity - content validity - as well as to expose some of the most popular methods used for its evaluation. The concept of content validity has undergone many modifications from its inception to the present time. However, in the past these changes have focused on which pieces of evidence must be presented and the different statistical methods used to study it, while keeping its meaning essentially stable over time. Nowadays, evidence for content validity is considered necessary (though not the sole factor) for interpreting test results. Finally, the use of both qualitative and quantitative methods is recognized as the best procedure for performing an in-depth study of content validity. Regarding the former, this paper recommends the IVC index because, besides being currently the most used, it shows the most benefits when compared to the alternatives proposed over the years. Regarding the latter, the Generalizability Theory is understood as the most comprehensive and accurate procedure for measuring this aspect of test validity.

• Referencias bibliográficas
  • Abad, F. J., Olea, J., Ponsoda, V. y García, C. (2011). Medición en ciencias sociales y de la salud [Measurement in social and Educational...
  • Aiken, L. R. (1980). Content validity and reliability of single items or questionnaires. Educational and Psychological Measurement 40, 955–959.
  • American Psychological Association. (1952). Technical recommendations for psychological tests and diagnostic techniques: A preliminary proposal....
  • American Psychological Association, American Educational Research Association, y national Council on Measurement in Education. (1985). standards...
  • American Psychological Association, American Educational Research Association, y national Council on Measurement in Education. (1999). standards...
  • Anastasi, A. (1954). Psychological Testing. new York: MacMillan.
  • Angoff, W. H. (1971). scales, norms, and equivalent scores. En R. L. Thorndike (Ed.), Educational measurement (pp. 508–600). Washington, D....
  • Balbinotti, M. A. A. (2004). Estou Testando o que Imagino Estar? Reflexoes acerca da Validade dos Testes Psicológicos. En C. E. Vaz y R. L....
  • Balbinotti, M. A. A., Benetti, C. y Terra, P. R. s. (2007). Translation and validation of the Graham-Harvey survey for the Brazilian context....
  • Bazarganipour F., Ziaei s., Montazeri A., Faghihzadeh s. y Frozanfard F. (2012). Psychometric properties of the Iranian version of modified...
  • Buster, M. A., Roth, P. L. y Bobko, P. (2005). A process for content validation of education and experienced based minimum qualifications:...
  • Castle, n. G. (2008). An instrument to measure job satisfaction of certified nurse assistants. Applied Nursing Research, 23, 214-220. doi:10.1016/j....
  • Claeys, C., nève, J., Tulkens, P. M. y spinewine, A. (2012). Content validity and inter-rater reliability of an instrument to characterize...
  • Crocker, L., Llabre, M. y Miller, M. D. (1988). The generalizability of content validity ratings. Journal of Educational Measurement 25, 287-299.
  • Cronbach, L. J. y Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin 52, 281–302.
  • Cureton, E. E. (1951). Validity. En E. F. Lindquist (Ed.), Educational Measurement (pp. 621–694). Washington, DC: American Council on Education.
  • Davis, L. L. (1992). Instrument review: Getting the most from a panel of experts. Applied Nursing Research, 5, 194-197.
  • Davison, M. L. (1985). Multidimensional scaling versus components analysis of test intercorrelations. Psychological Bulletin, 97, 94–105.
  • Deville, C. W. (1996). An empirical link of content and construct equivalence. Applied Psychological Measurement, 20, 127–139.
  • Distefano, M. K., Pryer, M. W. y Erffmeyer, R. C. (1983). Application of Content Validity Methods to the Development of a Job-Related Performance...
  • Drauden, G. M. y Peterson, n. G. (1974). A domain sampling approach to job analysis. Test Validation Center. st. Paul: Minn.
  • Ebel, R. L. (1956). Obtaining and reporting evidence for content validity. Educational and Psychological Measurement, 16, 269–282.
  • Fitch K., Bernstein s. J., Aguilar, M. D., Burnand, B., LaCalle, J. R., Lazaro, P., … Kahan, J. P. (2001) The RAND/UcLA Appropriateness Method...
  • Fitzpatrick, A. R. (1983). The meaning of content validity. Applied Psychologyical Measurement, 7, 3-13.
  • García-Campayo, J., Zamorano, E., Ruiz, M. A., Pardo, A., Freire, O., Pérez-Páramo. y Rejas, J. (2009). Cultural adaptation into spanish of...
  • García-Campayo, J., Zamorano, E., Ruiz, M. A., Pardo, A., Pérez-Páramo., López-Gómez, V. y Rejas, J. (2012). Psychometric validation of the...
  • Green, s. B. (1983). Identifiability of spurious factors with linear factor analysis with binary ítems. Applied Psychological Measurement,...
  • Guion, R. M. (1977). Content validity: The source of my discontent. Applied Psychological Measurement 1, 1–10.
  • Gulliksen, H. (1950a). Intrinsic validity. American Psychologist, 5, 511–517.
  • Gulliksen, H. (1950b). Theory of Mental Tests. new York: Wiley. Hambleton, R. K. (1980). Test score validity and standard setting methods....
  • Hambleton, R. K. (1984). Validating the test score. En R. A. Berk (Ed.), A guide to criterion-Referenced Test construction (pp. 199-230)....
  • Haynes, s. n., Richard, D. C. s. y Kubay, E. s. (1995). Content Validity in Psychological Assessment: A Functional Approach to Concepts and...
  • Hernández-nieto, R. A. (2002), contributions to statistical Analysis. Mérida, Venezuela: Universidad de Los Andes.
  • Kane, M. (2006). Content-related validity evidence in test development. En s. M. Downing y T. M. Haladyna (Ed.), Handbook of test development...
  • Kane, M. T. (2009). Validating the interpretations and uses of test scores. En R. W. Lissitz (Ed.), The concept of validity (pp. 39-64). Charlotte,...
  • Kröger, E., Tourigny, A., Morin, D., Côté, L., Kergoat, M. J., Lebel, P., … Benounissa, Z. (2007). selecting process quality indicators for...
  • Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28, 563–575.
  • Levine, E. L., Maye, D. M., Ulm, R. A. y Gordon, T. R. (1997). A methodology for developing and validating minimum qualifications (MQs). Personnel...
  • Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35, 382-385.
  • Mosier, C. I. (1947). A critical examination of the concepts of face validity. Educational and Psychological Measurement, 7, 191–205.
  • Muñiz, J. (2000). Teoría clásica de los tests [clasical Tests Theory] (6.ª Ed.). Madrid, España: Pirámide.
  • Mussio, s. J. y smith, M. K. (1973). content validity: A procedural manual. Chicago: International Personel Management Association.
  • Nunnally, J. C. y Bernstein, I. H. (1994). Psychometric Theory (3.ª Ed.). new York: McGraw Hill.
  • Polit, D. F., Beck, C. T. y Owen, s. V. (2007). Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research...
  • Rovinelli, R. J. y Hambleton, R. K. (1977). On the use of content specialists in the assessment of criterion-referenced test item validity....
  • Rubio, D. M., Berg-Weber, M., Tebb, s. s., Lee, E. s. y Rauch, s. (2003). Objectifying content validity: Conducting a content validity study...
  • Rulon, P. J. (1946). On the validity of educational tests. Harvard Educational Review, 16, 290–296.
  • sireci, s. G. (1998a). The construct of content validity. social Indicators Research, 45, 83-117.
  • sireci, s. G. (1998b). Gathering and analyzing content validity data. Educational Assessment, 5, 299-321.
  • sireci, s. G. (2003). Validity content. En R. F. Ballesteros (Ed.), Encyclopedia of psychological assessment. Londres, UK: sage.
  • sireci, s. G. (2007). On Validity Theory and Test Validation. Educational Researcher, 36(8), 477– 481. doi:10.3102/0013189x07311609
  • sireci, s. G. (2009). Packing and unpacking sources of validity evidence. En R. W. Lissitz (Ed.), The concept of validity: Revisions, new...
  • sireci, s. G. y Geisinger, K. F. (1992). Analyzing test content using cluster analysis and multidimensiamal scaling. Applied Psychological...
  • sireci, s. G. y Geisinger, K. F. (1995). Using subject matter experts to assess content representation: A MDs analysis. Applied Psychological...
  • Merino, C. y Livia, J. (2009). Intervalos de confianza asimétricos para el índice la validez de contenido: Un programa Visual Basic para la...
  • Thurstone, L. L. (1927). A law of comparative judgment. Psychological Review, 34, 273-286.
  • Tucker, L. R. (1961). Factor Analysis of Relevance Judgments: An Approach to Content Validity. En A. Anastasi (Ed.), Testing Problems in Perspective...
  • Yang, Y-T. C. y Chan, C-Y. (2008). Comprehensive evaluation criteria for English learning websites using expert validity surveys. computer...
  • Yeung, E. J. y shin-Park, K. K. (2006). Verification of the Profile of Mood states-Brief: CrossCultural Analysis. Journal of clinical Psychology,...