Can Multi-Item Measures and Single-Item Measures be Trusted to Assess Self-Determination Theory Constructs in the Elderly?

• Ariadna Angulo-Brunet ^[1] ; Carme Viladrich ^[1] ; Susana Pallarès ^[1] ; Marta Borrueco ^[1] ; Yago Ramis ^[1] ; Miquel Torregrossa ^[1] ; Jaume Cruz ^[1]
  1. [1] Universitat Autònoma de Barcelona

     Universitat Autònoma de Barcelona

     Barcelona, España

     
• Localización: Psicothema, ISSN-e 1886-144X, ISSN 0214-9915, Vol. 32, Nº. 4, 2020, págs. 583-589
• Idioma: inglés
• DOI: 10.7334/psicothema2020.159
• Títulos paralelos:
  • ¿Son fi ables las Medidas Multi-Ítem y las Mono-Ítem Para Evaluar los Constructos de la Teoría de la Auto-Determinación en Personas Mayores?
• Enlaces
  • Texto completo (pdf)
• Dialnet Métricas: 2 Citas
• Resumen
  • español

    Antecedentes: medir constructos complejos como los de la Teoría de la auto-determinación es un reto en personas mayores debido al proceso de respuesta. Para examinar estos constructos en actividad física nuestro objetivo fue comparar si las medidas mono-ítem eran igual de óptimas que las medidas multi-ítem pre-existentes. Por ello, desarrollamos siete medidas mono-ítem relacionadas con el estilo interpersonal, la satisfacción de las necesidades básicas y la vitalidad. Método: obtuvimos evidencias de validez y fiabilidad para las medidas multi-ítem y las medidas mono-ítem en una muestra de 128 personas mayores. Con otra muestra de 62 personas examinamos la fiabilidad test-retest para las medidas mono-ítem. Resultados: se obtuvo evidencia favorable relativa a la estructura interna, validez concurrente y fiabilidad para apoyo a la competencia y a la relación, y para satisfacción de la relación y vitalidad, mientras que para apoyo a la autonomía, satisfacción de la autonomía y de la competencia fue no conclusiva. Conclusiones: las medidas mono-ítem se han comportado como buenos sustitutos psicométricos para sus medidas multi-ítem homólogas, pero es necesario reconsiderar los constructos de autonomía, y además el proceso de respuesta y las consecuencias de la evaluación deben desempeñar un papel preeminente cuando se crean cuestionarios para personas mayores.

  • English

    Background: Measuring complex constructs, such as those from self-determination theory models, is challenging in the elderly due to the response process, particularly in collective data gathering. In order to examine this construct in physical activity settings we aimed at determining whether single-item measures were as good as pre-existing multi-item measures. For that reason, we developed seven single-item measures targeting perceived interpersonal styles, basic needs satisfaction, and well-being. Method: We gathered evidence of validity and reliability for multi-item measures and single-item measures based on a sample of 128 elderly adults. Another sample of 62 elderly adults provided test-retest reliability for the single-item measures. Results: Favourable evidence of the expected internal structure, concurrent validity, and reliability was obtained for competence- and relatedness-supportive styles, and for satisfaction of the basic psychological need of relatedness, fairly good evidence was obtained for subjective vitality, whereas mixed evidence was obtained for autonomy-supportive style and the satisfaction of the basic psychological needs of autonomy and competence. Conclusions: Single-item measures proved to be psychometrically sound substitutes for their multi-item counterparts, but the autonomy constructs need to be reconsidered. Furthermore the response process and consequences of testing should play a prominent role when devising questionnaires for the elderly.

• Referencias bibliográficas
  • Alcaraz, S., Viladrich, C., & Torregrosa, M. (2013). Less time, better quality. shortening questionnaires to assess team environment and...
  • American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (1999)....
  • American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (2014)....
  • Angulo-Brunet, A. (2019). Creating synergies between psychometrics for the development and validation of single-item measures and the evaluation...
  • American Psychological Association (2010). Publication manual of the American Psychological Association (6th ed.). American Psychological...
  • American Psychological Association (2020). Publication manual of the American Psychological Association (7th ed.). American Psychological...
  • Bruine de Bruin, W., Parker, A. M., & Strough, J. (2016). Choosing to be happy? Age differences in “maximizing” decision strategies and...
  • Bruton, A. M., Mellalieu, S. D., & Shearer, D. A. (2016). Validation of a single-item stem for collective efficacy measurement in sports...
  • Byrt, T., Bishop, J., & Carlin, J. B. (1993). Bias, prevalence and kappa. Journal of Clinical Epidemiology, 46(5), 423-429. https://doi.org/10.1016/0895-4356(93)90018-V
  • Castillo, I., Tomás, I., & Balaguer, I. (2017). The Spanish-Version of the Subjective vitality scale: Psychometric properties and evidence...
  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Earlbaum Associates.
  • Ferrando, P. J., Lorenzo-Seva, U., & Chico, E. (2009). A general factoranalytic procedure for assessing response bias in questionnaire...
  • Fuchs, C., & Diamantopoulos, A. (2009). Using single-item measures for construct measurement in management research: Conceptual issues...
  • Gill, D. P., Jones, G. R., Zou, G., & Speechley, M. (2012). Using a single question to assess physical activity in older adults: A reliability...
  • Gray, S., Wharf, J., & Rhodes, R. E. (2018). Understanding physical activity motivation and behaviour through Self-Determination and Servant...
  • Green, S. B., & Yang, Y. (2009). Reliability of summed item scores using structural equation modeling: An alternative to coefficient alpha....
  • Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fi t indexes in covariance structure analysis: Conventional criteria versus new alternatives....
  • Jorgensen, T. D., Pornprasertmanit, S., Schoemann, A. M., & Rosseel, Y. (2018). semTools: Useful tools for structural equation modeling...
  • Konstabel, K., Lönnqvist, J. E., Leikas, S., Velázquez, R. G., Qin, H., Verkasalo, M., & Walkowitz, G. (2017). Measuring single constructs...
  • Kruyen, P. M., Emons, W. H. M., & Sijtsma, K. (2013). On the shortcomings of shortened tests: A literature review. International Journal...
  • Kwon, H., & Trail, G. (2005). The feasibility of single item measures in sport loyalty research. Sport Management Review, 8, 69-88. ...
  • Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159-174. ...
  • Lane, S. (2014). Validity evidence based on testing consequences. Psicothema, 26(1), 127-135. https://doi.org/10.7334/psicothema2013.258
  • Liu, Y., Millsap, R. E., West, S. G., Tein, J., Tanaka, R., & Grimm, K. J. (2017). Testing measurement invariance in longitudinal data...
  • Lozano, L. M., García-Cueto, E., & Muñiz, J. (2008). Effect of the number of response categories on the reliability and validity of rating...
  • Marcos, P. J., Orquín, F. J., Pedreño, N. B., & Moreno-Murcia, J. A. (2014). Motivación autodeterminada en adultos mayores practicantes...
  • Marsh, H. W., Hau, K.-T., & Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values...
  • Milton, K., Clemes, S., & Bull, F. (2013). Can a single question provide an accurate measure of physical activity? British Journal of...
  • Muñiz, J., & Fonseca-Pedrero, E. (2019). Diez pasos para la construcción de un test [Ten steps for test development]. Psicothema, 31(1),...
  • Ntoumanis, N., Quested, E., Reeve, J., & Cheon, S. H. (2017). Need supportive communication: Implications for motivation in sport exercise...
  • Nunnally, J. C. (1978). Psychometric theory. McGraw-Hill.
  • Padilla, J. L., & Benítez, I. (2014). Validity evidence based on response processes. Psicothema, 26(1), 136-144. https://doi.org/10.7334/psicothema2013.259
  • Portegijs, E., Sipilä, S., Viljanen, A., Rantakokko, M., & Rantanen, T. (2016). Validity of a single question to assess habitual physical...
  • Pulido, J. J., Sánchez-Oliva, D., Leo, F. M., Sánchez-Cano, J., & GarcíaCalvo, T. (2017). Development and validation of Coaches’ interpersonal...
  • R Core Team (2018). R: A language and environment for statistical computing (Version 3.5.1) [Computer software]. https://www.r-project.org/
  • Revelle, W. (2018). psych: Procedures for personality and pscychological research (Version 1.8.4) [R package]. CRAN. ...
  • Robins, R. W., Hendin, H. M., & Trzesniewski, K. H. (2001). Measuring global self-esteem: Construct validation of a single-item measure...
  • Rosseel, Y. (2012). lavaan: An R Package for structural equation modeling. Journal of Statistical Software, 48(2), 1-36.
  • Rutkowski, L., Svetina, D., & Liaw, Y.-L. (2019). Collapsing categorical variables and measurement invariance. Structural Equation Modeling,...
  • Ryan, R., & Deci, E. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being....
  • Ryan, R., & Deci, E. (2017). Self-determination theory: Basic psychological needs in motivation, development. The Guilford Press.
  • Ryan, R., & Frederick, C. (1997). On energy, personality and health: Subjective vitality as a dynamic refl ection of well-being. Journal...
  • Sánchez, J. M., & Núñez, J. L. (2007). Análisis preliminar de las propiedades psicométricas de la versión española de la escala de necesidades...
  • Silsbury, Z., Goldsmith, R., & Rushton, A. (2015). Systematic review of the measurement properties of self-report physical activity questionnaires...
  • Viladrich, C., Angulo-Brunet, A., & Doval, E. (2017). A journey around alpha and omega to estimate internal consistency reliability. Annals...
  • Vigil-Colet, A., Lorenzo-Seva, U., & Morales-Vives, F. (2015). The effects of ageing on self-reported aggression measures are partly explained...
  • Vlachopoulos, S. P., & Michailidou, S. (2006). Development and initial validation of a measure of autonomy, competence, and relatedness...
  • Wilson, P., Paige, J., & Mack, D. (2009). The importance of interpersonal style in competitive sport: A Self-Determination Theory approach....
  • Xia, Y., & Yang, Y. (2018). RMSEA, CFI, and TLI in structural equation modeling with ordered categorical data: The story they tell depends...
  • Yang, M., Viladrich, C., & Cruz, J. (2019). Measuring motivation in physical education among Chinese and Spanish adolescents: Comparing...
  • Yang, Y., & Xia, Y. (2019). Categorical omega with small sample sizes via bayesian estimation: An alternative to frequentist estimators....