The evaluation of family support programmes in Spain: an analysis of their quality standards

• Victoria Hidalgo ^[1] ; Beatriz Rodríguez-Ruiz ^[2] ; Francisco J. García Bacete ^[3] ; Raquel A. Martínez-González ^[2] ; Isabel López-Verdugo ^[1] ; Lucía Jiménez García
  1. [1] Universidad de Sevilla

     Universidad de Sevilla

     Sevilla, España

     
  2. [2] Universidad de Oviedo

     Universidad de Oviedo

     Oviedo, España

     
  3. [3] Universitat Jaume I

     Universitat Jaume I

     Castellón, España

     

  Mostrar afiliaciones +
• Localización: Psicología educativa, ISSN 1135-755X, Vol. 29, Nº. 1, 2023, págs. 35-43
• Idioma: inglés
• DOI: 10.5093/psed2023a9
• Títulos paralelos:
  • La evaluación de los programas de apoyo familiar en España: un análisis de sus estándares de calidad
• Enlaces
  • Texto completo (pdf)
• Dialnet Métricas: 7 Citas
• Resumen
  • español

    A partir de las propuestas de la Society for Prevention Research sobre los estándares de evidencia necesarios para las intervenciones preventivas, contar con una evaluación rigurosa se considera como uno de los principales requisitos de los programas basados en la evidencia. A pesar de su importancia, muchos programas de apoyo familiar no cuentan con diseños de evaluación que cumplan con los estándares de calidad más consensuados. El objetivo de este artículo fue analizar los procesos de evaluación de cincuenta y siete programas españoles identificados en el marco del proyecto COST European Family Support Network. Los resultados obtenidos muestran una imagen bastante positiva de los estándares de calidad que caracterizan la evaluación de los programas, aunque es necesario ampliar el número de diseños que incluyan grupos de comparación, que contemplen medidas de los efectos en el bienestar infantil y que lleven a cabo evaluaciones de seguimiento para medir los efectos a largo plazo de las intervenciones. Se analizan los resultados desde un enfoque plural de la evaluación, que además del rigor metodológico considera la necesidad de tener en cuenta la utilidad, la viabilidad y el rigor ético de las investigaciones de evaluación.

  • English

    Since the well-known publication of the Society for Prevention Research about standards for evidence related to research on prevention interventions, a rigorous evaluation is considered one of the main requirements for evidence-based programmes. Despite their importance, many programmes do not include evaluation designs that meet the most widely agreed quality standards. The aim of this study was to examine the evaluation processes of fifty-seven Spanish programmes identified in the context of the COST European Family Support Network. The obtained results provide a fairly positive picture of the quality of programme evaluation standards, although more designs that include a control group, follow-up evaluations assessing long-term effects, and the evaluation of child and indirect outcomes are needed. The results are discussed from a comprehensive and plural perspective of evaluation which, in addition to methodological rigor, considers the usefulness, feasibility, and ethical rigor of evaluation research.

• Referencias bibliográficas
  • Acquah, D., & Thévenon, O. (2020). Delivering evidence-based services for all vulnerable families. A review of main policy issues. OECD...
  • Aldenderfer, M., & Blashfield, R. (1987). Cluster analysis. Jossey-Bass. Almeida, A., Cruz, O., & Canário, A. C. (2022). Evidence-based...
  • Altafim, E. R. P., McCoy, D. C., & Linhares, M. B. M. (2021). Unpacking the impacts of a universal parenting program on child behavior....
  • Arnason, A., Langarica, N., Dugas, L. R., Mora, N., Luke, A., & Markossian, T. (2020). Family-based lifestyle interventions: What makes...
  • Asmussen, K. (2011). The evidence-based parenting practitioner’s handbook. Routledge.
  • Asmussen, K., & Brim, L. (2018). What works to enhance the effectiveness of the healthy child programme: An evidence update. Early Intervention...
  • Asmussen, K., Waddell, S., Molloy, D., & Chowdry, H. (2017). Commissioning parenting and family support for troubled families. Early Intervention...
  • Barlow, J., Bergman, H., Kornør, H., Wei, Y., & Bennett, C. (2016). Group-based parent training programmes for improving emotional and...
  • Barlow, J., & Coren, E. (2018). The effectiveness of parenting programs: A review of Campbell reviews. Research on Social Work Practice,...
  • Boddy, J., Smith, M., & Statham, J. (2011). Understandings of efficacy: Cross-national perspectives on ‘what works’ in supporting parents...
  • Bronfenbrenner, U. (Ed.). (2005). Making human beings human: Bioecological perspectives on human development. Sage Publications.
  • Canavan, J. (2019). Pluralist evaluation for the real worlds of intervention. In L. Moran & J. Canavan (Eds.), Realising children’s rights...
  • Chacón, S., Sanduvete, S., Portell, M., & Anguera, M. T. (2013). Reporting a program evaluation: Needs, program plan, intervention, and...
  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Routledge.
  • Council of Europe. (2006). Recommendation Rec (2006)19 of the Committee of Ministers to member states on policy to support positive parenting....
  • Council of Europe. (2011). Recommendation Rec (2011)12 of the Committee of Ministers to member states on children’s rights and social services...
  • Council of Europe. (2016). Council of Europe strategy for the rights of the child (2016–2021). https://www.coe.int/en/web/children/children–s–...
  • Daly, M. (2007). Parenting in contemporary Europe: A positive approach. Council of Europe.
  • Daly, M., Bray, R., Bruckauf, Z., Byrne, J., Margaria, A., Pécnik, N., & SammsVaughan, M. (2015). Family and parenting support: Policy...
  • Davies, L. M., Janta, B., & Gardner, F. (2019). Positive parenting interventions. Empowering parents with positive parenting techniques...
  • European Cooperation in Science & Technology. (2018). Memorandum of Understanding for the implementation of the COST Action “The European...
  • European Family Support Network. (2020). Foundation document for the European Family Support Network. Social Work & Social Sciences Review,...
  • Fives, A., Canavan, J., & Dolan, P. (2017). Evaluation study design – a pluralist approach to evidence. European Early Childhood Education...
  • Flay, B., Biglan, A., Boruch, R. F., González, F., Gottfredson, D., Kellam, S., Moscicki, E. K., Schinke, S., Valentine, J. C., & Ji,...
  • Gottfredson, D. C., Cook, T. D., Gardner, F. E, Gorman-Smith, D., Howe, G. W., Sandler, I. N., & Zafft, K. M. (2015). Standards of evidence...
  • Hidalgo, V., Pérez-Padilla, J., Sánchez, J., Ayala-Nunes, L., Maya, J., Grimaldi, V., & Menéndez, S. (2018). An analysis of different...
  • Jeong, J., Pitchik, H. O., & Fink, G. (2021). Short-term, medium-term and long-term effects of early parenting interventions in lowand...
  • Jiménez, L., Antolín-Suárez, L., Lorence, B., & Hidalgo, V. (2019). Family education and support for families at psychosocial risk in...
  • Jiménez, L., Canavan, J., Catarina-Canario, A., Burgund-Isakov, A., Holzer, J., Buciuceanu-Vrabie, M., & Özdemir, M. (2021). Evidence-informed...
  • Li, N., Peng, J., & Li, Y. (2021) Effects and moderators of Triple P on the social, emotional, and behavioral problems of children: Systematic...
  • Magioni, P., & Williams, L. C. A. (2016). Parenting programs to prevent corporal punishment: A systematic review. Paidéia, 26(63), 121-129....
  • Martínez-González, R. A., Rodríguez, B., Álvarez, L., & Becedóniz, C. (2016). Evidence in promoting positive parenting through the ProgramGuide...
  • McCall, R. B. (2009). Evidence-based programming in the context of practice and policy. Social Policy Report, 23(3), 1-11. https://doi. org/10.1002/j.2379-3988.2009.tb00060.x
  • McCall, R. B., & Green, B. L. (2004). Beyond the methodological gold standards of behavioral research: Considerations for practice and...
  • Ministerio de Derechos Sociales y Agenda 2030. (2021a). El sistema público de servicios sociales: Plan concertado de prestaciones básicas...
  • Ministerio de Derechos Sociales y Agenda 2030. (2021b). Guía de ayudas sociales y servicios para las familias 2021. Ministerio de Derechos...
  • Orte, C., Ballester, L., Vives, M., Amer, J., & March, M. X. (2017). Cultural adaptation of family evidence-based drug prevention programs...
  • Özdemir, M. (2015). How much do we know about the long-term effectiveness of parenting programmes? Advances, shortcomings,
  • Özdemir, M., Vastamäki, S., Leijten, P., & Sampaio, F. (in press). The European Family Support Network (EurofamNet) quality standards...
  • Proctor, K. B., & Brestan-Knight, E. (2016). Evaluating the use of assessment paradigms for preventive interventions: A review of the...
  • Rayce, S. B., Rasmussen, I. S., Klest, S. K., Patras, J., & Pontoppidan, M. (2017). Effects of parenting interventions for at–risk parents...
  • Rodrigo, M. J. (2016). Quality of implementation in evidence-based positive parenting programs in Spain: Introduction to the special issue....
  • Rodrigo, M. J., Byrne, S., & Álvarez, M. (2017). Interventions to promote positive parenting in Spain. In M. Israelashvili & J. L....
  • Rodrigo, M. J., Hidalgo, V., Byrne, S., Bernedo, I. M., & Jiménez, L. (2022). Quality of evidence in the evaluation of programmes under...
  • Rodrigo, M. J., Máiquez, M. L., Martín, J. C., & Rodríguez, B. (2015). La parentalidad positiva desde la prevención y la promoción. In...
  • Sama-Miller, E., Akers, L., Mraz–Esposito, A., Coughlin, R., & Zukiewicz, M. (2019). Home visiting evidence of effectiveness review: Executive...
  • Schindler, H. S., Fisher, P. A., & Shonkoff, J. P. (2017). From innovation to impact at scale: Lessons learned from a cluster of research...
  • Scott, S. (2010). National dissemination of effective parenting programmes to improve child outcomes. The British Journal of Psychiatry, 196(1),...
  • Small, S. A., Cooney, S. M., & O’Connor, C. (2009). Evidence-informed program improvement: Using principles of effectiveness to enhance...
  • Thévenon, O. (2020). Family support services across the OECD. DELSA/ ELSA/WP1/RD(2020)2. Directorate for Employment, Labour and Social Affairs...
  • United Nations General Assembly. (1989). Convention on the rights of the child. United Nations. Treaty Series, 1577, 3. https://www.refworld.org....
  • Van Assen, A. G., Knot-Dickscheita, J., Posta, W. J., & Grietensb, H. (2020). Home-visiting interventions for families with complex and...
  • Yarbrough, D. B., Shulha, L. M., Hopson, R. K., & Caruthers, F. A. (2011). The program evaluation standards: A guide for evaluators and...