Effects of using rubrics in self-assessment with instructor feedback on pre-service teachers’ academic performance, self-regulated learning and perceptions of self-assessment

• Autores: Pınar Karaman
• Localización: European Journal of Psychology of Education, ISSN-e 1878-5174, ISSN 0256-2928, Vol. 39, Nº 3, 2024, págs. 2551-2574
• Idioma: inglés
• DOI: 10.1007/s10212-024-00867-w
• Enlaces
  • Texto completo
• Resumen

  • This study aims to explore the effects of pre-service teachers’ use of rubric in self-assessment with instructor feedback on academic achievement and self-regulated learning. Their perceptions and experiences of the self-assessment intervention were also investigated. A total of 79 pre-service teachers participated in the study. A mixed methods approach was used as a blend of experimental and qualitative design. The quasi-experimental research model with pretest/posttest control group design was employed in the quantitative phase of the study. The pre-service teachers (N = 79) were assigned to either use of rubric in self-assessment involving tutor feedback condition or a non-self-assessment condition for their essay assignments. Besides, the pre-service teachers’ perceptions and experiences of using self-assessment with instructor feedback were explored in the qualitative phase of the study. Data were collected using a rubric, an achievement test, a self-regulation in learning subscale and reflective journals. The results indicated that the rubric used in self-assessment with instructor feedback group had higher achievement and use of self-regulated learning strategies than the no-intervention group. The reflective journals also revealed that most of the pre-service teachers found the self-assessment a useful learning tool. They felt that it helped them to improve their learning by guiding them to set their own goals, monitor their progress and reflect on their learning through their own tasks. The implications for educational research and practice are discussed.

• Referencias bibliográficas
  • Alonso-Tapia, J., & Panadero, E. (2010). Effect of self-assessment scripts on self-regulation and learning. Infancia y Aprendizaje, 33(3),...
  • Andrade, H. (2010). Students as the definitive source of formative assessment: Academic self-assessment and the self-regulation of learning....
  • Andrade, H., & Du, Y. (2007). Student responses to criteria-referenced self-assessment. Assessment & Evaluation in Higher Education,...
  • Andrade, H., & Valtcheva, A. (2009). Promoting learning and achievement through self-assessment. Theory into Practice, 48(1), 12–19. https://doi.org/10.1080/00405840802577544
  • Andrade, H. L., Du, Y., & Wang, X. (2008). Putting rubrics to the test: The effect of a model, criteria generation, and rubric-referenced...
  • Andrade, H. L., Wang, X., Du, Y., & Akawi, R. L. (2009). Rubric-referenced self-assessment and self-efficacy for writing. The Journal...
  • Andrade, H. L., Du, Y., & Mycek, K. (2010). Rubric-referenced self-assessment and middle school students’ writing. Assessment in Education:...
  • Andrade, H. L. (2018). Feedback in the context of self-assessment. In A. A. Lipnevich & J. K. Smith (Eds.), The Cambridge handbook of...
  • Andrade, H. L. (2019). A critical review of research on student self-assessment. Frontiers in Education, 4. https://doi.org/10.3389/feduc.2019.00087
  • Black, P., & Wiliam, D. (1998). Insidethe black box: Raising standards through classroom assessment. Phi Delta Kappan, 80(2), 139–148.
  • Boud, D., & Falchikov, N. (1989). Quantitative studies of student self-assessment in higher education: A critical analysis of findings....
  • Boud, D., Lawson, R., & Thompson, D. G. (2013). Does student engagement in self-assessment calibrate their judgement over time? Assessment...
  • Bradford, K. L., Newland, A. C., Rule, A. C., & Montgomery, S. E. (2016). Rubrics as a tool in writing instruction: Effects on the opinion...
  • Brookhart, S. M., & Chen, F. (2015). The quality and effectiveness of descriptive rubrics. Educational Review, 67(3), 343–368. https://doi.org/10.1080/00131911.2014.929565
  • Brown, G. T. L., & Harris, L. R. (2013). Student self-assessment. In J. H. McMillan (Ed.), The SAGE handbook of research on classroom...
  • Brown, G. T., Andrade, H. L., & Chen, F. (2015). Accuracy in student self-assessment: Directions and cautions for research. Assessment...
  • Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46.
  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Erlbaum.
  • Dinsmore, D. L., & Wilson, H. E. (2016). Student participation in assessment: Does it influence self-regulation? In G. T. L. Brown &...
  • Dunlosky, J., & Rawson, K. A. (2012). Overconfidence produces underachievement: Inaccurate self evaluations undermine students’ learning...
  • Erdogan, T., & Senemoglu, N. (2016). Development and validation of a scale on self-regulation in learning (SSRL). Springerplus, 5, 1686....
  • Falchikov, N., & Boud, D. (1989). Student self-assessment in higher education: A meta-analysis. Review of Educational Research, 59(4),...
  • Fraile, J., Gil-Izquierdo, M., & Medina-Moral, E. (2023). The impact of rubrics and scripts on self-regulation, self-efficacy and performance...
  • Goodrich, H. W. (1996). Student self-assessment: At the intersection of metacognition and authentic assessment. Harvard University.
  • Hanrahan, S. J., & Isaacs, G. (2001). Assessing self-and peer-assessment: The students’ views. Higher Education Research & Development,...
  • Harris, L. R., & Brown, G. T. (2013). Opportunities and obstacles to consider when using peer-and self-assessment to improve student learning:...
  • Harris, L. R., & Brown, G. T. (2018). Using self-assessment to improve student learning. Routledge.
  • Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112. https://doi.org/10.3102/003465430298487
  • Hill, T. (2016). Do accounting students believe in self-assessment? Accounting Education, 25(4), 291–305. https://doi.org/10.1080/09639284.2016.1191271
  • Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research...
  • Karaman, P. (2021). The impact of self-assessment on academic performance: A meta-analysis study. International Journal of Research in Education...
  • Kostons, D., Van Gog, T., & Paas, F. (2012). Training self-assessment and task-selection skills: A cognitive approach to improving self-regulated...
  • Krebs, R., Rothstein, B., & Roelle, J. (2022). Rubrics enhance accuracy and reduce cognitive load in self-assessment. Metacognition and...
  • Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174.
  • Leach, L. (2012). Optional self-assessment: Some tensions and dilemmas. Assessment & Evaluation in Higher Education, 37(2), 137–147. https://doi.org/10.1080/02602938.2010.515013
  • Leenknecht, M., Wijnia, L., Köhlen, M., Fryer, L., Rikers, R., & Loyens, S. (2020). Formative assessment as practice: The role of students’...
  • Lipnevich, A. A., McCallen, L. N., Miles, K. P., & Smith, J. K. (2014). Mind the gap! Students’ use of exemplars and detailed rubrics...
  • Lipnevich, A. A., Panadero, E., & Calistro, T. (2023). Unraveling the effects of rubrics and exemplars on student writing performance....
  • Logan, B. (2015). Reviewing the value of self-assessments: Do they matter in the classroom? Research in Higher Education Journal, 29, 1–11.
  • Lund, T. (2012). Combining qualitative and quantitative approaches: Some arguments for mixed methods research. Scandinavian Journal of Educational...
  • McHugh, M. L. (2012). Interrater reliability: The kappa statistic. Biochemia Medica, 22(3), 276–282.
  • McMillan, J. H., & Hearn, J. (2008). Student self-assessment: The key to stronger student motivation and higher achievement. Educational...
  • Nicol, D. (2021). The power of internal feedback: Exploiting natural comparison processes. Assessment & Evaluation in Higher Education,...
  • Nicol, D., & McFarlane-Dick, D. (2006). Formative assessment and self-regulated learning, a model and seven principles of good feedback...
  • Nili, A., Tate, M., Barros, A., & Johnstone, D. (2020). An approach for selecting and using a method of inter-coder reliability in information...
  • Onwuegbuzie, A. J., & Leech, N. L. (2006). Linking research questions to mixed methods data analysis procedures. The Qualitative Report,...
  • Panadero, E., & Jonsson, A. (2013). The use of scoring rubrics for formative assessment purposes revisited: A review. Educational Research...
  • Panadero, E., & Romero, M. (2014). To rubric or not to rubric? The effects of self-assessment on self-regulation, performance and self-efficacy....
  • Panadero, E., Tapia, J. A., & Huertas, J. A. (2012). Rubrics and self-assessment scripts effects on self-regulation, learning and self-efficacy...
  • Panadero, E., Alonso-Tapia, J., & Reche, E. (2013). Rubrics vs. self-assessment scripts effect on self-regulation, performance and self-efficacy...
  • Panadero, E., Brown, G. T. L., & Strijbos, J. W. (2016a). The future of student self-assessment: A review of known unknowns and potential...
  • Panadero, E., Jonsson, A., & Strijbos, J. (2016b). Scaffolding self-regulated learning through self-assessment and peer assessment: Guidelines...
  • Panadero, E., Jonsson, A., & Botella, J. (2017). Effects of self-assessment on self-regulated learning and self-efficacy: Four meta-analyses....
  • Panadero, E., Andrade, H., & Brookhart, S. (2018). Fusing self-regulated learning and formative assessment: A roadmap of where we are,...
  • Panadero, E., Lipnevich, A. A., & Broadbent, J. (2019). Turning self-assessment into self-feedback. In D. Boud, M. D. Henderson, R. Ajjawi,...
  • Panadero, E., Fernández-Ruiz, J., & Sánchez-Iglesias, I. (2020). Secondary education students’ self-assessment: The effects of feedback,...
  • Panadero, E., Jonsson, A., Pinedo, L., & Fernández-Castilla, B. (2023a). Effects of rubrics on academic performance, self-regulated learning,...
  • Panadero, E., Pérez, D. G., Ruiz, J. F., Fraile, J., Sánchez-Iglesias, I., & Brown, G. T. (2023b). University students’ strategies and...
  • Raaijmakers, S. F., Baars, M., Paas, F., van Merriënboer, J. J., & Van Gog, T. (2019). Effects of self-assessment feedback on self-assessment...
  • Reddy, Y. M., & Andrade, H. (2010). A review of rubric use in higher education. Assessment & Evaluation in Higher Education, 35(4),...
  • Reitmeier, C. A., & Vrchota, D. A. (2009). Self-assessment of oral communication presentations in food science and nutrition. Journal...
  • Ross, J. A. (2019). The reliability, validity, and utility of self-assessment. Practical Assessment, Research, and Evaluation, 11(1), 10....
  • Sadler, D. R. (1989). Formative assessment and the design of instructional systems. Instructional Science, 18, 119–144.
  • Sitzmann, T., Ely, K., Brown, K. G., & Bauer, K. N. (2010). Self-assessment of knowledge: A cognitive learning or affective measure? Academy...
  • Stevens, D. D., & Levi, A. J. (2013). Introduction to rubrics: An assessment tool to save grading time, convey effective feedback, and...
  • Strauss, A., & Corbin, J. (1998). Basics of qualitative research techniques: Techniques and procedures for developing grounded theory....
  • Taras, M. (2003). To feedback or not to feedback in student self-assessment. Assessment & Evaluation in Higher Education, 28(5), 549–565....
  • van Diggelen, M., den Brok, P., & Beijaard, D. (2013). Teachers’ use of a self-assessment procedure: The role of criteria, standards,...
  • Wang, W. (2017). Using rubrics in student self-assessment: Student perceptions in the English as a foreign language writing context. Assessment...
  • Wanner, T., & Palmer, E. (2018). Formative self-and peer assessment for improved student learning: The crucial factors of design, teacher...
  • Wollenschläger, M., Hattie, J., Machts, N., Möller, J., & Harms, U. (2016). What makes rubrics effective in teacher-feedback? Transparency...
  • Wong, H. M. (2017). Implementing self-assessment in Singapore primary schools: Effects on students’ perceptions of self-assessment. Pedagogies:...
  • Yan, Z. (2018). Student self-assessment practices: The role of gender, school level and goal orientation. Assessment in Education: Principles,...
  • Yan, Z. (2020). Self-assessment in the process of self-regulated learning and its relationship with academic achievement. Assessment &...
  • Yan, Z. (2022). Student self-assessment as a process for learning. Routledge.
  • Yan, Z., & Brown, G. T. (2017). A cyclical self-assessment process: Towards a model of how students engage in self-assessment. Assessment...
  • Yan, Z., & Carless, D. (2022). Self-assessment is about more than self: The enabling role of feedback literacy. Assessment & Evaluation...
  • Yan, Z., Brown, G. T. L., Lee, C. K. J., & Qiu, X. L. (2020a). Student self-assessment: Why do they do it? Educational Psychology, 40(4),...
  • Yan, Z., Chiu, M. M., & Ko, P. Y. (2020b). Effects of self-assessment diaries on academic achievement, self-regulation, and motivation....
  • Yan, Z., Lao, H., Panadero, E., Fernández-Castilla, B., Yang, L., & Yang, M. (2022). Effects of self-assessment and peer-assessment interventions...
  • Yan, Z., Panadero, E., Wang, X., & Zhan, Y. (2023a). A systematic review on students’ perceptions of self-assessment: Usefulness and factors...
  • Yan, Z., Wang, X., Boud, D., & Lao, H. (2023b). The effect of self-assessment on academic performance and the role of explicitness: A...
  • Zimmerman, B. J., & Moylan, A. R. (2009). Self-regulation: When metacognition and motivation intersect. In D. J. Hacker, J. Dunlosky,...