Logfile analyses of successful and unsuccessful strategy use in complex problem-solving: A cross-national comparison study

• Hao Wu ^[1] ; Gyöngyvér Molnár ^[1]
  1. [1] University of Szeged

     University of Szeged

     Hungría

     
• Localización: European journal of psychology of education, ISSN-e 1878-5174, ISSN 0256-2928, Vol. 36, Nº 4, 2021, págs. 1009-1032
• Idioma: inglés
• DOI: 10.1007/s10212-020-00516-y
• Texto completo no disponible (Saber más ...)
• Resumen

  • The purpose of this study is to examine cross-national differences in students’ exploration strategies in a computer-simulated CPS (complex problem-solving) environment and to identify similarities and qualitative differences in the way Hungarian and Chinese students explore a CPS environment. In a sample of 187 Chinese and 835 Hungarian students (aged 12), we administered problem-solving items via the eDia platform within the MicroDYN approach. After structuring and coding the logfile data, latent class analyses were used to identify students whose problem-solving strategies showed similar patterns. Results indicated that Chinese students employed the most effective and successful exploration strategy, the VOTAT (vary-one-thing-at-a-time) strategy, more frequently and effectively than Hungarian students and that they showed a significantly higher learning effect during testing than their Hungarian peers. These results highlight the possibilities and importance of explicit enhancement of exploration strategies as a tool for learning in a new technological context.

• Referencias bibliográficas
  • Buchner, A. (1995). Basic topics and approaches to the study of complex problem solving. In P. A. Frensch & J. Funke (Eds.), Complex problem...
  • Byrne, B. M. (2008). Testing for multigroup equivalence of a measuring instrument: a walk through the process. Psicothema, 20(4), 872–882.
  • Byrne, B. M., & Stewart, S. M. (2006). The MACS approach to testing for multigroup invariance of a second-order structure: a walk through...
  • Chen, Z., & Klahr, D. (1999). All other things being equal: acquisition and transfer of the control of variables strategy. Child Development,...
  • Chen, Y., Li, X., Liu, J., & Ying, Z. (2019). Statistical analysis of complex problem-solving process data: an event history analysis...
  • Collins, L. M., & Lanza, S. T. (2010). Latent class and latent transition analysis. In With applications in the social, behavioral, and...
  • Csapó, B., Ainley, J., Bennett, R., Latour, T., & Law, N. (2012). Technological issues of computer-based assessment of 21st century skills....
  • Csapó, B., & Molnár, G. (2017). Potential for assessing dynamic problem-solving at the beginning of higher education studies. Frontiers...
  • Csapó, B., & Molnár, G. (2019). Online diagnostic assessment in support of personalized teaching and learning: The eDia System. Frontiers...
  • Csapó, B., Molnár, G., & Nagy, J. (2014). Computer-based assessment of school readiness and early reasoning. Journal of Educational Psychology,...
  • Dörner, D., & Funke, J. (2017). Complex problem solving: what it is and what it is not. Frontiers in Psychology, 8, 1153.
  • Dörner, D., Kreuzig, H. W., Reither, F., & Stäudel, T. (1983). Lohhausen. Vom Unigang mit Unbestimmtheit und Komplexität. Bern: Huber.
  • Fischer, A., Greiff, S., & Funke, J. (2012). The process of solving complex problems. The Journal of Problem Solving, 4(1), 19–42.
  • Frensch, P. A., & Funke, J. (1995). Complex problem solving: The European perspective. New York: Psychology Press.
  • Funke, J. (1991). Solving complex problems: exploration and control of complex systems. In R. J. Sternberg & P. A. Frensch (Eds.), Complex...
  • Funke, J. (2001). Dynamic systems as tools for analysing human judgement. Thinking and Reasoning, 7(1), 69–89.
  • Funke, J., & Frensch, P. A. (2007). Complex problem solving: the European perspective - 10 years after. In D. H. Jonassen (Ed.), Learning...
  • Geiser, C. (2013). Data analysis with Mplus. New York, NY: The Guilford Press.
  • Greiff, S., & Funke, J. (2009). Measuring complex problem solving-the MicroDYN approach. In F. Scheuermann (Ed.), The transition to computer-based...
  • Greiff, S., & Wüstenberg, S. (2014). Assessment with microworlds: factor structure, invariance, and latent mean comparison of the MicroDYN...
  • Greiff, S., Wüstenberg, S., & Funke, J. (2012). Dynamic problem solving: a new measurement perspective. Applied Psychological Measurement,...
  • Greiff, S., Holt, D., & Funke, J. (2013a). Perspectives on problem solving in cognitive research and educational assessment: analytical,...
  • Greiff, S., Wüstenberg, S., Molnár, G., Fischer, A., Funke, J., & Csapó, B. (2013b). Complex problem solving in educational contexts-Something...
  • Greiff, S., Kretzschmar, A., Müller, J., Spinath, B., & Martin, R. (2014a). Computer-based assessment of complex problem solving in educational...
  • Greiff, S., Wusterberg, S., Csapo, B., Demetriou, A., Hautamaki, J., Graesser, A., & Martin, R. (2014b). Domain-general problem solving...
  • Greiff, S., Krkovic, K., & Hautamäki, J. (2015a). The prediction of problem-solving assessed via microworlds. European Journal of Psychological...
  • Greiff, S., Stadler, M., Sonnleitner, P., Wolff, C., & Martin, R. (2015b). Sometimes less is more: comparing the validity of complex problem...
  • Greiff, S., Wüstenberg, S., & Avvisati, F. (2015c). Computer-generated log-file analyses as a window into students’ minds? A showcase...
  • Greiff, S., Molnár, G., Martin, R., Zimmermann, J., & Csapó, B. (2018). Students’ exploration strategies in computer-simulated complex...
  • Klauer, K. J., & Phye, G. D. (2008). Inductive reasoning: a training approach. Review of Educational Research, 78(1), 85–123.
  • Kuhn, D. (2010). What is scientific thinking and how does it develop? In U. Goswami (Ed.), The Wiley-Blackwell handbook of childhood cognitive...
  • Kuhn, D. (2012). The development of causal reasoning. WIREs Cgnitive Science, 3(3), 327–335.
  • Kuhn, D., Garcia-Mila, M., Zohar, A., Andersen, C., White, S. H., Klahr, D., & Carver, S. M. (1995). Strategies of knowledge acquisition....
  • Leutner, D., Wirth, J., Klieme, E., & Funke, J. (2005). Ansätze zur Operationalisierung und deren Erprobung im Feldtest zu PISA 2000....
  • Lien, Y. C. N., Wu, W. J., & Lu, Y. L. (2020). How well do teachers predict students’ actions in solving an ill-defined problem in STEM...
  • Lo, Y., Mendell, N. R., & Rubin, D. B. (2001). Testing the number of components in a normal mixture. Biometrika, 88(3), 767–778.
  • Mayer, R. E., & Wittrock, M. C. (2006). Problem solving. In P. A. Alexander & P. H. Winne (Eds.), Handbook of Educational Psychology...
  • Molnár, G. (2011). Playful fostering of 6-to 8-year-old students’ inductive reasoning. Thinking skills and Creativity, 6(2), 91–99.
  • Molnár, G., & Csapó, B. (2018). The efficacy and development of students’ problem-solving strategies during compulsory schooling: logfile...
  • Molnár, G., & Csapó, B. (2019). Making the psychological dimension of learning visible: using technology-based assessment to monitor students’...
  • Molnár, G., Greiff, S., & Csapó, B. (2013). Inductive reasoning, domain specific and complex problem solving: Relations and development....
  • Molnár, G., Greiff, S., Wüstenberg, S., & Fischer, A. (2017). Empirical study of computer-based assessment of domain-general dynamic problem...
  • Mustafić, M., Yu, J., Stadler, M., Vainikainen, M. P., Bornstein, M. H., Putnick, D. L., & Greiff, S. (2019). Complex problem solving:...
  • Muthén, L. K., & Muthén, B. O. (2010). Mplus user’s guide. Los Angeles, CA: Muthén & Muthén.
  • Newell, A., & Simon, H. A. (1972). Human problem solving. Englewood Cliffs, NJ: Prentice-Hall.
  • Novick, L. R., & Bassok, M. (2005). Problem solving. In K. J. Holyoak & R. G. Morrison (Eds.), The Cambridge handbook of thinking...
  • OECD. (2014). Results: creative problem solving - students’ skills in tackling real-life problems (Vol. V). Paris: OECD Publishing.
  • OECD. (2020). PISA 2018 results (volume I): what students know and can do. Paris: OECD Publishing.
  • Perret, P. (2015). Children’s inductive reasoning: developmental and educational perspectives. Journal of Cognitive Education and Psychology,...
  • Ren, Y., Luo, F., Ren, P., Bai, D., Li, X., & Liu, H. (2019). Exploring multiple goals balancing in complex problem solving based on log...
  • Schoppek, W., & Fischer, A. (2017). Common process demands of two complex dynamic control tasks: transfer is mediated by comprehensive...
  • Schweizer, F., Wüstenberg, S., & Greiff, S. (2013). Validity of the MicroDYN approach: complex problem solving predicts school grades...
  • Sweller, J. (1994). Cognitive load theory, learning difficulty, and instructional design. Learning and Instruction, 4(4), 295–312.
  • Tóth, K., Rölke, H., Goldhammer, F., & Barkow, I. (2017). Educational process mining: new possibilities for understanding students’ problem-solving...
  • UNESCO Institute for Statistics. (2009). Guide to measuring information and communication technologies (ICT) in education. Montreal: UNESCO...
  • Vollmeyer, R., & Rheinberg, F. (1999). Motivation and metacognition when learning a complex system. European Journal of Psychology of...
  • Vollmeyer, R., Burns, B. D., & Holyoak, K. J. (1996). The impact of goal specificity on strategy use and the acquisition of problem structure....
  • Wenke, D., Frensch, P. A., & Funke, J. (2005). Complex problem solving and intelligence: empirical relation and causal direction. In R....
  • Wittmann, W. W., & Hattrup, K. (2004). The relationship between performance in dynamic systems and intelligence. Systems Research and...
  • Wu, H., & Molnár, G. (2018). Interactive problem solving: assessment and relations to combinatorial and inductive reasoning. Journal of...
  • Wüstenberg, S., Greiff, S., & Funke, J. (2012). Complex problem solving – more than reasoning? Intelligence, 40(1), 1–14.
  • Wüstenberg, S., Greiff, S., Molnár, G., & Funke, J. (2014a). Cross-national gender differences in complex problem solving and their determinants....
  • Wüstenberg, S., Stadler, M., Hautamäki, J., & Greiff, S. (2014b). The role of strategy knowledge for the application of strategies in...
  • Xia, Y., & Yang, Y. (2019). RMSEA, CFI, and TLI in structural equation modeling with ordered categorical data: the story they tell depends...
  • Zoanetti, N., & Griffin, P. (2017). Log-file data as indicators for problem-solving processes. In B. Csapó & J. Funke (Eds.), The...