Support for decision-making in checking the level of quality of student research works based on automated text analysis

• Lyaylya Tarkhova ^[1] ; Sergey Tarkhov ^[2] ; Ilshat Akhmetyanov ^[1] ; Radik Ibragimov ^[1] ; Natalia Minasova ^[3]
  1. [1] Bashkir State Agrarian University

     Bashkir State Agrarian University

     Rusia

     
  2. [2] Ufa State Aviation Technical University

     Ufa State Aviation Technical University

     Rusia

     
  3. [3] University 20.35 of the National Technology Initiative

  Mostrar afiliaciones +
• Localización: Culture and Education, Cultura y Educación, ISSN-e 1578-4118, ISSN 1135-6405, Vol. 35, Nº 4, 2023, págs. 1068-1102
• Idioma: inglés
• DOI: 10.1080/11356405.2023.2255819
• Títulos paralelos:
  • Asistencia para la toma de decisiones en la evaluación de la calidad de las investigaciones de los estudiantes basada en el análisis automático de textos
• Enlaces
  • Texto completo
• Resumen
  • español

    El objetivo de este estudio es incrementar la eficacia del proceso de análisis y la objetividad de las decisiones en la evaluación final y mostrar la calidad de los trabajos de investigación de los estudiantes utilizando un programa de análisis automático de textos. El total de artículos evaluados superó los 300 (media de edad de los estudiantes: 21.6, DT = 34). Durante el experimento se probó la efectividad del programa Multifunctional Text Analysis (MTA) en la muestra seleccionada. El texto de las investigaciones analizadas puede evaluarse como cualitativo si el indicador complejo de coherencia de los fragmentos textuales supera el 70%. Este artículo puede servir de base metodológica y teórica para poner en práctica los principios de la virtud académica en los centros de educación superior.

  • English

    The purpose of this study is to increase the efficiency of the analysis process and the objectivity of decision-making on the final assessment, showing the quality of student research works based on the use of an automated text analysis software product. The total number of evaluated research papers was more than 300 (average age of students: 21.6; SD = 34). During the experiment, the effectiveness of the software product Multifunctional Text Analyser (MTA) was tested on the specified sample. The text of the analysed research works can be assessed as qualitative if the complex indicator of the text fragments congruence of the work exceeds 70%. The current article can be used as a methodological and theoretical basis for implementing the principles of academic virtue in institutions of higher education.

• Referencias bibliográficas
  • Advego. (2021a). Online semantic text analysis, seo-analysis of a text.
  • Advego. (2021b). Software for the uniqueness of the text checking.
  • Aronsson, F. S., Kuhlmann, M., Jelic, V., & Östberg, P. (2021). Is cognitive impairment associated with reduced syntactic complexity in...
  • Bhaumik, H., Chakraborty, B., Mukherjee, A., Bhattacharyya, S., & Chattopadhyay, M. (2014). Towards reliable clustering of English text...
  • Birjali, M., Beni-Hssane, A., Erritali, M., & Madani, Y. (2016). Information content measures of semantic similarity between documents...
  • Butakova, M. A., Klimanskaya, E. V., & Yants, V. I. (2013). A measure of information similarity for semistructured information analysis....
  • Chua, S., Kulathuramaiyer, N., Ranaivo-Malançon, B., & Iboi, H. (2018). A comparative study of sentiment-based graphs of text summaries....
  • Conjugateprior. (2021). Lowe W. ‘JFreq: Count words, quickly’.
  • Fouche, E., Meng, Y., Guo, F., Zhuang, H. L., Bohm, K., & Han, J. W. (2020). Mining text outliers in document directories. In X. Wu (Ed.),...
  • Gerasimov, S. V., Kurynin, R. V., Mashechkin, I. V., Petrovsky, M. P., Tsarev, D. V., & Shestimerov, A. A. (2013). Tools for assessing...
  • Gupta, Y., Khan, F. M., & Agarwal, S. (2021). Exploring factors influencing mobile learning in higher education–a systematic review. International...
  • Khoo, C. S. G., Nourbakhsh, A., & Na, J. C. (2012). Sentiment analysis of online news text: A case study of appraisal theory. Online Information...
  • Kim, Y. S., Rim, H. C., & Lee, D. G. (2019). Business environmental analysis for textual data using data mining and sentence-level classification....
  • Kreines, E. M., & Kreines, M. G. (2016). Control model for the alignment of the quality assessment of scientific documents based on the...
  • Kunz, N. (2019). An automated quantitative content analysis process for humanitarian logistics research. Journal of Humanitarian Logistics...
  • Leximancer. (2021). The program - content analysis of large volumes of text.
  • Liang, Y., Liu, Y., Chen, C., & Jiang, Z. (2018). Extracting topic-sensitive content from textual documents — a hybrid topic model approach....
  • Liu, Y., & Li, Z. (2016). Semantic based text similarity computation. In P. Zhao, Y. Ouyang, M. Xu, L. Yang, & Y. Ouyang (Eds.), China...
  • Lytvyn, V., Vysotska, V., Veres, O., Rishnyak, I., & Rishnyak, H. (2016). Content linguistic analysis methods for textual documents classification....
  • Minasova, N. S., & Tarkhov, S. V. (2015). Support for decision making in the evaluation of educational scientific-technical works on the...
  • Minasova, N. S., Tarkhov, S. V., & Tarkhova, L. M. (2006). Models of formation and practical implementation of compiled training modules...
  • MindGems. (2021). Fast Dublicate File Finder.
  • MonoConc. (2021). Text data analysis tool.
  • Moore, R. L., Oliver, K. M., & Wang, C. (2019). Setting the pace: Examining cognitive processing in MOOC discussion forums with automatic...
  • Nascimento, N. M., Valentim, P. M. L., & Moro Cabero, M. M. (2017). Reflections from the bibliometric analysis about documents types,...
  • Petchprasert, A. (2021). Utilizing an automated tool analysis to evaluate EFL students’ writing performances. Asian-Pacific Journal of Second...
  • Popovič, M., & Willett, P. (1992). The effectiveness of stemming for natural‐language access to Slovene textual data. Journal of the American...
  • Porter, M. F. (1980). An algorithm for suffix stripping. Program, 14(3), 130–137. https://doi.org/10.1108/eb046814
  • Provalis Research. (2021). QDA Miner. A tool for qualitative analysis of text data.
  • Sanchez-Gomez, J. M., Vega-Rodriguez, M. A., & Perez, C. J. (2020). Experimental analysis of multiple criteria for extractive multi-document...
  • Sandhya, N., & Govardhan, A. (2012). Analysis of similarity measures with wordnet based text document clustering. In S. C. Satapathy,...
  • Simankov, V. S., & Tolkachev, D. M. (2014). Automatic assessment of semantic similarity of texts. In O. Kuzmina (Ed.), Proceedings of...
  • Sisodia, D. S., Choudhary, M., Vandana, T., & Rai, R. (2019). Agglomerative similarity measure based automated clustering of scholarly...
  • Sumathi, S., & Grace, G. H. (2021). A similarity measure for text document using term cardinality. IOP Conference Series: Materials Science...
  • Tarkhova, L., Tarkhov, S., Nafikov, M., Akhmetyanov, I., Gusev, D., & Akhmarov, R. (2020). Infographics and their application in the educational...
  • Tarkhov, S. V., Minasova, N. S., & Kalimullina, G. R. (2015). Certificate of state registration of computer programs No. 2015612998. In...
  • Tarkhov, S. V., Minasova, N. S., Minasov, S. M., & Tarkhova, L. M. (2018). Storage and processing technologies of cognitive content for...
  • Tarkhov, S. V., Tarkhova, L. M., & Shagiyeva, Y. R. (2013). Information support of decision-taking in staff recruitment management process...
  • Text Analyzer. (2021). Official web site.
  • Watt, R. J. C. (2021). Last update. The program of content analysis of electronic documents.
  • Yadav, C., & Sharan, A. (2018a). Automatic text document summarization using graph based centrality measures on lexical network. International...
  • Yadav, C., & Sharan, A. (2018b). A new LSA and entropy-based approach for automatic text document summarization. International Journal...
  • Yadav, C. S., Sharan, A., Kumar, R., & Biswas, P. (2016). A new approach for single text document summarization. Advances in Intelligent...