Difficulty index and active learning in Education 4.0 applied to university education

Authors

DOI:

https://doi.org/10.35622/j.rie.2023.03.008

Keywords:

Education 4.0, difficulty index, active methodology, learning, higher education

Abstract

The development of this research was aimed at knowing, using a methodology based on Education 4.0, if that model allows an increase in the percentage of participation of students with an adequate difficulty index in the evaluations. For this, a quantitative - qualitative mixed method was used with a case study implemented in 138 students form the University of Aconcagua (Chile) from September 2022 to July 2023. The instruments to collect the information were checklists of grades and participations (pretest and postest), as well as a complementary survey for the students. The results indicate that the percentage of activities completed increased its mean from 45.1% to 71.3% (p<0.001) with a Cohen’s indicator of 0.89, highlighting a much larger effect size than typical; likewise, the difficulty index in both cases remained in the range of “adequate difficulty” varying slightly form 0.639 to 0.621 with a perception of the students that finally integrates the previous results. It is concluded that the effects of the application of Education 4.0 are positive by promoting active learning and the proper implementation of challenges for the achievement of 21st century skills.

Author Biography

  • José Labori, Universidad de Aconcagua

    Profesor Universitario en la Facultad de Ingeniería, Tecnología e Innovación desde el 2015, obteniendo el título de Magíster en Docencia e Investigación en Educación Superior en la Universidad de Aconcagua. Durante su carrera académica, ha destacado por su compromiso con la Educación Superior y la innovación pedagógica con la organización de ferias científicas y proyectos de vinculación con el medio, fortaleciendo los lazos entre la academia y la comunidad.

References

Akimov, N., Kurmanov, N., Uskelenova, A., Aidargaliyeva, N., Mukhiyayeva, D., Rakhimova, S., Raimbekov, B., & Utegenova, Z. (2023). Components of education 4.0 in open innovation competence frameworks: Systematic review. Journal of Open Innovation: Technology, Market, and Complexity, 9(2), 100037. https://doi.org/https://doi.org/10.1016/j.joitmc.2023.100037 DOI: https://doi.org/10.1016/j.joitmc.2023.100037

AlMalki, H. A., & Durugbo, C. M. (2023). Evaluating critical institutional factors of Industry 4.0 for education reform. Technological Forecasting and Social Change, 188, 122327. https://doi.org/https://doi.org/10.1016/j.techfore.2023.122327 DOI: https://doi.org/10.1016/j.techfore.2023.122327

Asunción, S. (2019). Metodologías Activas: Herramientas para el empoderamiento docente. Revista Docentes 2.0, 7(1), 65–80. DOI: https://doi.org/10.37843/rted.v7i1.27

Cárdenas Ayala, A. (2013). Índice de dificultad y asimetría de los ítems en las pruebas pedagógicas. Horizonte de La Ciencia, 3(5), 65. https://doi.org/10.26490/uncp.horizonteciencia.2013.5.77 DOI: https://doi.org/10.26490/uncp.horizonteciencia.2013.5.77

Cárdenas Ayala, A. (2022). Análisis estadístico del índice de dificultad de los ítems politómicos en las pruebas pedagógicas. Prospectiva Universitaria, 8(2). https://doi.org/10.26490/uncp.prospectivauniversitaria.2011.8.1280 DOI: https://doi.org/10.26490/uncp.prospectivauniversitaria.2011.8.1280

Castillo, I. I. (2009). Evaluación de resultados clínicos (II): Las medidas de la significación clínica o los tamaños del efecto. Norte de Salud Mental, 8(34), 94–110.

Choi, W., & Kim, I. (2023). Averaging p-values under exchangeability. Statistics & Probability Letters, 194, 109748. https://doi.org/https://doi.org/10.1016/j.spl.2022.109748 DOI: https://doi.org/10.1016/j.spl.2022.109748

Cohen, J. (2013). Statistical power analysis for the behavioral sciences. Academic press. DOI: https://doi.org/10.4324/9780203771587

Covey, S. (2013). Las 4 disciplinas de la ejecución: cómo alcanzar metas crucialmente importantes. Conecta.

DeCuir-Gunby, J. T., & Schutz, P. A. (2017). Mixed methods designs: Frameworks for organizing your research methods. Developing a Mixed Methods Proposal: A Practical Guide for Beginning Researchers, 83–106. DOI: https://doi.org/10.4135/9781483399980.n10

Elrehail, H., Emeagwali, O. L., Alsaad, A., & Alzghoul, A. (2018). The impact of Transformational and Authentic leadership on innovation in higher education: The contingent role of knowledge sharing. Telematics and Informatics, 35(1), 55–67. https://doi.org/https://doi.org/10.1016/j.tele.2017.09.018 DOI: https://doi.org/10.1016/j.tele.2017.09.018

Flores, L., & Meléndez, C. (2021). Análisis comparativo del b-learning y e-learning en competencias TIC para la docencia en educación superior. Revista Innova Educación, 3(4). https://doi.org/10.35622/j.rie.2021.04.013 DOI: https://doi.org/10.35622/j.rie.2021.04.013.es

Gagné, M., Hamel, C., Lauzier, S., Penney, S.-E., Bourbeau, J., Moisan, J., & Boulet, L.-P. (2021). Comparative educational outcomes of an active versus passive learning continuing professional development activity on self-management support for respiratory educators: A non-randomized controlled mixed-methods study. Nurse Education in Practice, 57, 103256. https://doi.org/https://doi.org/10.1016/j.nepr.2021.103256 DOI: https://doi.org/10.1016/j.nepr.2021.103256

Gajek, A., Fabiano, B., Laurent, A., & Jensen, N. (2022). Process safety education of future employee 4.0 in Industry 4.0. Journal of Loss Prevention in the Process Industries, 75, 104691. https://doi.org/https://doi.org/10.1016/j.jlp.2021.104691 DOI: https://doi.org/10.1016/j.jlp.2021.104691

Giaconi, E., Bazán, M. E., Castillo, M., Hurtado, A., Rojas, H., Giaconi, V., & Guiraldes, E. (2021). Análisis de pruebas de opción múltiple en carreras de la salud de la Universidad Mayor. Investigación En Educación Médica, 40, 61–69. https://doi.org/10.22201/fm.20075057e.2021.40.21365 DOI: https://doi.org/10.22201/fm.20075057e.2021.40.21365

González-Hernando, C., Martín-Villamor, P., Carbonero-Martín, M. Á., & Lara-Ortega, F. (2013). Evaluación por competencias de los estudiantes de Enfermería a través de Aprendizaje Basado en Problemas. Enfermería Universitaria, 10(4), 120–124. https://doi.org/https://doi.org/10.1016/S1665-7063(13)72640-X DOI: https://doi.org/10.1016/S1665-7063(13)72640-X

Gorbaneff, Y., & Cancino, A. (2009). Mapa Conceptual Para El Aprendizaje Basado En Problemas. Estudios Gerenciales, 25(110), 111–124. https://doi.org/https://doi.org/10.1016/S0123-5923(09)70064-6 DOI: https://doi.org/10.1016/S0123-5923(09)70064-6

Gueye, M. L., & Exposito, E. (2020). University 4.0: The industry 4.0 paradigm applied to education. IX Congreso Nacional de Tecnologías En La Educación.

Haataja, E. S. H., Tolvanen, A., Vilppu, H., Kallio, M., Peltonen, J., & Metsäpelto, R.-L. (2023). Measuring higher-order cognitive skills with multiple choice questions –potentials and pitfalls of Finnish teacher education entrance. Teaching and Teacher Education, 122, 103943. https://doi.org/https://doi.org/10.1016/j.tate.2022.103943 DOI: https://doi.org/10.1016/j.tate.2022.103943

Haderer, B., & Ciolacu, M. (2022). Education 4.0: Artificial Intelligence Assisted Task- and Time Planning System. Procedia Computer Science, 200, 1328–1337. https://doi.org/https://doi.org/10.1016/j.procs.2022.01.334 DOI: https://doi.org/10.1016/j.procs.2022.01.334

Hamp-Lyons, L. (2007). The impact of testing practices on teaching: Ideologies and alternatives. International Handbook of English Language Teaching, September 2014. DOI: https://doi.org/10.1007/978-0-387-46301-8_35

Hernández Sampieri, R., Fernández Collado, C., & Baptista Lucio, P. (2018). Metodología de la investigación (Vol. 4). McGraw-Hill Interamericana México.

Huamán Flores, E. J., & Aquije Cardenas, G. A. (2023). Guía técnico-pedagógica para la planificación curricular por competencias. Editorial Universidad Autónoma de Ica. http://repositorio.autonomadeica.edu.pe/handle/autonomadeica/2239

Jenkins, A., & Unwin, D. (2001). How to write learning outcomes. University of Baltimore. https://cutt.ly/ewvfis1D

Khalid, S., Knouzi, N., Tanane, O., & Talbi, M. (2014). Balanced Scoreboard, the Performance Tool in Higher Education: Establishment of Performance Indicators. Procedia - Social and Behavioral Sciences, 116, 4552–4558. https://doi.org/https://doi.org/10.1016/j.sbspro.2014.01.984 DOI: https://doi.org/10.1016/j.sbspro.2014.01.984

Lee, N., & Jo, M. (2023). Exploring problem-based learning curricula in the metaverse: The hospitality students’ perspective. Journal of Hospitality, Leisure, Sport & Tourism Education, 32, 100427. https://doi.org/https://doi.org/10.1016/j.jhlste.2023.100427 DOI: https://doi.org/10.1016/j.jhlste.2023.100427

Llobet, J. R., Álvarez, M. R., & Velez, O. C. (2015). Aprendizaje Basado en Problemas, Estudio de Casos y Metodología Tradicional: Una Experiencia Concreta en el Grado en Enfermería. Procedia - Social and Behavioral Sciences, 196, 163–170. https://doi.org/https://doi.org/10.1016/j.sbspro.2015.07.029 DOI: https://doi.org/10.1016/j.sbspro.2015.07.029

March, A. F. (2006). Metodologías activas para la formación de competencias. Educatio Siglo XXI, 24, 35–56.

Martín-Peña, M. L., Díaz-Garrido, E., & del Barrio Izquierdo, L. (2012). Metodología docente y evaluación por competencias: una experiencia en la materia Dirección de Producción. Investigaciones Europeas de Dirección y Economía de La Empresa, 18(3), 237–247. https://doi.org/https://doi.org/10.1016/j.iedee.2012.05.003 DOI: https://doi.org/10.1016/j.iedee.2012.05.003

Miranda, J., Lopez, C. S., Navarro, S., Bustamante, M. R., Molina, J. M., & Molina, A. (2019). Open Innovation Laboratories as Enabling Resources to Reach the Vision of Education 4.0. Proceedings - 2019 IEEE International Conference on Engineering, Technology and Innovation, ICE/ITMC 2019. https://doi.org/10.1109/ICE.2019.8792595 DOI: https://doi.org/10.1109/ICE.2019.8792595

Miranda, J., Navarrete, C., Noguez, J., Molina-Espinosa, J. M., Ramírez-Montoya, M. S., Navarro-Tuch, S. A., Bustamante-Bello, M. R., Rosas-Fernández, J. B., & Molina, A. (2021). The core components of education 4.0 in higher education: Three case studies in engineering education. Computers and Electrical Engineering, 93. https://doi.org/10.1016/j.compeleceng.2021.107278 DOI: https://doi.org/10.1016/j.compeleceng.2021.107278

Morán-Barrios, J., Ruiz de Gauna, P., Ruiz Lázaro, P. M., & Calvo, R. (2020). Metodologías complementarias de aprendizaje para la adquisición de competencias en la formación de especialistas y actividades profesionales confiables. Educación Médica, 21(5), 328–337. https://doi.org/https://doi.org/10.1016/j.edumed.2020.02.001 DOI: https://doi.org/10.1016/j.edumed.2020.02.001

Muduli, A., Kaura, V., & Quazi, A. (2018). Pedagogy or andragogy? Views of Indian postgraduate business students. IIMB Management Review, 30(2), 168–178. https://doi.org/https://doi.org/10.1016/j.iimb.2018.01.008 DOI: https://doi.org/10.1016/j.iimb.2018.01.008

Mukul, E., & Büyüközkan, G. (2023). Digital transformation in education: A systematic review of education 4.0. Technological Forecasting and Social Change, 194, 122664. https://doi.org/10.1016/J.TECHFORE.2023.122664 DOI: https://doi.org/10.1016/j.techfore.2023.122664

Oliveira, S. R. M., & Saraiva, M. A. (2023). Leader skills interpreted in the lens of education 4.0. Procedia Computer Science, 217, 1296–1304. https://doi.org/https://doi.org/10.1016/j.procs.2022.12.327 DOI: https://doi.org/10.1016/j.procs.2022.12.327

Otzen, T., & Manterola, C. (2017). Técnicas de Muestreo sobre una Población a Estudio. International Journal of Morphology, 35(1), 227–232. https://doi.org/10.4067/S0717-95022017000100037 DOI: https://doi.org/10.4067/S0717-95022017000100037

Paneque, R. J. (1998). Metodología de la Investigación. Elementos Básicos Para La Investigación Clínica. 1ra Ed. Havana: ECIMED.

Qian, Y., Vaddiraju, S., & Khan, F. (2023). Safety education 4.0 – A critical review and a response to the process industry 4.0 need in chemical engineering curriculum. Safety Science, 161, 106069. https://doi.org/https://doi.org/10.1016/j.ssci.2023.106069 DOI: https://doi.org/10.1016/j.ssci.2023.106069

Ramírez-Montoya, M. S., Castillo-Martínez, I. M., Sanabria-Z, J., & Miranda, J. (2022). Complex Thinking in the Framework of Education 4.0 and Open Innovation—A Systematic Literature Review. Journal of Open Innovation: Technology, Market, and Complexity, 8(1), 4. https://doi.org/https://doi.org/10.3390/joitmc8010004 DOI: https://doi.org/10.3390/joitmc8010004

Ramírez Vanegas, D. N. (2022). La aplicación de la andragogía en la educación no formal. Revista Docencia Universitaria, 3(1). https://doi.org/10.46954/revistadusac.v3i1.46 DOI: https://doi.org/10.46954/revistadusac.v3i1.46

Richter, K. G., & Medel Romero, R. A. (2020). Item analysis of a multiple-choice test of incoming EFL students at a public university in Guanajuato State. Estudios de Lingüística Aplicada, 71. https://doi.org/10.22201/enallt.01852647p.2020.71.900 DOI: https://doi.org/10.22201/enallt.01852647p.2020.71.900

Robledo Ramón, P., Fidalgo Redondo, R., Arias Gundín, O., & Álvarez Fernández, L. (2015). Percepción de los estudiantes sobre el desarrollo de competencias a través de diferentes metodologías activas. Revista de Investigación Educativa, 33(2 SE-Artículos), 369–383. https://doi.org/10.6018/rie.33.2.201381 DOI: https://doi.org/10.6018/rie.33.2.201381

Rusli, M., & Sutopo, H. (2016). Multimedia based scoreboard development of four disciplines of execution for journal publication. 2016 8th International Conference on Knowledge and Smart Technology (KST), 120–124. DOI: https://doi.org/10.1109/KST.2016.7440475

Sepulveda, P., Cabezas, M., García, J., & Fonseca-Salamanca, F. (2021). Aprendizaje basado en problemas: percepción del proceso enseñanza aprendizaje de las ciencias preclínicas por estudiantes de Kinesiología. Educación Médica, 22(2), 60–66. https://doi.org/https://doi.org/10.1016/j.edumed.2019.01.004 DOI: https://doi.org/10.1016/j.edumed.2019.01.004

Sifuentes Ocegueda, A. T., Sifuentes Ocegueda, E. L., & Rivera Barajas, J. M. (2022). Educación 4.0, modalidad educativa y desarrollo regional integral. IE Revista de Investigación Educativa de La REDIECH, 13. https://doi.org/10.33010/ie_rie_rediech.v13i0.1452 DOI: https://doi.org/10.33010/ie_rie_rediech.v13i0.1452

Suárez-Lantarón, B., & García-Martínez, Á. (2022). Grupos interactivos y su influencia en el rendimiento académico en el aula de primaria: estudio de caso. Revista Innova Educación, 4(2). https://doi.org/10.35622/j.rie.2022.02.005 DOI: https://doi.org/10.35622/j.rie.2022.02.005

Taipe, M. D. (2020). Metodologías activas en el proceso enseñanza-aprendizaje. (Revisión). Roca: Revista Científico-Educaciones de La Provincia de Granma, 16(1), 463–472.

Tilea, D. M., & Bleotu, V. (2012). Implementation of a Scoreboard in Schools Based on Performance Indicators. Procedia - Social and Behavioral Sciences, 46, 2472–2476. https://doi.org/https://doi.org/10.1016/j.sbspro.2012.05.505 DOI: https://doi.org/10.1016/j.sbspro.2012.05.505

Torres, J., Chávez, H., & Cadenillas, V. (2021). Evaluación formativa: una mirada desde sus diversas estrategias en educación básica regular. Revista Innova Educación, 3(2). https://doi.org/10.35622/j.rie.2021.02.007 DOI: https://doi.org/10.35622/j.rie.2021.02.007

Urquijo, A. P. L., del Valle, E. R., & Salvo, C. A. (2014). Estrategias de aprendizaje en educación superior en un modelo curricular por competencias. Revista de La Educación Superior, 43(172), 123–144. https://doi.org/https://doi.org/10.1016/j.resu.2015.03.012 DOI: https://doi.org/10.1016/j.resu.2015.03.012

Wang, K., Li, B., Tian, T., Zakuan, N., & Rani, P. (2023). Evaluate the drivers for digital transformation in higher education institutions in the era of industry 4.0 based on decision-making method. Journal of Innovation & Knowledge, 8(3), 100364. https://doi.org/https://doi.org/10.1016/j.jik.2023.100364 DOI: https://doi.org/10.1016/j.jik.2023.100364

West, J. (2023). Utilizing Bloom’s taxonomy and authentic learning principles to promote preservice teachers’ pedagogical content knowledge. Social Sciences & Humanities Open, 8(1), 100620. https://doi.org/https://doi.org/10.1016/j.ssaho.2023.100620 DOI: https://doi.org/10.1016/j.ssaho.2023.100620

Yoza, A., & Vélez Villavicencio, C. E. (2021). Aporte de las tecnologías del aprendizaje y conocimiento en las competencias digitales de los estudiantes de educación básica superior. Revista Innova Educación, 3(4). https://doi.org/10.35622/j.rie.2021.04.004 DOI: https://doi.org/10.35622/j.rie.2021.04.004.es

Published

2023-09-20

Issue

Section

Artículos originales

How to Cite

Labori, J. (2023). Difficulty index and active learning in Education 4.0 applied to university education. Revista Innova Educación, 5(3), 129-144. https://doi.org/10.35622/j.rie.2023.03.008

Similar Articles

1-10 of 265

You may also start an advanced similarity search for this article.