Document Type : Research Paper
Authors
1 Department of Languages and Linguistics, Shiraz University, Shiraz, Iran
2 Faculty of Computer engineering, Islamic Azad university, Torbati-e-Heydariyeh Branch
Abstract
Predicting students’ performance in a course is one of the major aims of educational data mining systems. In the present study, two and three-layer artificial neural networks (ANN) and neuro-fuzzy systems (NFS) were used to predict Iranian EFL learners’ final scores and compare them with scores given by their instructor. Sixty-six students’ scores in an English reading comprehension course comprising of five sub-scores of midterm (out of 40), quiz (out of 60), final (out of 50), class participation (out of 5) and bonus (out of 2) were used for training the systems. Two and three-layer ANNs and an NFS were trained to predict students’ final scores using training data. Researchers compared the students’ final scores given by their instructor and those achieved through the ANNs and NFS. The results showed that the NFS could predict and deliver scores that were closer to the linear sum of students’ scores. Moreover, three-layer ANN had a better performance than the two-layer ANN. According to these results, data mining techniques could deliver an accurate estimate of students' abilities in a particular course.
Keywords
Main Subjects
Adekitan A.I., & Salau, O. (2019). The impact of engineering students' performance in the first three years on their graduation result using educational data mining. Heliyon, 5(2), e01250. https://doi.org/10.1016/j.heliyon.2019.e01250
Adekitan, A. I., Adewale, A. A., & Olaitan, A. (2019). Determining the operational status of a Three Phase Induction Motor using a predictive data mining model. International Journal of Power Electronics and Drive System, 10(1), 91-103. http://doi.org/10.11591/ijpeds.v10.i1.pp93-103
Ahajjam, T., Moutaib, M., & Aissa, H., et al. (2022). Predicting Students’ Final Performance Using Artificial Neural Networks. Big Data Mining and Analytics, 5(4), 294-301. https://doi.org/10.26599/BDMA.2021.9020030
Amiruzzaman, M. (2019). Prediction of traffic-violation using data mining techniques. In Proceedings of the Future Technologies Conference (FTC) 2018: Volume 1 (pp. 283-297). Springer International Publishing.
An, J., Fu, L., Hu, M., Chen, W., & Zhan, J. (2019). A novel fuzzy-based convolutional neural network method for traffic flow prediction with uncertain traffic accident information. IEEE Access, 7, 20708–20722. https://doi.org/10.1109/ACCESS.2019.2896913
Bagheri Nevisi, R., & Arab, N. (2023). Computer-Generated vs. Direct Written Corrective Feedback and Iranian EFL Students’ Syntactic Accuracy and Complexity. Teaching English as a Second Language Quarterly (Formerly Journal of Teaching Language Skills), 42(2), 111-148. doi: 10.22099/tesl.2023.46955.3177
Bridgeman, B., Trapani, C., & Attali, Y. (2012). Comparison of human and machine scoring of essays: differences by gender, ethnicity, and country. Applied Measurements in Education, 25(1), 27-40. https://doi.org/10.1080/08957347.2012.635502
Bonanno, D., Nock, K., Smith, L., Elmore, P., & Petry, F. (2017). An approach to explainable deep learning using fuzzy inference. In Proceedings of the SPIE 10207, Next-Generation Analyst V, 102070D. https://doi.org/10.1117/12.2268001
Brocardo, M. L., Traore, I., Woungang, I., & Obaidat, M. S. (2017). Authorship verification using deep belief network systems. International Journal of Communication Systems, 30(12), e3259. https://doi.org/10.1002/dac.3259.
Daneshvar, A., Homayounfar, M., Fadaei Eshkiki, M., & Doshmanziari, E. (2021). Developing a model for performance evaluation of teachers in electronic education systems using adaptive Neuro-Fuzzy Inference System (ANFIS). Journal of New Approaches in Educational Administration, 12(4), 176-190. https://doi.org/10.30495/jedu.2021.22870.4633
Daniels, L, M., & Bulut, O. (2020). Students' perceived usefulness of computerized percentage‐only vs. descriptive score Reports: Associations with motivation and grades. Journal of Computer Assisted Learning, 36(2), 199-208. https://doi.org/10.1111/jcal.12398
Divya, N., Preetam, R., Deepthishree, A. M., & Lingamaiah, V. B. (2019). Analysis of road accidents through data mining. In ICCCE 2018: Proceedings of the International Conference on Communications and Cyber Physical Engineering 2018 (pp. 287-294). Springer Singapore.
Fernandes, E., Holanda, M., Victorino, M., Borges, V., Carvalho, R., & Van Erven, G. (2019) Educational data mining: Predictive analysis of academic performance of public school students in the capital of Brazil. Journal of Business Research, 94, 335–343. https://doi.org/10.1016/j.jbusres.2018.02.012
Göktepe Yıldız, S., & Göktepe Körpeoğlu, S. (2023). Prediction of students’ perceptions of problem-solving skills with a neuro-fuzzy model and hierarchical regression method: A quantitative study. Education and Information Technologies. https://doi.org/10.1007/s10639-022-11446-1
García, E., Romero, C., Ventura, S., & Calders, T. (2007). Drawbacks and solutions of applying association rule mining in learning management systems. In Proceedings of the International Workshop on Applying Data Mining in e-Learning (ADML 2007), Crete, Greece.
Gu, J., Gao, B., & Zhu, S. (2018). Characterization of bi-domain drosomycin-type antifungal peptides in nematodes: An example of convergent evolution. Developmental & Comparative Immunology, 87, 90-97. https://doi.org/10.1016/j.dci.2018.06.005
Guo, D., Zhang, Y., Xiang, Q., & Li, Z. (2014). Improved radio frequency identification indoor localization method via radial basis function neural network. Mathematical Problems in Engineering, 420482. https://doi.org/10.1155/2014/420482
Haghi, S., Aliakbari, M., & Yasini, A. (2023). EFL Teachers’ Individual Development Planning Model: A Data-Driven Approach. Teaching English as a Second Language Quarterly (Formerly Journal of Teaching Language Skills), 42(1), 1-28. doi: 10.22099/tesl.2022.44999.3151
Iatrellis, O., Savvas, I. K., Fitsilis, P. & Gerogiannis, V. C. (2021). A two-phase machine learning approach for predicting student outcomes. Educational Information Technology, 26 (1), pp. 69–88, 2021. https://doi.org/10.1007/s10639-020-10260-x
Ibrahim, Z. M., Bader-El-Den, M., & Cocea, M. (2019). Mining unit feedback to explore students’ learning experiences. In Advances in Computational Intelligence Systems: Contributions Presented at the 18th UK Workshop on Computational Intelligence, September 5-7, 2018, Nottingham, UK (pp. 339-350). Springer International Publishing.
Isabona, J., Imoize A. L., Ojo, S., Karunwi, O., Kim, Y., Lee, C-C., & Li, C-T. (2022). Development of a Multilayer Perceptron Neural Network for Optimal Predictive Modeling in Urban Microcellular Radio Environments. Applied Sciences, 12(11), 5713. https://doi.org/10.3390/app12115713
Jin, J., Liu, Y., Ji, P., & Kwong, C. K. (2019). Review on recent advances in information mining from big consumer opinion data for product design. Journal of Computing and Information Science in Engineering, 19(1), 010801. https://doi.org/10.1115/1.4041087
Jo, H.-S., Park, C., Lee, E., Choi, H.K., & Park, J. (2020). Path loss prediction based on machine learning techniques: Principal component analysis, artificial neural network, and Gaussian process. Sensors, 20(7), 1927. https://doi.org/10.3390/s20071927
Keserci, S., Livingston, E., Wan, L., Pico, A. R., & Chacko, G. (2017). Research synergy and drug development: Bright stars in neighboring constellations. Heliyon, 3(11), e00442. https://doi.org/10.1016/j.heliyon.2017.e00442
Khan, N., Haq, I.U., Khan, S.U., Rho, S., Lee, M.Y., & Baik, S.W. (2021). DB-Net: A novel dilated CNN-based multi-step forecasting model for power consumption in integrated local energy systems. International Journal of Electronic Power Energy Systems, 133, 107023. https://doi.org/10.1016/j.ijepes.2021.107023
Kim, D., Yoon, M., Jo, I. H., & Branch, R. M. (2018). Learning analytics to support self-regulated learning in asynchronous online courses: A case study at a women's university in South Korea. Computers & Education, 127, 233-251. https://doi.org/10.1016/j.compedu.2018.08.023
Kovalchuk, V., Demchuk, O., Demchuk, D., & Voitovich, O. (2019). Data mining for a model of irrigation control using weather web services. In Advances in Computer Science for Engineering and Education 13 (pp. 133-143). Springer International Publishing. https://doi.org/10.1007/978-3-319-91008-6_14
Liu, O. L., Brew, C., Blackmore, J., Gerard, L., Madhok, J., & Linn, M. C. (2014). Automated scoring of constructed-response science items: prospects and obstacles. Educational Measurement, Issues and Practice. 33(2), 19–28. https://doi.org/10.1111/emip.12028
Mahendra, M., Kishore, C., & Prathima, C. (2019). Data Mining Efficiency and Scalability for Smarter Internet of Things. In: Computational Intelligence and Big Data Analytics. SpringerBriefs in Applied Sciences and Technology. Springer, Singapore. https://doi.org/10.1007/978-981-13-0544-3_11
Mehdi, R., & Nachouki, M. (2022). A neuro-fuzzy model for predicting and analyzing student graduation performance in computing programs. Educational Information Technology, 28, 2455–2484. https://doi.org/10.1007/s10639-022-11205-2
Miguel-Cruz, A., Aya-Parra, P. A., Rodríguez-Dueñas, W. R., Camelo-Ocampo, A. F., Plata Guao, V. S., Correal O, H. H., & Quiroga-Torres, D. A. (2018, May). Using data mining techniques to determine whether to outsource medical equipment maintenance tasks in real contexts. In World Congress on Medical Physics and Biomedical Engineering 2018: June 8, 2018, Prague, Czech Republic (Vol. 3) (pp. 295-298). Singapore: Springer Singapore.
Naresh, C., Bose, P.S.C., & Rao, C.S.P. (2020). Artificial neural networks and adaptive neuro-fuzzy models for predicting WEDM machining responses of Nitinol alloy: a comparative study. SN Applied Science, 2, 314. https://doi.org/10.1007/s42452-020-2083-y
Noreña–P, A., González Muñoz, A., Mosquera-Rendón, J., Botero, K., & Cristancho, M. A. (2018). Colombia an unknown genetic diversity in the era of Big Data. BMC Genomics, 19(8), 61-73. https://doi.org/10.1186/s12864-018-5194-8
Ranjan, J., & Malik, K. (2007). Effective educational processes: a data mining approach. VINE: The journal of information and knowledge management systems, 37(4), 502-515. https://doi.org/10.1108/03055720710838551
Roy, S., & Garg, A. (2017). Predicting the academic performance of student using classification techniques. In 2017 4th IEEE Uttar Pradesh Section International Conference on Electrical, Computer and Electronics (UPCON) (pp. 568-572). IEEE.
Saa, A.A., Al-Emran, M., Shaalan, K. (2020). Mining Student Information System Records to Predict Students’ Academic Performance. In: Hassanien, A., Azar, A., Gaber, T., Bhatnagar, R., F. Tolba, M. (eds), The International Conference on Advanced Machine Learning Technologies and Applications (AMLTA2019). AMLTA 2019. Advances in Intelligent Systems and Computing, vol 921. Springer, Cham. https://doi.org/10.1007/978-3-030-14118 9_23
Saini, M. K., & Aggarwal, A. (2018). Detection and diagnosis of induction motor bearing faults using multiwavelet transform and naive Bayes classifier. International Transactions on Electrical Energy Systems, 28(8), e2577. https://doi.org/10.1002/etep.2577
Shermis, M. D. (2015). Contrasting state-of-the-art in the machine scoring of short-form constructed responses. Educational Assessment, 20(1), 46–65. https://doi.org/10.1080/10627197.2015.997617
Son, L.H., & Fujita, H. (2019). Neural-fuzzy with representative sets for prediction of student performance. Applied Intelligence, 49, 172–187 (2019). https://doi.org/10.1007/s10489-018-1262-7
Sultana, J., Rani, M.U., & Farquad, M. (2019). Student’s performance prediction using deep learning and data mining methods. International Journal of Recent Technology Engineering, 8(1S4), 1018–1021.
Talpur, N., Abdulkadir, S. J., Alhussian, H., Hasan, M. H., Aziz, N., & Bamhdi, A. (2023). Deep Neuro-Fuzzy System application trends, challenges, and future perspectives: A systematic survey. Artificial intelligence review, 56(2), 865-913. https://doi.org/10.1007/s10462-022-10188-3
Tataria, H., Haneda, K., Molisch, A.F., Shafi, M., & Tufvesson, F. (2021). Standardization of Propagation Models for Terrestrial Cellular Systems: A Historical Perspective. International Journal of Wireless Information Networks, 28, 20–44. https://doi.org/10.1007/s10776-020 00500-9
Tofighi, S., & Ahmadi Safa, M. (2023). Fairness in Classroom Language Assessment from EFL Teachers' Perspective. Teaching English as a Second Language Quarterly (Formerly Journal of Teaching Language Skills), 42(2), 81-110. doi: 10.22099/tesl.2023.46825.3173
Tomasevic, N., Gvozdenovic, N., & Vranes, S. (2020). An overview and comparison of supervised data mining techniques for student exam performance prediction. Computer Education, 143, 103676. https://doi.org/10.1016/j.compedu.2019.103676
Uskov, V. L., Bakken, J. P., Byerly, A., & Shah, A. (2019). Machine learning-based predictive analytics of student academic performance in STEM education, in Proc. IEEE Global Engineering Education Conf. (EDUCON), Dubai, United Arab Emirates, 2019, pp. 1370 1376.
Van der Vleuten, C. P. M., Norman, G. R., & De Graaff, E. (1991). Pitfalls in the pursuit of objectivity: issues of reliability. Medical education, 25(2), 110-118.
Virk, A., Joshi, A., Mahajan, R., & Singh, T. (2020). The power of subjectivity in competency-based assessment. Journal of postgraduate medicine, 66(4), 200–205. https://doi.org/10.4103/jpgm.JPGM_591_20
Yang, F., & Li, F. W. (2018). Study on student performance estimation, student progress analysis, and student potential prediction based on data mining. Computers & Education, 123, 97-108. https://doi.org/10.1016/j.compedu.2018.04.006
Yin, P., Dou, G., Lin, X., & Liu, L. (2020). A hybrid method for forecasting new product sales based on fuzzy clustering and deep learning. Kybernetes, 49(12):3099–3118. https://doi.org/10.1108/K-10-2019-0688Zuo, Y., Kajikawa, Y., & Mori, J. (2016). Extraction of business relationships in supply networks using statistical learning theory. Heliyon, 2(6), e00123. https://doi.org/10.1016/j.heliyon.2016.e00123
', './data/jtls/coversheet/cover_en.jpg'))