Streamlining ABET Direct Assessment: The Potential of ChatGPT Integration in Open and Distance Engineering Education
DOI:
https://doi.org/10.22452/stem.vol5no2.2Keywords:
Distance Education, Large Language Model , ChatGPT, Student outcome assessment, ABET accreditation, Assessment methodology, Assessment metrics, Continuous improvement, Educational qualityAbstract
Open and distance engineering education (ODEE) presents unique challenges for program evaluation and accreditation. Traditional ABET accreditation processes, often reliant on in-person observation and resource-intensive assessments, struggle to effectively assess the diverse learning experiences and outcomes inherent to ODEE environments. This paper proposes an LLM-enhanced framework for ABET accreditation, specifically designed to address the complexities of ODEE. The framework integrates Large Language Models (LLMs) like ChatGPT throughout key assessment stages, from curriculum mapping and CLO weighting to examination design, attainment level setting, and student outcome reporting. This paper details how LLMs can analyze learning data, personalize assessments, provide scalable yet tailored feedback, and automate reporting, thereby enhancing the robustness, efficiency, and transparency of ABET accreditation for ODEE programs. The ethical considerations and potential limitations of LLM integration are also critically examined, highlighting the need for human oversight, data privacy safeguards, and ongoing evaluation. By embracing the capabilities of LLMs responsibly, this framework empowers ODEE programs, particularly those within a European context seeking international recognition, to demonstrate program quality, continuous improvement, and alignment with globally recognized standards in engineering education.
References
Ahmad, N. and Qahmash, A. (2020). Implementing Fuzzy AHP and FUCOM to evaluate critical success factors for sustained academic quality assurance and ABET accreditation. PLoS ONE, 15, e0239140.
Alhakami, H., Al-Masabi, B. and Alsubait, T. (2020). Data analytics of student learning outcomes using Abet course files. In: Proceedings of the Science and Information Conference, London, UK, 16–17 July 2020; Springer: Cham, Germany, 309–325.
Ali, Q. I. (2023a). An In-depth Comparative Study of Different ABET Accredited Computer Engineering Programs Using Self-Assessment Reports. Al-Rafidain Engineering Journal (AREJ), 28(2), pp. 226-236. doi: 10.33899/rengj.2023.137672.12244.
Ali, Q. I. (2023b). Surveying Different Student Outcome Assessment Methods for ABET Accredited Computer Engineering Programs. Research Reports on Computer Science, 2(1), 56–76. https://doi.org/10.37256/rrcs.2120232577.
Anwar, A. and Richards, D. (2018). A comparison of EC and ABET accreditation criteria. J. Prof. Issues Eng. Educ. Pract., 144.
Bachnak, R., Marikunte, S. and Shafaye, A. (2019). Fundamentals of ABET accreditation with the newly approved changes. In: Proceedings of the ASEE Annual Conference and Exposition, Tampa, FL, USA, 18 June 2019., 16–19.
Cabezas, I. (2015). On combining gamification theory and ABET criteria for teaching and learning engineering. In: Proc. IEEE Frontiers Educ. Conf. (FIE), October. 2015, 1-9.
Dawood, M.-U.-Z., Buragga, K. A., Khan, A. R. and Zaman, N. (2013). Rubric based assessment plan implementation for Computer Science program: A practical approach. In: Proc. IEEE Int. Conf. Teach., Assessment Learn. Eng. (TALE), August. 2013, 551-555.
Essa, E., Dittrich, A., Dascalu S. and Harris, Jr, F.C. (2010). ACAT: A web-based software tool to facilitate course assessment for ABET accreditation. In: Proc. 7th Int. Conf. Inf. Technol., New Gener., April. 2010, 88-93.
Hussain, W., Spady, W., Naqash, M., Khan, S., Khawaja, B. and Conner, L. (2020). ABET Accreditation During and After COVID19-Navigating the Digital Age. IEEE Access, 8, 218997–219046.
Karimi, A. and Manteufel, R. (2021). Preparation of Documents for ABET Accreditation during the COVID-19 Pandemic. In: Proceedings of the ASEE 2021 Gulf-Southwest Annual Conference, Waco, TX, USA, 24–26 March 2021.
Khan, I. (2019). A Unified Framework for Systematic Evaluation of ABET Student Outcomes and Program Educational Objectives. Int. J. Mod. Educ. Comput. Sci., 11, 1–6.
Lam, W., Xie, H. Liu, D. and Yung, K. (2019). Investigating Online Collaborative Learning on Students’ Learning Outcomes in Higher Education. In: Proceedings of the 2019 3rd International Conference on Education and E-Learning (ICEEL 2019), Barcelona, Spain, 5–7 November 2019, 13–19.
Lavanya, C., Murthy, J. and Kosaraju, S. (2020). Assessment practices in outcome-based education: Evaluation drives education. In: Methodologies and Outcomes of Engineering and Technological Pedagogy; IGI Global: Hershey, PA, USA, 50–61.
Manzoor, A., Aziz, H., Jahanzaib, M., Wasim, A. and Hussain, S. (2017) Transformational model for engineering education from content-based to outcome-based education. Int. J. Contin. Eng. Educ. Life-Long Learn, 27, 266.
Mohamed, O., Bitar, Z., Abu-Sultaneh, A. and Elhaija, W. (2021). A simplified virtual power system lab for distance learning and ABET accredited education systems. Int. J. Electr. Eng. Educ., 60(4), 397-426.
McKenzie, F.D., Mielke, R.R. and Leathrum, J.F. (2015). A successful EACABET accredited undergraduate program in modeling and simulation engineering (M&SE). In: Proc. Winter Simul. Conf. (WSC), Dec. 2015, 3538-3547.
Peridier, V. (2020). Faculty-directed continuous improvement regimen with intentional ABET/SO 1–7 Scaffolding. In: Proceedings of the ASEE Virtual Annual Conference Experience, College Park, MD, USA, June 2020, 22–26.
Rathy, G., Sivasankar, P. and Gnanasambandhan, T. (2020). Developing a knowledge structure using outcome-based education in power electronics engineering. Procedia Comput. Sci., 172, 1026–1032.
Sánchez-Ruiz, L.M., Moll-López, S., Nuñez-Pérez, A., Moraño-Fernández, J.A. and Vega-Fleitas, E. (2023). ChatGPT Challenges Blended Learning Methodologies in Engineering Education: A Case Study in Mathematics. Applied Sciences. 2023; 13(10):6039. https://doi.org/10.3390/app13106039
Schoepp, K., Danaher, M. and Kranov, A.A. (2016). The computing professional skills assessment: An innovative method for assessing ABET's student outcomes. In: Proc. IEEE Global Eng. Educ. Conf. (EDUCON), April. 2016, 45-52.
Xu, Y., Liu, P. and Tang, P. (2018). Exploration of outcome-based computational thinking education programs for teachers. In: Proceedings of the 2nd International Conference on E-Society, E-Education and E-Technology (ICSET 2018), Taipei, Taiwan, 13–15 August 2018; Association for Computing Machinery: New York, NY, USA, 2018, 123–126.
Zambrano, C. (2019). Continuous improvement model to systematize curricular processes in the context of ABET accreditation. In: Proceedings of the International Conference on Frontiers in Education: Computer Science and Computer Engineering (FECS), Las Vegas, NV, USA, 29 July–1 August 2019, 88–93.
