Students’ Perceptions of ChatGPT: Usability and Enjoyment in English Language Education
DOI:
https://doi.org/10.36663/tatefl.v7i1.1124Keywords:
ChatGPT, Usability, Enjoyment, Student Perceptions, English Language EducationAbstract
The rapid development of artificial intelligence has influenced English language learning practices, particularly through the integration of ChatGPT as a learning support tool. This study investigates students’ perceptions of ChatGPT’s usability and explores their learning experiences when using the tool in the English Language Education Study Program. The population consisted of 941 undergraduate students enrolled in the program. Using simple random sampling and Slovin’s formula with a 10% margin of error, 90 students were selected as research participants. A sequential explanatory mixed-methods design was employed. Participants used the free version of ChatGPT (GPT-3.5) for one academic semester to support tasks such as writing assignments, idea development, grammar checking, and understanding linguistic concepts. Its use was integrated into coursework and guided by lecturers to promote critical and responsible engagement. Quantitative data were collected using the System Usability Scale (SUS), while qualitative data were obtained through semi-structured interviews with four purposively selected students to gain deeper insight into their experiences. Descriptive analysis revealed an average SUS score of 63, indicating marginal usability. This suggests that although ChatGPT is perceived as beneficial, its usability has not yet reached an optimal level for academic purposes. Interview findings indicated that participants described generally positive learning experiences, including increased confidence, reduced anxiety, and assistance in developing writing skills. However, these qualitative insights reflect individual perspectives and do not constitute a measured level of enjoyment across the broader sample. Several challenges were identified, including occasional inaccuracies, overly general responses, and the potential for overreliance without adequate pedagogical supervision.
Downloads
References
Adamopoulou, E., & Moussiades, L. (2020). Chatbots: History, technology, and applications. Machine Learning with Applications, 2, 100006. https://doi.org/10.1016/j.mlwa.2020.100006
Aryanti, R. D., & Santosa, M. H. (2024). A systematic review on artificial intelligence applications for enhancing EFL students’ pronunciation skill. The Art of Teaching English as a Foreign Language (TATEFL), 5(1), 102–113. https://doi.org/10.36663/tatefl.v5i1.718
Bangor, A., Kortum, P. T., & Miller, J. T. (2008). An empirical evaluation of the system usability scale. International Journal of Human–Computer Interaction, 24(6), 574–594. https://doi.org/10.1080/10447310802205776
Beck, S., Kuhner, M., Haar, M., Daubmann, A., Semmann, M., & Kluge, S. (2024). Evaluating the accuracy and reliability of AI chatbots in disseminating the content of current resuscitation guidelines: a comparative analysis between the ERC 2021 guidelines and both ChatGPTs 3.5 and 4. Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine, 32(1), 1–9. https://doi.org/10.1186/s13049-024-01266-2
Bendig, D., & Bräunche, A. (2024). The role of artificial intelligence algorithms in information systems research: a conceptual overview and avenues for research. In Management Review Quarterly. Springer International Publishing. https://doi.org/10.1007/s11301-024-00451-y
Braun, V., Clarke, V., Hayfield, N., & Terry, G. (2019). Thematic analysis. In P. Liamputtong (Ed.), Handbook of research methods in health social sciences (pp. 843–860). Springer Singapore. https://doi.org/10.1007/978-981-10-5251-4_103
Brooke, J. (1995). SUS - A quick and dirty usability scale. Usability Eval. Ind.
Chan, C. K. Y., & Hu, W. (2023). Students’ voices on generative AI: perceptions, benefits, and challenges in higher education. International Journal of Educational Technology in Higher Education, 20(1). https://doi.org/10.1186/s41239-023-00411-8
Copeland, B. J., & Proudfoot, D. (2007). - Artificial intelligence: History, foundations, and philosophical issues. In P. B. T.-P. of P. and C. S. Thagard (Ed.), Handbook of the Philosophy of Science (pp. 429–482). North-Holland. https://doi.org/10.1016/B978-044451540-7/50032-3
Deng, R., Jiang, M., Yu, X., Lu, Y., & Liu, S. (2025). Does ChatGPT enhance student learning? A systematic review and meta-analysis of experimental studies. Computers & Education, 227, 105224. https://doi.org/10.1016/j.compedu.2024.105224
Denovan, R. F., & Marsasi, E. G. (2025). Perceived ease of use, perceived usefulness and satisfaction to maximize behavioral intention with the technology acceptance model in generation y and z consumers. Jurnal PAMATOR, 18(1), 1–36. https://doi.org/10.21107/pamator.v18i1.29461
Dewaele, J.-M. (2022). Enjoyment. In S. Li, P. Hiver, & M. Papi (Eds.), The Routledge Handbook of Second Language Acquisition and Individual Differences. Routledge. https://doi.org/10.4324/9781003270546
Dewaele, J.-M., & Dewaele, L. (2020). Are foreign language learners’ enjoyment and anxiety specific to the teacher? An investigation into the dynamics of learners’ classroom emotions. Studies in Second Language Learning and Teaching, 10(1 SE-Articles), 45–65. https://doi.org/10.14746/ssllt.2020.10.1.3
Dewaele, J.-M., & Macintyre, P. D. (2014). The two faces of Janus ? Anxiety and enjoyment in the foreign language classroom. Studies in Second Language Learning and Teaching, 4(2), 237–274. https://doi.org/10.14746/ssllt.2014.4.2.5
Farrelly, T., & Baker, N. (2023). Generative artificial intelligence: Implications and considerations for higher education practice. Education Sciences, 13(11). https://doi.org/10.3390/educsci13111109
Grotlüschen, A., Dutz, G., & Skowranek, K. (2024). Writing with artificial intelligence? Ad-hoc-survey findings raise awareness for critical literacy at the International Literacy Day. International Journal of Lifelong Education, 43(4), 371–384. https://doi.org/10.1080/02601370.2024.2349657
Hyzy, M., Bond, R., Mulvenna, M., Bai, L., Dix, A., Leigh, S., & Hunt, S. (2022). System Usability scale benchmarking for digital health apps: Meta-analysis. JMIR MHealth and UHealth, 10(8), e37290. https://doi.org/10.2196/37290
Indrayani, L., Utami, I. L. P., & Ana, I. K. T. A. (2022). Utilizing generative AI to enhance EFL learners ’ Learning motivation : A case study. JETAL: Journal of English Teaching & Applied Linguistics, 7(1), 1–8. https://doi.org/10.36655/jetal.v7i1.1835
Kartini, M. M., Santosa, M. H., & Indrayani, L. (2025). Students’ acceptance and enjoyment of ChatGPT in English language learning. Journal of Educational Study (JoES), 5(2), 171–186. https://doi.org/10.36663/joes.v5i2.1100
Kohnke, L. (2024). Exploring EAP students’ perceptions of GenAI and traditional grammar-checking tools for language learning. Computers and Education: Artificial Intelligence, 7. https://doi.org/10.1016/j.caeai.2024.100279
Kristiawan, D. Y., Bashar, K., & Pradana, D. A. (2024). Artificial intelligence in English language learning: A systematic review of AI tools, applications, and pedagogical outcomes. The Art of Teaching English as a Foreign Language (TATEFL), 5(2), 207–218. https://doi.org/10.36663/tatefl.v5i2.912
Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4). https://doi.org/10.3390/educsci13040410
Lund, B., Mannuru, N. R., Teel, Z. A., Lee, T. H., Ortega, N. J., Simmons, S., & Ward, E. (2025). Student perceptions of ai-assisted writing and academic integrity: Ethical concerns, academic misconduct, and use of generative AI in higher education. In AI in Education (Vol. 1, Issue 1, p. 2). https://doi.org/10.3390/aieduc1010002
Mallik, S., & Gangopadhyay, A. (2023). Proactive and reactive engagement of artificial intelligence methods for education: A review. Frontiers in Artificial Intelligence, 6. https://doi.org/10.3389/frai.2023.1151391
McDonald, N., Johri, A., Ali, A., & Collier, A. H. (2025). Generative artificial intelligence in higher education: Evidence from an analysis of institutional policies and guidelines. Computers in Human Behavior: Artificial Humans, 3, 100121. https://doi.org/10.1016/j.chbah.2025.100121
Morales-García, W. C., Sairitupa-Sanchez, L. Z., Morales-García, S. B., & Morales-García, M. (2024). Development and validation of a scale for dependence on artificial intelligence in university students. Frontiers in Education, 9(March), 1–7. https://doi.org/10.3389/feduc.2024.1323898
Niloy, A. C., Akter, S., Sultana, N., Sultana, J., & Rahman, S. I. U. (2024). Is ChatGPT a menace for creative writing ability? An experiment. Journal of Computer Assisted Learning, 40(2), 919–930. https://doi.org/10.1111/jcal.12929
Ntoa, S. (2025). Usability and user experience evaluation in intelligent environments: A review and reappraisal. International Journal of Human–Computer Interaction, 41(5), 2829–2858. https://doi.org/10.1080/10447318.2024.2394724
Robbins, B. D. (2021). The joyful life: An existential-humanistic approach to positive psychology in the time of a pandemic. Frontiers in Psychology, 12. https://doi.org/10.3389/fpsyg.2021.648600
Safrai, M., & Orwig, K. E. (2024). Utilizing artificial intelligence in academic writing: an in-depth evaluation of a scientific review on fertility preservation written by ChatGPT-4. Journal of Assisted Reproduction and Genetics, 41(7), 1871–1880. https://doi.org/10.1007/s10815-024-03089-7
Scherr, S., Cao, B., Jiang, L. C., & Kobayashi, T. (2025). Explaining the use of AI chatbots as context alignment: Motivations behind the use of AI chatbots across contexts and culture. Computers in Human Behavior, 172, 108738. https://doi.org/10.1016/j.chb.2025.108738
Shrivastava, P. (2025). Understanding acceptance and resistance toward generative AI technologies: a multi-theoretical framework integrating functional, risk, and sociolegal factors. Frontiers in Artificial Intelligence, Volume 8-2025. https://doi.org/10.3389/frai.2025.1565927
Solak, E. (2024). Exploring the efficiency of ChatGPT and artificial intelligence in advancing academic writing pedagogy. International Journal of Education in Mathematics, Science, and Technology, 12(6), 1525–1537. https://doi.org/10.46328/ijemst.4373
Solanki, S. R., & Khublani, D. K. (2024). Generative artificial intelligence: Exploring the power and potential of generative AI. Springer.
Song, C., & Song, Y. (2023). Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students. Frontiers in Psychology, 14(December), 1–14. https://doi.org/10.3389/fpsyg.2023.1260843
Tseng, Y. C., & Lin, Y. H. (2024). Enhancing English as a Foreign Language (EFL) learners’ writing with ChatGPT: A university-level course design. Electronic Journal of E-Learning, 22(2), 78–97. https://doi.org/10.34190/ejel.21.5.3329
Vo, A., & Nguyen, H. (2024). Generative artificial intelligence and ChatGPT in language learning : EFL students ’ perceptions of technology acceptance. Journal of University Teaching and Learning Practice, 21(6). https://doi.org/10.53761/fr1rkj58
Welda, W., Putra, D. M. D. U., & Dirgayusari, A. M. (2020). Usability testing website dengan menggunakan metode System Usability Scale ( Sus )s. International Journal of Natural Science and Engineering, 4(3), 152–161. https://doi.org/10.23887/ijnse.v4i2.28864
Winarsa, N. M. K. P., Santosa, M. H., & Indrayani, L. (2025). The investigation of teachers ’ and students ’ attitudes and enjoyment towards ChatGPT for English language learning. The Art of Teaching English as a Foreign Language (TATEFL), 6(2), 123–138. https://doi.org/10.36663/tatefl.v6i2.979
Wulandari, M., & Purnamaningwulan, R. A. (2024). Exploring Indonesian EFL pre-service teachers’ experiences in AI-assisted teaching practicums: Benefits and drawbacks. LLT Journal: Journal on Language and Language Teaching, 27(2), 878–894. https://doi.org/10.24071/llt.v27i2.8690
Zhai, C., Wibowo, S., & Li, L. D. (2024). The effects of over-reliance on AI dialogue systems on students’ cognitive abilities: a systematic review. Smart Learning Environments, 11(1). https://doi.org/10.1186/s40561-024-00316-7
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Desak Gede Wahyu Puspadnyani, Made Hery Santosa, Luh Indrayani
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
License Terms
- Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in a way that suggests the licensor endorses you or your use.
- ShareAlike — If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
