Exploring the impact of Generative AI on Modern Language Learning (MFL) in Higher Education

Academic lead in the School of Modern Languages & Culture: Dr Aziza Zaher

Lead from DCAD: James Youdale

About the study

Aim of the study: To explore the potential impact of Generative AI on student writing and assessment within the context of language teaching in Higher Education.

Background: The study was inspired by a presentation on Generative AI (GenAI) by James Youdale from DCAD during an away day for the School of Modern Languages & Cultures in 2023. As a result of the presentation, Dr Aziza Zaher from the School was inspired to form a collaboration of colleagues to explore the potential impact of GenAI on student writing in language studies, with a particular focus on assessment. A large team from multiple language areas formed and included members from Arabic, Chinese, French, German, Italian, Japanese, Russian and Spanish language areas.

Design: Colleagues collaboratively designed writing tasks for the students. The aim was for the tasks to not be easily answered by the GenAI software, ChatGPT. Students completed the writing task with and without the use of ChatGPT and completed a reflection on the writing process in both cases. Then, they received feedback on their writing task from ChatGPT and from tutors and wrote reflections on both forms of feedback. Criteria were agreed between colleagues for the feedback to students, to ensure consistency across all the participating tutors. Following the writing task and after receiving their feedback, the students participating in reflective interviews and focus group discussions with a student research intern. The project generated a significant amount of valuable data, which has subsequently been presented and discussed at local and international conferences and workshops. Academic papers are also in development.

Findings: Student participants were critical of GenAI but recognised its potential to support their learning. The project helped the students to understand the benefits and risks of using AI in their studies. The project team were able to use the learning from the project to support development of learning and teaching and to inform the development of the GenAI policy for their School.

Watch the Video

In this video, Laura Lewis, Mari Carmen, Maya Medina, Kaoru Umezawa, James Youdale, Olga Zabotkina and Aziza Zaher present their findings from a study to explore the implications of Generative AI on learning, teaching, assessment and feedback in the Modern Foreign Language (MFL) context. The study was funded by a Collaborative Innovation Grant (CIG) from DCAD.

Click on the image below, or the hyperlink beneath the video, to watch the full presentation.

Watch the video at this link

Benefits of the Collaborative Innovation Grant

Following the completion of the study, the academic and DCAD leads shared what they considered to be the main benefits of the Collaborative Innovation Grant.

To staff

• The study provided an opportunity for staff to develop their understanding of GenAI.
• Colleagues were introduced to the potential benefits and risks of GenAI for learning and teaching.
• Staff were inspired and increased their confidence to include GenAI in learning and teaching because of student feedback.
• The study provided lots of data for future scholarship of teaching and learning projects.
• Colleagues running the study developed skills in how to undertake a study of this kind.
• New learning relating to students’ perceptions and application of GenAI for language learning and teaching in HE emerged.

To students (from participating in the project)

• Student participants were able to develop their understanding of the benefits and limitations of using GenAI in their writing and assessment.
• The study enabled an internship to be provided for a student to gain real-world experience of undertaking research.
• The student research intern was able to develop skills that they would not have otherwise had the opportunity to develop.

To the department (School)

• The study enabled development of new learning and teaching activities using GenAI.
• The School was able to think strategically about GenAI and assessment as multiple staff had been upskilled through involvement in the study.
• The findings from the study were used to inform the development of the School’s new GenAI policy.

To the university

• The study fed into inter-university collaborations and shared learning through the dissemination of the findings.
• The reputation of the university as leading in development of understanding in this area was increased.

Learn more about the findings of the study

Presentations

Durham/Queens Joint Online AI Symposium – 11th Sept 24  (How our students use ChatGPT in writing in Modern Foreign Languages, Dr Aziza Zaher, School of Modern Languages and Culture, Durham University)

Title: Generative AI and Arabic Learning and Teaching, with a Focus on Writing

• Presenter: Aziza Zaher
• Description: Presentation given at the BATA Conference, Scotland, June 2024

Title: El desarrollo de las destrezas escritas en lengua extranjera mediado por inteligencia artificial: una perspectiva multilingüe.

• Presenters:Nuria Polo-Pérez and Mari Carmen Maya Medina.
• Description: presentation given at ASELE international conference in Edinburgh, July 2024. ASELE is the world’s largest association of teachers and researchers in the field of teaching Spanish as a foreign language. https://asele2024edimburgo.org/programa/programa-del-congreso/

Title: On the Ongoing Multilingual Collaborative Project: How Generative AI Can Support Writing Skills and Feedback in Modern Foreign Languages (MFL)

• Presenter: Kaoru Umezawa
• Description: Presentation given at the BATJ Forum: Japanese Language Education and AI (Artificial Intelligence) at the 26th Annual Conference of the British Association for Teaching Japanese (BATJ), held on August 30-31, 2024 at Leicester University

Title: Generative AI in MFL Learning and Assessment

• Presenters: Dominique Carlini-Versini, Jin Huang, Nuria Polo-Perez.
• Description: Presentation given at the CercleS Conference, Durham, September 2024

Title: How our students use ChatGPT in writing and assessment in Modern Foreign Languages

• Presenters: Nuria Polo-Perez, Kaoru Umezawa, Aziza Zaher 
• Description: Presentation given as part of the Scholarship Lab series, Durham University, October 2024

Title: Generative AI in Writing and Assessment in Modern Foreign Languages

• Presenter: Aziza Zaher
• Description: workshop delivered to The Fifth Online International Symposium on Applied Linguistics Research (ALR2024), November 2024

Publications in preparation

Title: Students’ Practices and Perceptions of Using ChatGPT for Modern Foreign Language Writing: A Multilingual Perspective 

• Authors: Dominique Carlini Versini, Jin Huang, Nuria Polo-Perez, Aziza Zaher 
• Description: Paper submitted to: Language Learning in Higher Education, Journal of CercleS (European Confederation of Language Centres in Higher Education) – currently in-review stage, not published yet.

Currently: James Youdale, Kaoru Umezawa, Laura Lewis, and Mari Maya Medina are working on a paper for Enhancing Teaching and Learning in Higher Education Journal.