Every year the IELTS Partners recognise a Master’s-level thesis which makes the most significant contribution to the field of language testing.
The 2024 Caroline Clapham IELTS Masters Award was given to Rahmad Adi Wijaya from the University of Melbourne, Australia. His research, ‘Language testing in superdiverse Indonesia: A discourse study of the Test of Indonesian Proficiency (UKBI)’, was praised by reviewers as a ‘highly innovative and insightful study’.
Pioneering insights: Exploring language testing in Indonesia
We asked Adi to tell us more about his research, the impact he hopes it will have, and his thoughts on the future of language assessment.
Can you tell us a little bit about yourself?
Sure, my full name is Rahmad Adi Wijaya, but people call me Adi.
I’m from Malang, East Java, Indonesia. It’s a city surrounded by mountains, so it’s quite cool here. I grew up in a suburb, about 90 minutes from the city centre.
I completed my bachelor’s degree in English language education at the Universitas Negeri Malang (State University of Malang) in 2017. After graduation, I taught English in high schools, and then Indonesian to foreign learners, and worked as a translator before setting up my own translation agency.
I then received a scholarship from the Indonesia Endowment Fund for Education Agency (LPDP) to pursue my master’s degree in applied linguistics at the University of Melbourne and I graduated in 2023. That’s where I became interested in language testing and assessment, particularly its roles in society and its impact.
Why did you apply for the Caroline Clapham IELTS Masters Award?
It was one of my examiners who recommended my work for the award. My supervisor, Dr Kellie Frost, encouraged me and provided details about the award. I looked into it and thought, ‘Why not give it a try?’
How did you feel when you found out you’d won the award?
I felt quite in disbelief, honestly! When I worked on my thesis, I was just focused on doing my best to finish the work. Winning the award is a bonus.
I feel honored to be recognised this way, especially when I read about the purpose of the award, which is to encourage newcomers to start a career in language testing. It motivates me to continue working in this field.
Can you tell us a bit about your thesis and what you found out?
My research focuses on the Uji Kemahiran Berbahasa Indonesia (UKBI), a national language test developed and administered by Indonesia’s Language Planning Agency, Badan Bahasa.
The aim of my study is to explore how the agency communicates about the test to the public, including representations of the test design, its uses, and its impact on individuals, institutions, and society at large.
I examined the validity claims made by the agency about the UKBI using an argument-based validation framework and critical discourse analysis.
My findings reveal that the UKBI’s validity claims lack support from robust theoretical and empirical evidence or test documentation. The agency uses various methods to legitimise the test, but there is a need for a transparent validation process.
What do you think the impact of your research will be?
I hope my research makes a humble contribution to the field by approaching validation as a critical discursive practice, making visible the social values and ideologies embedded in language testing practices. Practically, it provides a framework for UKBI test developers to build a coherent validation research agenda, clearly outlining the claims and types of evidence needed to support them. It calls for a better understanding of transparency and accountability in language testing.
Rahmad Adi Wijaya attending the 12th Indonesian Language Congress in 2023 in Jakarta
Who do you think will benefit from your research?
Policy makers and test developers in Indonesia will benefit the most from my research. It will help them understand the importance of transparency and accountability and provide clear and comprehensive information about the test for expert scrutiny and public debate.
What are you planning to do with your winnings?
I plan to attend the Language Testing Research Colloquium (LTRC) in Bangkok, where I will present my paper and meet other researchers in the field.
This opportunity will further integrate me into the international language testing community and provide a platform to share my findings and insights.
What do you think about the future of language assessment?
The future of language assessment will likely involve the role of AI and automation, broadening our understanding of language proficiency, and balancing technical perspectives with issues of social justice.
It’s important to capture even more relevant aspects of language proficiency in tests and consider the role of context in the validity of inferences about the test.
Is there anything else you would like to share?
I want to highlight the contributions of my supervisor, Dr Kellie Frost. She encouraged me to apply for the award and helped me prepare for the LTRC presentations. Her support has been invaluable, and I am grateful for the opportunities she has provided.
The Caroline Clapham IELTS Masters Award is awarded by the IELTS Partners (British Council, IDP IELTS, and Cambridge University Press & Assessment), and is designed to encourage students and researchers to pursue a career in language testing.
If you’re interested in applying or know someone who is, applications for 2025 are open and the deadline to apply is 30 June.