English Teachers' Perceptions of a Language Assessment Literacy Course
Article Sidebar
Main Article Content
Abstract
Language assessment literacy has gained recent attention in the field of language testing, particularly on teachers’ profile. However, the literature on LAL is limited regarding teachers’ perceptions of language assessment courses. In this paper, we used a case study method to characterize the perceptions of eighteen English language teachers into three components of an online assessment course: contents, activities, and impact on their professional development. For data collection, we used a questionnaire and a focus group interview. Findings indicate that the teachers perceived course contents as organized, relevant, and useful; they also considered test analysis and collaborative tasks as valuable. Regarding professional development, the teachers explained that test-analysis tasks made them aware of their mistakes in assessment. Finally, the teachers suggested that the course raised their awareness of what language assessment is and does. Based on these results, we provide recommendations for LAL courses elsewhere.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
The authors of the manuscripts accepted for publication in HOW journal are required to sign a nonexclusive license agreement allowing ASOCOPI to reproduce the full text on the Internet or in any other available source. Authors retain copyright of their manuscripts with the following restrictions: first publication is granted to ASOCOPI; nonexclusive agreements with third parties can be established as long as the original publication in the HOW journal is properly acknowledged.
References
Arias, C. I., Maturana, L. M., & Restrepo, M. I. (2012). Evaluación de los aprendizajes en lenguas extranjeras: Hacia prácticas justas y democráticas. Lenguaje, 40(1), 99–126. https://doi.org/10.25100/lenguaje.v40i1.4945
Baker, B. A., & Riches, C. (2017). The development of EFL examinations in Haiti: Collaboration and language assessment literacy development. Language Testing, 35(4), 557–581. https://doi.org/10.1177/0265532217716732
Baker, B. (2021, June). Unpacking the concept of language assessment literacy for all key stakeholders [Conference presentation]. New Directions Colombia 2021. https://americas.britishcouncil.org/new-directions/programme
Bøhn, H., & Tsagari, D. (2021). Teacher educators’ conceptions of language assessment literacy in Norway. Journal of Language Teaching and Research, 12(2), 222-233. http://dx.doi.org/10.17507/jltr.1202.02
Boyd, E., & Donnarumma, D. (2018). Assessment literacy for teachers: A pilot study investigating the challenges, benefits and impact of assessment literacy training. In D. Xerri & P. Vella Briffa (Eds.), Teacher involvement in high-stakes language testing (pp. 105–126). Springer. https://doi.org/10.1007/978-3-319-77177-9_7
Brindley, G. (2001). Language assessment and professional development. In C. Elder, A. Brown, E. Grove, K. Hill, N. Iwashita, T. Lumley, T. McNamara, & K. O’Loughlin (Eds.), Experimenting with uncertainty: Essays in honour of Alan Davies (pp. 126–136). Cambridge University Press.
Butler, Y., Peng, X., & Lee, J. (2021). Young learners’ voices: Towards a learner-centered approach to understanding language assessment literacy. Language Testing, 38(3), 1-27. https://doi.org/10.1177/0265532221992274
Coombe, C., Troudi, S., & Al-Hamly, M. (2012). Foreign and second language teacher assessment literacy: Issues, challenges, and recommendations. In C. Coombe, P. Davidson, B. O’Sullivan, & S. Stoynoff (Eds.), The Cambridge guide to second language assessment (pp. 20-29). Cambridge University Press.
Coombe, C., & Davidson, P. (2021). Language assessment literacy. In H. Mohebbi & C. Coombe (Eds), Research questions in language education and applied linguistics (pp. 343-347). Springer Nature. https://doi.org/10.1007/978-3-030-79143-8_61
Creswell, J. (2015). 30 essential skills for the qualitative researcher. SAGE.
Davies, A. (2008). Textbook trends in teaching language testing. Language Testing, 25(3), 327- 347. https://doi.org/10.1177/0265532208090156
Fulcher, G. (2010). Practical language testing. Hodder Education.
Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113-132. https://doi.org/10.1080/15434303.2011.642041
Fulcher, G. (2020). Operationalizing assessment literacy. In D. Tsagari (Ed.), Language assessment literacy: From theory to practice (pp. 8 -28). Cambridge Scholars.
Frodden, M., Restrepo, M., & Maturana, L. (2004). Analysis of assessment instruments used in foreign language teaching. Íkala, Revista de Lenguaje y Cultura, 9(1), 171-201.
Giraldo, F. (2018). Language assessment literacy: Implications for language teachers. Profile: Issues in Teachers’ Professional Development, 20(1), 179-195. https://doi.org/10.15446/profile.v20n1.62089
Giraldo, F. (2021a). Language assessment literacy and teachers’ professional development: A review of the literature. Profile: Issues in Teachers’ Professional Development, 23(2), 265–279. https://doi.org/10.15446/profile.v23n2.90533
Giraldo, F. (2021b). Language assessment literacy: Insights for educating English language teachers through assessment. HOW, 28(3), 78–92. https://doi.org/10.19183/how.28.3.673
Giraldo, F., & Murcia, D. (2018). Language assessment literacy for pre-service teachers: Course expectations from different stakeholders. GiST: Education and Learning Research Journal, 16, 56-77. https://doi.org/10.26817/16925777.425
Giraldo, F., & Murcia, D. (2019). Language assessment literacy and the professional development of pre-service language teachers. Colombian Applied Linguistics Journal, 21(2), pp. 243-259. https://doi.org/10.14483/22487085.14514
Herrera, L., & Macías, D. (2015). A call for language assessment literacy in the education and development of teachers of English as a foreign language. Colombian Applied Linguistics Journal, 17(2). 17(2), 302-312. http://dx.doi.org/10.14483/udistrital.jour.calj.2015.2.a09
Inbar-Lourie, O. (2008). Constructing a language assessment knowledge base: A focus on language assessment courses. Language Testing, 25(3), 385–402. https://doi.org/10.1177/0265532208090158
Inbar-Lourie, O. (2012). Language assessment literacy. In C. Chapelle (Ed.), The encyclopedia of applied linguistics (pp. 2923–2931). John Wiley & Sons. https://doi.org/10.1002/9781405198431.wbeal0605
Inbar-Lourie, O. (2013). Guest Editorial to the special issue on language assessment literacy. Language Testing, 30(3), 301–307. https://doi.org/10.1177/0265532213480126
Inbar-Lourie, O. (2017). Language assessment literacy. In E. Shohamy, I. G. Or, & S. May (Eds.), Language testing and assessment: Encyclopedia of language and education (3rd ed., pp. 257–268). Springer. https://doi.org/10.1007/978-3-319-02261-1_19
Janssen, G. (2022). Local placement test retrofit and building language assessment literacy with teacher stakeholders: A case study from Colombia. Language Testing, 39(3), 377-400.
Jaramillo-Delgado, J., & Gil-Bedoya, A. M. (2019). Pre-service English language teachers’ use of reflective journals in an assessment and testing course. Funlam Journal of Students’ Research, (4), 210–218. https://doi.org/10.21501/25007858.3010
Kleinsasser, R. C. (2005). Transforming a postgraduate level assessment course: A second language teacher educator’s narrative. Prospect, 20(3), 77–102.
Koh, K., Burke, L., Luke, A., Gong, W., & Tan, C. (2018). Developing the assessment literacy of teachers in Chinese language classrooms: A focus on assessment task design. Language Teaching Research, 22(3), 264–288. https://doi.org/10.1177/1362168816684366
Kremmel, B., Eberharter, K., Holzknecht, F, & Konrad, E. (2018). Fostering language assessment literacy through teacher involvement in high-stakes test development. In D. Xerri & P. Vella Briffa (Eds.), Teacher involvement in high-stakes language testing (pp. 173–194). Springer. https://doi.org/10.1007/978-3-319-77177-9_10
Kremmel, B., & Harding, L. (2020). Towards a comprehensive, empirical model of language assessment literacy across stakeholder groups: Developing the language assessment literacy survey. Language Assessment Quarterly, 17(1), 100–120. https://doi.org/10.1080/15434303.2019.1674855
Kuckartz, U. (2014). Qualitative text analysis: A guide to methods, practice and using software. Sage.
Levi, T., & Inbar-Lourie, O. (2019). Assessment literacy or language assessment literacy: Learning from the teachers. Language Assessment Quarterly, 17(2), 168–182. https://doi.org/10.1080/15434303.2019.1692347
Malone, M. (2017). Training in language assessment. In E. Shohamy, I. G. Or, & S. May (Eds.), Language testing and assessment: Encyclopedia of language and education (3rd ed., pp. 225–240). Springer. https://doi.org/10.1007/978-3-319-02261-1_16
McNamara, T., & Roever, C. (2006). Language testing: The social dimension. John Wiley & Sons.
Montee, M., Bach, A., Donovan, A., & Thompson, L. (2013). LCTL teachers’ assessment knowledge and practices: An exploratory study. Journal of the National Council of Less Commonly Taught Languages, 13, 1–31.
Nguyen, P., & Dursun, A. (2022, September). Impact of a proficiency-oriented, assessment-driven, reverse design approach on assessment and teaching practices, and professional identity among foreign language instructors [Paper presentation]. Language Assessment Research Conference 2022, Chicago, United States. https://larc2022.event.uchicago.edu/program-schedule/
Nier, V. C., Donovan, A. E., & Malone, M. E. (2009). Increasing assessment literacy among LCTL instructors through blended learning. Journal of the National Council of Less Commonly Taught Languages, 7, 95–118.
Restrepo, E. M. (2020). Monitoring preservice teachers’ language assessment literacy development through journal writing. Malaysian Journal of ELT Research, 17(1), 38–52.
Richards, K. (2011). Case study. In E. Hinkel (Ed.), Handbook of research in second language teaching and learning. Volume II (pp. 207-221), Routledge.
Scarino, A. (2013). Language assessment literacy as self- awareness: Understanding the role of interpretation in assessment and in teacher learning. Language Testing, 30(3), 309-327. https://doi.org/10.1177/0265532213480128
Stabler-Havener, M. L. (2018). Defining, conceptualizing, problematizing, and assessing language teacher assessment literacy. Working Papers in Applied Linguistics & TESOL, 18(1), 1–22.
Sultana, N. (2019). Language assessment literacy: An uncharted area for the English language teachers in Bangladesh. Language Testing in Asia, 9(1), 2–14. https://doi.org/10.1186/s40468-019-0077-8
Taylor, L. (2013). Communicating the theory, practice and principles of language testing to test stakeholders: Some reflections. Language Testing, 30(3), 403–412. https://doi.org/10.1177/0265532213480338
Tsagari, D. (2021). Gauging the assessment literacy levels of English teachers in Norway. European Journal of Applied Linguistics and TEFL, 10(1), 161-191.
Tsagari, D., & Vogt, K. (2017). Assessment literacy of foreign language teachers around Europe: Research, challenges and future prospects. Papers in Language Testing and Assessment, 6(1), 41–63.
Vogt, K., & Tsagari, D. (2014). Assessment literacy of foreign language teachers: Findings of a European study. Language Assessment Quarterly, 11(4), 374-402. https://doi.org/10.1080/15434303.2014.960046
Vogt, K., Tsagari, D., & Spanoudis, G. (2020). What do teachers think they want? A comparative study of in-service language teachers’ beliefs on LAL training needs. Language Assessment Quarterly, 17(4), 386–409. https://doi.org/10.1080/15434303.2020.1781128
Yan, X. (2021, June 14-17). Towards a conceptual model of LAL development across stakeholder groups and contexts [Conference presentation]. Language Testing Research Colloquium, online. https://cdn.ymaws.com/www.iltaonline.com/resource/resmgr/docs/ltrc_2021/ltrc2021_schedule_version_ma.pdf