Standardized Test Results: An Opportunity for English Program Improvement

Main Article Content

Maureyra Jiménez
Caroll Rodríguez
Lourdes Rey Paba

Abstract

This case study explores the relationship between the results obtained by a group of Industrial Engineering students on a national standardized English test and the impact these results had on language program improvement. The instruments used were interviews, document analysis, observations, surveys, and test results analysis. Findings indicate that the program has some weaknesses in terms of number of hours of instruction, methodology, and assessment practices that affect the program content and the students’ expected performance. Recommendations relate to setting up a plan of action to make the program enhance student’s performance in English, bearing in mind that the goal is not the students’ preparation for the test but the development of language skills.

Article Details

How to Cite
Jiménez, M., Rodríguez, C., & Rey Paba, L. (2017). Standardized Test Results: An Opportunity for English Program Improvement. HOW, 24(2), 121–140. https://doi.org/10.19183/how.24.2.335
Section
Research Reports
Author Biographies

Maureyra Jiménez, Universidad Simon Bolivar

Maureyra Jiménez is an English teacher at Instituto de Lenguas Extranjeras at Universidad Simón Bolivar and holds a master degree in Teaching English.

Caroll Rodríguez

Caroll Rodríguez is an English teacher at Instituto de Lenguas Extranjeras at Universidad Simón Bolivar and holds a master degree in Teaching English.

Lourdes Rey Paba, Universidad del Norte

Lourdes Rey Paba is an English professor, researcher and Department Director at the undergraduate and graduate level in the Department of Foreign Languages at Instituto de Idiomas, Universidad del Norte. Her research interests include curriculum development, internationalization, language policies, and teacher development. Member of COLCIENCIAS-ranked research group: Language and Education.

References

Abedi, J. (2002). Standardized achievement tests and English language learners: Psychometrics issues. Educational Assessment, 8(3), 231-257. http://doi.org/10.1207/S15326977EA0803_02.

Alonso, J. C., Martin, J. D., & Gallo, B. (2015). El nivel de inglés después de cursar la educación superior en colombia: una comparación de distribuciones [English proficiency in Colombia after post-secondary education: A relative distribution analysis]. Revista de Economía Institucional, 17(33), 275-298. http://doi.org/10.18601/01245996.v17n33.12.

Auerbach, E. R. (1993). Reexaming English only in the ESL classroom. TESOL Quarterly, 27(1), 9-32. http://doi.org/10.2307/3586949.

Barletta, N., & May, O. (2006). Washback of the ICFES Exam: A case study of two schools in the Departamento del Atlántico. Íkala, Revista de Lenguaje y Cultura, 11(1), 235-261.

Bell, A., & Mladenovic, R. (2008). The benefits of peer observation of teaching for tutor development. High Education, 55(6), 735-752. http://doi.org/10.1007/s10734-007-9093-1.

Benavides, J. E. (2011). Las pruebas estandarizadas como forma de medición del nivel de inglés en la educación colombiana [Standardized tests as measurement for the level of English in Colombian education]. En J. Bastidas & G. Muñoz (Eds.), Fundamentos para el desarrollo profesional de los profesores de inglés (pp. 19-24). San Juan de Pasto, CO: Graficolor.

Bond, L. A. (1996). Norm- and criterion-referenced testing. Retrieved from ERIC database. (ED410316)

Buck, G. (1988). Testing listening comprehension in Japanese university entrance examinations. JALT Journal, 10(1), 15-42.

Council of Europe. (2001). Common European Framework of Reference for Languages: Learning, teaching, evaluation (Instituto Cervantes, Trans.). Madrid, ES: Ministerio de educación, cultura y deporte.

Davies, A., Brown, A., Elder, C., Hill, K., Lumley, T., & McNamara, T. (2002). Dictionary of language testing. Cambridge, UK: Cambridge University Press.

Genesee, F., & Upshur, J. A. (1996). Classroom-based evaluation in second language education. Cambridge, UK: Cambridge University Press.

Graddol, D. (2006). English next. London, UK: British Council.

Graham, C., & Neu, D. (2004). Standardized testing and the construction of governable persons. Journal of Curriculum Studies, 36(3), 295-319. http://doi.org/10.1080/0022027032000167080.

Green, A. (2007). IELTS washback in context: Preparation for academic writing in higher education. Cambridge, UK: Cambridge University Press.

ICONTEC. (2007). Norma Técnica Colombiana 5580. Bogotá, CO. Retrieved from http://www.mineducacion.gov.co/1621/articles-157089_archivo_pdf_NTC_5580.pdf.

Jin, Y. (2006). Improving test validity and washback: A proposed washback study on CET4/6. Foreign Language World, 6, 65-73.

Krashen, S. D., & Terrell, T. D. (1983). The natural approach: Language acquisition in the classroom. San Francisco, US: Pergamon/Alemany Press.

Lightbown, P. M., & Spada, N. (1990). Focus-on-form and corrective feedback incommunicative language teaching. Studies in second language acquisition, 12(4), 429-448. http://doi.org/10.1017/S0272263100009517.

Long, M. H. (1996). The role of linguistic environment. In W. C. Ritchie & T. K. Bhatia (Eds.), Handbook of second language acquisition (pp. 413-468). San Diego, US: Academic Press.

López, A. (2002). Washback: The impact of language tests on teaching and learning. Colombian Applied Linguistics Journal, 4, 50-63.

Martiyniuk, W. (2010). Studies in language testing aligning tests with the CEFR: Reflections on using the Council of Europe’s draft manual. Cambridge, UK: Cambrigde University Press.

McGrath, I. (2002). Materials evaluation and design for language teaching. Edinburgh, UK: Edinburgh University Press.

Messick, S. (1982). Issues of effectiveness and equity in the coaching controversy: Implications for educational and testing practice. Educational Psychologist, 17(2), 67-91. http://doi.org/10.1080/00461528209529246.

Ministerio de Educación Nacional, MEN. (2006). Estándares básicos de competencias en lenguas extranjeras: inglés [Basic standards of competences in foreign languages: English]. Bogotá, CO: Imprenta Nacional.

Ministerio de Educación Nacional, MEN. (2014). Colombia Very well! Programa Nacional de Inglés 2015-2025 (Documento de socialización). Bogotá, CO: Author. Retrieved from http://www.colombiaaprende.edu.co/html/micrositios/1752/articles-343287_recurso_1.pdf.

Pica, T. (1994). Research on negotiation: What does it reveal about second-language learning conditions, processes, and outcomes? Language Learning, 44(3), 493-527. http://doi.org/10.1111/j.1467-1770.1994.tb01115.x.

Powers, D. E. (1985). Effects of test preparation on the validity of a graduate admissions test. Applied Psychological Measurement, 9, 179-190. http://doi.org/10.1177/014662168500900206.

Powers, D. E., & Rock, D. A. (1999). Effects of coaching on SAT I: Reasoning test scores. Journal of Educational Measurement, 36(2), 93-118. http://doi.org/10.1111/j.1745-3984.1999.tb00549.x.

Richards, J. C. (2012). The role of textbooks in a language program. Retrieved from http://www.professorjackrichards.com/wp-content/uploads/role-of-textbooks.pdf.

Richards, J. C., & Rodgers, T. S. (1986). Approaches and methods in language teaching. Cambridge, UK: Cambridge University Press.

Robinson, P., & Gilabert, R. (2007). Task complexity, the cognition hypothesis and second language learning and performance. IRAL, 45(3), 161-176. http://doi.org/10.1515/iral.2007.007.

Rowley, J. (2002). Using case studies in research. Management Research News, 25(1), 16-27. http://doi.org/10.1108/01409170210782990.

Sánchez Jabba, A. (2013). Bilingüísmo en Colombia [Bilingualism in Colombia]. Cartagena de Indias, CO: Centro de Estudios Económicos Regionales, Banco de la República.

Schweers, W. C., Jr. (1999). Using L1 in the L2 classroom. English Teaching Forum, 37(2), 6-9.

Song, M.-J. (1998). Teaching reading strategies in an ongoing EFL university reading classroom. Asian Journal of English Language Teaching, 8(1), 41-54.

Valdez, M. G. (1999). How learners’ needs affect syllabus design. English Teaching Forum, 37(1).

Wallace, M. J. (1998). Action research for language teachers. Cambridge, UK: Cambridge University Press.

Woodward, T. (2001). Planning lessons and courses: Designing sequences of work for the language classroom. Cambridge, UK: Cambridge University Press. http://doi.org/10.1017/CBO9780511732973.

Xie, Q. (2013). Does test preparation work? Implications for score validity. Language Assessment Quarterly, 10(2), 196-218. http://doi.org/10.1080/15434303.2012.721423.