PROBING INTO STUDENTS’ USE OF AUTOMATED FEEDBACK IN ESSAY REVISION: A CASE STUDY OF TWO CHINESE EFL LEARNERS

Wang Jian, Zhang Tengyao

Abstract


Automated feedback (AF) has been extensively investigated by L2 researchers, but in-depth research on English learners’ use of AF to revise their English essays is still limited. Moreover, whether there exist individual differences in essay revision remains underexplored. To address these gaps, this cross-sectional study, by adopting a qualitative research method, mainly reports on two Chinese EFL (English as a foreign language) learners’ use of the feedback provided by Pigai, an AWE (automated writing evaluation) system. First, both researchers analyzed learners’ different writing drafts to see where changes were made. Then, learners participated in a retrospective interview regarding their revision behaviors. The writing drafts and the interview data reveal individual differences between both writers’ revision behaviors. Specifically, one writer accepted only a tiny portion of Pigai’s suggestions. In contrast, the other not only took up automated feedback but actively made self-initiated revisions. Such differences might be attributed to their gender difference, English proficiency, interest and motivation levels in English learning, stances on automated feedback, and writing experiences in secondary school.


Keywords


automated feedback; essay revision; Chinese EFL writers; contributing factors

Full Text:

PDF

References


Attali, Y. (2004). Exploring the feedback and revision features of Criterion. Journal of Second Language Writing, 14(3), 191-205.

Bai, L. F., & Hu, G. W. (2017). In the face of fallible AWE feedback: How do students respond? Educational Psychology, 37(1), 67-81.

Bitchener, J., & Ferris, D. R. (2012). Written corrective feedback in second language acquisition and writing. Routledge. https://doi.org/10.4324/9780203832400

Chapelle, C. A., Cotos, E., & Lee, J. (2015). Validity arguments for diagnostic assessment using automated writing evaluation. Language Testing, 32(3), 385-405. https://doi.org/10.1177/0265532214565386

El-Ebyary, K., & Windeatt, S. (2010). The impact of computer-based feedback on students’ written work. International Journal of English Studies, 10(2), 121-142. https://doi.org/10.6018/ijes.10.2.119231

Ferris, D. R. (2010). Second language writing research and written corrective feedback in SLA: Intersections and practical applications. Studies in Second Language Acquisition, 32(2), 181-201.

Foltz, P. W., & Rosenstein, M. (2013, Dec.). Tracking student learning in a state-wide implementation of automated writing scoring [Conference session]. NIPS Workshop on Data Driven Education, Lake Tahoe, Nevada, USA. https://doi.org/10.1.1.465.1132

Hayes, J. R. (1996). A new framework for understanding cognition and affect in writing. In Levy, C.M., & Ransdell, S. (Eds.). The Science of Writing (pp. 1-27). Lawrence Erlbaum. https://psycnet.apa.org/record/1996-98203-001

Huang, J., & Zhang, W. X. (2014). The Impact of the Integrated Feedback on Students’ Writing Revision. Foreign Language of China, 11(1), 51-56.

Kellogg, R. T. (1996). A model of working memory in writing. In Levy, C.M., & Ransdell, S. (Eds.). The Science of Writing (pp. 57-71). Lawrence Erlbaum. https://psycnet.apa.org/record/1996-98203-003

Kormos, J. (2012). The role of individual differences in L2 writing. Journal of Second Language Writing, 21(4), 390-403.

Link, S., Mehrzad, M., & Rahimi, M. (2022). Impact of automated writing evaluation on teacher feedback, student revision, and writing improvement. Computer Assisted Language Learning, 35(4), 605-634.

Liu, S., & Yu, G. (2022). L2 learners’ engagement with automated feedback: An eye-tracking study. Language Learning & Technology, 26(2), 78-105.

Lu, L. (2016). A study of the second writing process based on an automated essay evaluation tool. Foreign Language World, 173(2), 88-96.

Manchón, R. (Ed.). (2011). Learning-to-write and Writing-to-learn in an Additional Language. John Benjamins Publishing. https://doi.org/10.1075/lllt.31

Ramineni, C., Trapani, C. S., Williamson, D. M., Davey, T., & Bridgeman, B. (2012). Evaluation of the e-rater® Scoring Engine for the GRE® Issue and Argument Prompts. Research Report RR-12-02,2012, Educational Testing Service, Princeton, NJ, USA. https://doi.org/10.1002/j.2333-8504.2012.tb02284.x

Ranalli, J. (2021). L2 student engagement with automated feedback on writing: Potential for learning and issues of trust. Journal of Second Language Writing, 52, 1-16.

Ranalli, J., & Yamashita, T. (2022). Automated written corrective feedback: Error-correction performance and timing of delivery. Language Learning & Technology, 26(1), 1-25.

Ranalli, J., Link, S., & Chukharev-Hudilainen, E. (2017). Automated writing evaluation for formative assessment of second language writing: investigating the accuracy and usefulness of feedback as part of argument-based validation. Educational Psychology, 37(1), 8-25.

Roscoe, R. D., Wilson, J., Johnson, A. C., & Mayra, C. R. (2017). Presentation, expectations, and experience: Sources of student perceptions of automated writing evaluation. Computers in Human Behavior, 70, 207-221.

Shang, H. F. (2022). Exploring online peer feedback and automated corrective feedback on EFL writing performance. Interactive Learning Environments, 30(1), 4-16.

Stevenson, M., & Phakiti, A. (2014). The effects of computer-generated feedback on the quality of writing. Assessing Writing, 19, 51-65.

Truscott, J. (2009). Arguments and appearances: a response to Chandler. Journal of Second Language Writing, 18(1), 59-60.

Wang, J., & Bai, L. F. (2021). Unveiling the Scoring Validity of Two Chinese Automated Writing Evaluation Systems: A Quantitative Study. International Journal of English Linguistics, 11(2), 68-84.

Wu, Y. (2016). Impact of Automated Writing Evaluation Feedback and Human Feedback on Text Revision in Chinese EFL Learners’ Argumentative Writing [Doctoral dissertation]. Tsinghua University.

Wu, Y., & Zhang, W. X. (2016). Impact of automated writing evaluation system and teacher feedback on students’ writing revision. Foreign Language Education in China, 9(1), 12-19, 91.

Zhang, Z. V., & Hyland, K. (2018). Student engagement with teacher and automated feedback on L2 writing. Assessing Writing, 36, 90-102.

Zhang, Z. V., & Hyland, K. (2022). Fostering student engagement with feedback: An integrated approach. Assessing Writing, 51, 1-16.




DOI: https://doi.org/10.36706/jele.v9i2.18349

Refbacks

  • There are currently no refbacks.


License URL: https://creativecommons.org/licenses/by-sa/4.0/

PUBLISHER:

ENGLISH EDUCATION STUDY PROGRAM, FACULTY OF TEACHER TRAINING AND EDUCATION, UNIVERSITAS SRIWIJAYA                       

JLN SRIJAYA NEGARA BUKIT BESAR PALEMBANG 30137, SUMATERA SELATAN, INDONESIA

EMAIL: jele@fkip.unsri.ac.id

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

 VIEW