• Automated Writing Evaluation A Case of College Learners’ Perceived Ef-fects in Taiwan   [CCE 2013]
  • Author(s)
  • Bin-Bin Yu
  • Theimplementationof automated writing evaluation(AWE) softwareis to facilitate students’ writing developmentwith immediate computer-generated scores and diagnostic feedbackand to reduce instructors’heavyworkload.Learners’perceived effects ofusingAWE programs varied in the previous studies conducted in Taiwan due totheirlanguage proficiencylevel.The primary objective of the presentstudy is then to investigate how the implementation of the AWE program,Criterion, is perceived by college students with lower English language proficiency. Thisresearchwasdesigned as a case study. A total of 44 students enrolled in the evening session of the Applied Foreign Languages department at ascience and technologyuniversity in Taiwan participatedin the investigation.Two questionnaire surveys were conducted in this yearlong study. Initial survey results show that the majority ofthe learners held positive attitudes towards the use ofCriterionboth as anessay graderand as awriting assistance tool. Improved writing ability and increased learner motivation also indicate thatAWEsoftware can be a useful support insecond/foreign languagewriting pedagogy.
  • Automated Writing Evaluation;, Automated Essay Scoring; Writing Assessment; Essay Grader; e-rater
  • References
  • [1]
    M.Warschauer,"Invited commentary: New tools for teaching writing,"Language Learning & Technology,vol.14,pp.3-8, 2010.
    M.Warschauerand P.Ware,"Automated writing evaluation: Defining the classroom research agenda,"Language Teaching Research,vol.10,pp.1-24,2006.
    M. D.Shermisand J.Burstein,"Introduction,"inAutomatedEssayScoring: ACross-disciplinaryPerspective,M. D. ShermisandJ. Burstein,Eds.Mahwah, NJ: Lawrence Erlbaum, 2003,pp. xiii-xvi.
    E. Page,"Project essay grade: PEG,"inAutomatedEssayScoring: ACross-disciplinaryPerspective,M. D. ShermisandJ. Burstein,Eds.Mahwah, NJ: Lawrence Erlbaum, 2003,pp. 43-54.
    P. F. Ericsson,"The meaning of meaning: Is a paragraph more than an equation?"inMachineScoring ofStudentEssays: Truth andConsequences,P. F. EricssonandR. Haswell,Eds. Logan, UT: Utah State University Press,2006,pp. 28-37.
    A.Herringtonand C.Moran,"What happens when machines read our students’ writing?"CollegeEnglish,vol.63, pp.480-499, 2001.
    D. E.Powers, J. C.Burstein, M.Chodorow, M. E.Fowles,andK.Kukich,"Stumpinge-rater: Challenging the validity of automated essay scoring,"Computers in Human Behavior,vol.18, pp.103-134, 2002.
    J. Burstein,"The e-rater scoring engine: Automated essay scoring with natural language processing,"inAutomatedEssayScoring: ACross-disciplinaryPerspective,M. D. ShermisandJ. Burstein,Eds.Mahwah, NJ: Lawrence Erlbaum, 2003,pp. 113-121.
    J.Burstein,M.Chodorow,and C.Leacock,"Automated essay evaluation: The Criterion online writing service,"AI Magazine,vol.25,pp.27-36, 2004.
    S.Dikli,"An overview of automated scoring of essays,"J.of Technology, Learning, and Assessment,vol.5,pp.1-35, 2006.
    M.Taras,"Assessment – summative and formative – some theoretical reflections,"British Journal of Educational Studies,vol.53,pp.466-478, 2005.
    D. H.SchunkandB. J. Zimmerman, Eds. Self-regulation ofLearning andPerformance: Issues andEducationalApplications,Hillsdale, NJ: Lawrence Erlbaum Associates,1994.
    B. J. Zimmerman,"Self-regulated learning and academic achievement: An overview,"Educational Psychologist,vol.25,pp.3-17, 1990.
    N. D. Yang,"Using My Access in EFL writing,"inTheProceedings of 2004 International Conference and Workshop on TEFL & Applied Linguistics.Taipei: Ming Chuan University, 2004,pp. 550-564.
    C. F. E. ChenandW. Y. E. Cheng,"Beyond the design of automated writing evaluation: Pedagogical practices and perceived learning effectiveness in EFL writing classes,"Language Learning&Technology,vol.12,pp.94-112,2008.
    Y. Fang,"Perceptions of the computer-assisted writing program among EFL college learners,"Education Technology&Society,vol.13,pp.246-256,2010.
    C. Y. ChiuandW. S. Wu,"EFL learner’s perceived effects of a web-based writing program in an English composition class,"J.of National Huwei University of Science & Technology,vol.30,pp.51-60,2011.

Engineering Information Institute is the member of/source content provider to