This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
2009 WRI World Congress on Computer Science and Information Engineering
A Novel Technique for Automated Linguistic Quality Assessment of Students' Essays Using Automatic Summarizers
Los Angeles, California USA
March 31-April 02
ISBN: 978-0-7695-3507-4
In this paper, experiments have addressed the calculation of inter-annotator inconsistency in selecting the content in both manual and automatic summarization of sample TOEFL essays. A new finding is that the linguistic quality of source essay has a very strong correlation with the degree of disagreement among human assessors to what should be included in a summary. This leads to a fully automated essay evaluation technique based on degree of disagreement among automated summarizes. ROUGE evaluation is used to measure the degree of inconsistency among the participants (human summarizers and automatic summarizers). This automated essay evaluation technique is potentially an important contribution with wider significance.
Index Terms:
Automatic Summarization, Summarization Evaluation, ROUGE Evaluation
Citation:
Seemab Latif, Mary McGee Wood, "A Novel Technique for Automated Linguistic Quality Assessment of Students' Essays Using Automatic Summarizers," csie, vol. 5, pp.144-148, 2009 WRI World Congress on Computer Science and Information Engineering, 2009
Usage of this product signifies your acceptance of the Terms of Use.