Assessing distance learning student's performance: A natural language processing approach to analyzing class discussion messages

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

In classes supported by electronic messaging systems, students are required or encouraged to discuss the class topics and share their knowledge by posting text messages and replying to others. When the amount of messages is large, it is difficult for the instructor to read through all messages and evaluate student's performance. We apply natural language processing techniques to analyze the course messages to assess student's performance. Students are evaluated from three aspects: knowledge learned from the class, effort devoted to the class, and the activeness of their participation; three measures - keyword density (KD), message length (ML), and message count (MC), are derived from the text messages for each evaluation aspect respectively. The three measures are then combined to compute an overall performance indicator (PI) score for each student. The experiment shows that there is a high correlation between the PI scores and the actual grades; the rank order of students by the PI scores and that by the actual grades are highly correlated as well.

Original languageEnglish (US)
Title of host publicationInternational Conferen ON Information Technology
Subtitle of host publicationCoding Computing, ITCC 2004
EditorsP.K. Srimani, A. Abraham, M. Cannataro, J. Domingo-Ferrer, R. Hashemi
Pages192-196
Number of pages5
DOIs
StatePublished - Jul 7 2004
EventInternational Conference on Information Technology: Coding Computing, ITCC 2004 - Las Vegas, NV, United States
Duration: Apr 5 2004Apr 7 2004

Publication series

NameInternational Conference on Information Technology: Coding Computing, ITCC
Volume1

Other

OtherInternational Conference on Information Technology: Coding Computing, ITCC 2004
CountryUnited States
CityLas Vegas, NV
Period4/5/044/7/04

All Science Journal Classification (ASJC) codes

  • Software
  • Information Systems
  • Engineering(all)

Keywords

  • Automated grading
  • Education technology
  • Keyword density
  • Natural language processing

Fingerprint Dive into the research topics of 'Assessing distance learning student's performance: A natural language processing approach to analyzing class discussion messages'. Together they form a unique fingerprint.

Cite this