Primary Submission Contact
Lindsey Arndt
Faculty Sponsor
Melissa Desjarlais, Michael Glass
Faculty Sponsor Email Address
melissa.desjarlais@valpo.edu, michael.glass@valpo.edu
College
Arts and Sciences
Department/Program
Dept. of Mathematics and Statistics/ Dept. of Computing and Information Sciences
Document Type
Poster Presentation
Date
Fall 10-27-2017
Abstract
The COMPS project employs computer chat for students working in small groups solving classroom problems. This summer’s project aims to build computer classifiers that could effectively “look over the shoulders” of the students while working, to approximately recognize whether the students are engaging in productive discussion. Research questions are: can we write machine classifiers that can recognize reasoning, agreement, and disagreement in student discussions? Can we achieve this using only a common English vocabulary?
Several thousand lines of COMPS transcripts were manually annotated. A topic modelling program was used to determine 10 main topics which appeared in the transcripts and the words in those topics. A Linear Classifier and a Support Vector Machine Classifier used the topic model to predict the annotation of each line of dialogue.
To address the common English vocabulary research question, an intersection of many transcripts from different sources was combined with Google word lists and modified to accommodate text-chat conventions.
In the normal vocabulary, we found f1 scores of 0.7 and above for reasoning. Using only common vocabulary, the scores were slightly lower.
The next step is to train our topic model on a combination of transcripts and apply it to other transcripts from different student discussions.
Recommended Citation
Arndt, Lindsey K.; Kalafatis, Stamatina E.; and Graham, Emily, "Identifying Student Discussion in Computer-Mediated Problem Solving Chat" (2017). Fall Interdisciplinary Research Symposium. 82.
https://scholar.valpo.edu/fires/82
Additional Presentation Information
Wall Poster
Biographical Information about Author(s)
Lindsey, Emily, and Tina are all secondary education and mathematics majors at Valparaiso University interested in studying COMPS because of its educational benefits. COMPS was never experienced prior to this project, but as education majors, studying its uses and advantages has led to an interest in its applications for the classroom setting. In the future, the goal is to be able to use COMPS in the classroom as well as for distance learning.