COMPARISON OF PERFORMANCES OF DIFFERENT SVM IMPLEMENTATIONS WHEN USED FOR AUTOMATED EVALUATION OF DESCRIPTIVE ANSWERS

Abstract
In this paper, we studied the performances of models built using various SVM implementations during the multiclass classification task of automated evaluation of descriptive answers. The performances were evaluated on five datasets each with 900 samples and with each of the datasets treated using symmetric uncertainty feature selection filter. We quantitatively analyzed the best SVM implementation technique from amongst the 17 different SVM implementation combinations derived by using various SVM classifier libraries, SVM types and Kernel methods. Accuracy, F Score, Kappa and Area under ROC curve are used as model evaluation metrics in order to evaluate the models and rank them according to their performances. Based on the results, we derived the conclusion that SMO classifier when used with Polynomial kernel is the overall best performing classifier applicable for auto evaluation of descriptive answers.

Authors
C. Sunil Kumar1, R. J. Rama Sree2
Bharathiar University, India1, Rashtriya Sanskrit Vidyapeetha, India2

Keywords
Descriptive Answers, Auto Evaluation, SVM, LibLINEAR, LibSVM, SMO, Kernels
Published By :
ICTACT
Published In :
ICTACT Journal on Soft Computing
( Volume: 5 , Issue: 3 )
Date of Publication :
April 2015

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.