An Evaluation Of Text Classification Methods For Literary Study  

Oleh:

Yu, Bei

Jenis: Article from Journal - e-Journal
Dalam koleksi: Literary and Linguistic Computing vol. 23 no. 3 (Sep. 2008), page 327-343.
Fulltext: Vol 23, 3, p 327-343.pdf (350.89KB)

Isi artikel

This article presents an empirical evaluation of text classification methods in literary domain. This study compared the performance of two popular algorithms, nai¨ve Bayes and support vector machines (SVMs) in two literary text classification tasks: the eroticism classification of Dickinson’s poems and the sentimentalism classification of chapters in early American novels. The algorithms were also combined with three text pre-processing tools, namely stemming, stopword removal, and statistical feature selection, to study the impact of these tools on the classifiers’ performance in the literary setting. Existing studies outside the literary domain indicated that SVMs are generally better than nai¨ve Bayes classifiers. However, in this study SVMs were not all winners. Both algorithms achieved high accuracy in sentimental chapter classification, but the nai¨ve Bayes classifier outperformed the SVM classifier in erotic poem classification. Self-feature selection helped both algorithms improve their performance in both tasks. However, the two algorithms selected relevant features in different frequency ranges, and therefore captured different characteristics of the target classes. The evaluation results in this study also suggest that arbitrary featurereduction steps such as stemming and stopword removal should be taken very carefully. Some stopwords were highly discriminative features for Dickinson’s erotic poem classification. In sentimental chapter classification, stemming undermined subsequent feature selection by aggressively conflating and neutralizing discriminative features.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali