Publishing Partner: Cambridge University Press CUP Extra Publisher Login
amazon logo
More Info


New from Oxford University Press!

ad

The Language Hoax

By John H. McWhorter

The Language Hoax "argues that that all humans process life the same way, regardless of their language."


New from Cambridge University Press!

ad

Language and Development in Africa

By H. Ekkehard Wolff

Language and Development in Africa "discusses the resourcefulness of languages, both local and global, in view of the ongoing transformation of African societies as much as for economic development.. "


The LINGUIST List is dedicated to providing information on language and language analysis, and to providing the discipline of linguistics with the infrastructure necessary to function in the digital world. LINGUIST is a free resource, run by linguistics students and faculty, and supported primarily by your donations. Please support LINGUIST List during the 2016 Fund Drive.

Academic Paper


Title: A cross-corpus study of subjectivity identification using unsupervised learning
Author: Dong Wang
Institution: University of Texas at Dallas
Author: Yang Liu
Institution: University of Texas at Dallas
Linguistic Field: Computational Linguistics; Text/Corpus Linguistics
Abstract: In this study, we investigate using unsupervised generative learning methods for subjectivity detection across different domains. We create an initial training set using simple lexicon information and then evaluate two iterative learning methods with a base naive Bayes classifier to learn from unannotated data. The first method is self-training, which adds instances with high confidence into the training set in each iteration. The second is a calibrated EM (expectation-maximization) method where we calibrate the posterior probabilities from EM such that the class distribution is similar to that in the real data. We evaluate both approaches on three different domains: movie data, news resource, and meeting dialogues, and we found that in some cases the unsupervised learning methods can achieve performance close to the fully supervised setup. We perform a thorough analysis to examine factors, such as self-labeling accuracy of the initial training set in unsupervised learning, the accuracy of the added examples in self-training, and the size of the initial training set in different methods. Our experiments and analysis show inherent differences across domains and impacting factors explaining the model behaviors.

CUP AT LINGUIST

This article appears IN Natural Language Engineering Vol. 18, Issue 3, which you can READ on Cambridge's site .



Add a new paper
Return to Academic Papers main page
Return to Directory of Linguists main page