Publishing Partner: Cambridge University Press CUP Extra Wiley-Blackwell Publisher Login
amazon logo
More Info


New from Oxford University Press!

ad

The Vulgar Tongue: Green's History of Slang

By Jonathon Green

A comprehensive history of slang in the English speaking world by its leading lexicographer.


New from Cambridge University Press!

ad

The Universal Structure of Categories: Towards a Formal Typology

By Martina Wiltschko

This book presents a new theory of grammatical categories - the Universal Spine Hypothesis - and reinforces generative notions of Universal Grammar while accommodating insights from linguistic typology.


New from Brill!

ad

Brill's MyBook Program

Do you have access to Dynamics of Morphological Productivity through your library? Then you can by the paperback for only €25 or $25! Find out more about Brill's MyBook program!


Academic Paper


Title: An Integrated Approach to Chinese Word Segmentation
Author: Guohong Fu
Email: click here to access email
Institution: Heilongjiang University
Linguistic Field: Computational Linguistics
Abstract: This paper presents an integrated approach to Chinese word segmentation. In this work, known word segmentation and unknown word identification are taken as one integrated process instead of two separate tasks. Furthermore, both known and unknown word candidates are scored equally with a hybrid model, in which three types of features are statistically computed and incorporated, including contextual information (viz. modified word bigram models), affinity relations between the components of words (viz. inside and outside word-juncture models), and the internal word-formation power of components in a word (viz. the word-formation patterns). To enhance the precision and avoid the problem of combination explosion in the construction of word candidates, in particular the unknown word candidates, a filter algorithm is used to block some ineligible unknown word candidates. In this way, ambiguities and unknown words can be resolved effectively. The results of our experiment on the Peking University corpus show that the proposed approach outperforms some other methods.
Type: Individual Paper
Status: In Progress


Back
Add a new paper
Return to Academic Papers main page
Return to Directory of Linguists main page