The Web as a Parallel Corpus

习惯优你

The Web as a Parallel Corpus
Philip Resnik∗ Noah A. Smith V,mA
University of Maryland Johns Hopkins University
Parallel corpora have become an essential resource for work in multilingual natural language processing. In this article, we report on our work using the STRAND system for mining parallel text on theWorldWideWeb, first reviewing the original algorithm and results and then presenting a set of significant enhancements. These enhancements include the use of supervised learning based on structural features of documents to improve classification performance, a new contentbased measure of translational equivalence, and adaptation of the system to take advantage of the Internet Archive for mining parallel text from theWeb on a large scale. Finally, the value of these techniques is demonstrated in the construction of a significant parallel corpus for a low-density language pair.

转自：http://www.nlpir.org/?action-viewnews-itemid-143