Many Natural Language Processing and Information Retrieval methods are based on the extensive use of text corpora. The credibility of the results can be heavily influenced by the underlying corpus quality. Much research has been utilizing Arabic corpora into various tasks of Arabic Information Processing. In this paper we discuss a suite of metrics that can be used to ascertain the quality of A...

This paper reports on a study thatinvestigated Iranian EFL high school students’ perceptions of written grammar feedback to specify their reasons for preferring comprehensive or selective feedback and choosing some feedback strategies. A questionnaire was administered to 100 EFL intermediate high school students who were selected based on their scores on a proficiency test. Moreover, semi-struc...

Chinese Word Sketch (CWS) provides a tool to identify the semantic distinctions of near synonyms in natural language use situation. This study has case 注 意 Zhùyì and 專 心 Zhuānxīn, with Gigaword_CNA Gigaword_XIN, two main sub-corpora CWS, as corpora for research. Based on comparison senses part speech (POS) from Net dictionaries, it is found that there are some disagreements POS between ones pre...

It seems widely agreed that IE (Information Extraction) is now a tested language technology that has reached precision+recall values that put it in about the same position as Information Retrieval and Machine Translation , both of which are widely used commercially. There is also a clear range of practical applications that would be eased by the sort of template-style data that IE provides. The...

Language statistics are widely used to characterize and better understand language. In parallel, the amount of text mining and information retrieval methods grew rapidly within the last decades, with many algorithms evaluated on standardized corpora, often drawn from newspapers. However, up to now there were almost no attempts to link the areas of natural language processing and language statis...

Here we present a survey of important work done on Comparable Corpora between the period 1995 to 2012. Unlike parallel corpora, which are clearly defined as translated texts, there is a wide variation of non-parallelism in comparable text. Non-parallelism is manifested in terms of differences in author, domain, topics, time period, language. The most common text corpora have non-parallelism in ...

Parallel sentences are a relatively scarce but extremely useful resource for many applications including cross-lingual retrieval and statistical machine translation. This research explores our new methodologies for mining such data from previously obtained comparable corpora. The task is highly practical since non-parallel multilingual data exist in far greater quantities than parallel corpora,...