Language models are fundamental for many natural language processing applications. The most widely used type of language models are the corpus-based probabilistic ones. These models provide an estimate of the probability of a word sequence W based on training data. Therefore, large amounts of training data are required in order to ensure statistical significance. But even if the training data a...

An unsupervised and language independent lemmatization procedure has been developed for major Indian languages (Bengali, Hindi etc) which are morphologically very rich and agglutinative in nature. The task of a lemmatizer is mapping an inflected surface word to its appropriate dictionary root word and it is a pre-requisite for implementing several NLP tools like Word Sense Disambiguation system...

The SpecTcl project is a reaction against the tendency for nuclear physics data analysis packages to be complex works which require a large investment of effort on the part of the user before simple things can be done. Epitomizing these efforts are Paw, Root, and to a lesser extent the Java Analysis Studio. Paw has a large, complex and inconsistent command language to master as well. Root[4] ta...

The experimental two-level morphology of Estonian is under development at the University of Tartu. The language description, consisting of 45 two-level rules and over 200 lexicons has been implemented and tested using Xerox finite-state tools twolc and lexc. The root lexicons cover 400 most frequent stems at the present stage of development. The software has been designed to update the lexicon ...

Turkish language is an agglutinative language. It is possible to produce a very high number of words from the same root with suffixes [1]. Language modeling for agglutinative languages needs to be different than modeling of languages like English. Such languages also have inflections but not as many as an agglutinative language. Techniques which can be used for modeling agglutinative languages ...

Splitting of compound Telugu words into its components or root words is one of the important, tedious and yet inaccurate tasks of Natural Language Processing (NLP). Except in few special cases, at least one vowel is necessarily involved in Telugu conjunctions. In the result, vowels are often repeated as they are or are converted into other vowels or consonants. This paper describes issues invol...

one of the basic questions in the domain of lexical access and the process of word recognition in mental lexicon is how the native speaker can access the meaning of new complex words in his/her language and what factors affect  its speed? the aim of this study was to investigate empirically effective factors on the speed of lexical access to the derived words in persian mental lexicon. if we kn...