Comparing frequency counts over texts or corpora is an important task in many applications and scientific disciplines. Given a text corpus, we want to test a hypothesis, such as “word X is frequent”, “word X has become more frequent over time”, or “word X is more frequent in male than in female speech”. For this purpose we need a null model of word frequencies. The commonly used bag-of-words mo...

In order to adjust observed frequencies of occurrence, previous studies have suggested a variety of measures of dispersion and adjusted frequencies. In part I of this article, I first summarily reviewed many of these measures as well as a variety of their shortcomings and then suggested an alternative measure, DP, for deviation of proportions, which I argued to be conceptually simpler, but at t...

Although genetic variants that affect susceptibility to coronary artery disease (CAD) have been greatly known, a number of these single nucleotide polymorphisms (SNPs) remain to be analyzed in populations with different ethnicities. CAD is influenced by numerous genetic, environmental, and lifestyle factors, and is an important reason for mortality around the globe. In this study, a novel SNP (...

1 Manana Kereselidze, Dr., V. Gulisashvili Forest Institute of the Agricultural University of Georgia, David Aghmashenebeli Alley, 13-th km., 0159, Tbilisi, Georgia, [email protected] 2 Slavimira Draganova, Dr., Assoc.Prof., Institute of Soil Science, Agrotechnologies and Plant Protection, 9 Shosse Bankya Str., 1080 Sofia, Bulgaria, sdraganova19@ gmail.com 3,5 Daniela Pilarska, Dr., P...

Lexical co-occurrence is an important cue for detecting word associations. We present a theoretical framework for discovering statistically significant lexical co-occurrences from a given corpus. In contrast with the prevalent practice of giving weightage to unigram frequencies, we focus only on the documents containing both the terms (of a candidate bigram). We detect biases in span distributi...

Identifying the lemma of a Named Entity is important for many Natural Language Processing applications like Information Retrieval. Here we introduce a novel approach for Named Entity lemmatisation which utilises the occurrence frequencies of each possible lemma. We constructed four corpora in English and Hungarian and trained machine learning methods using them to obtain simple decision rules b...

The FCC has proposed that the unassigned frequencies between broadcast TV channels – the TV band “white space” – should be opened on an unlicensed basis to certified devices that could offer a range of wireless services to the public. Access to the vacant TV channels in each market has been the subject of intense lobbying, yet far too many of the arguments against white space devices rely upon ...

Previous research has shown that the plausibility of an adjective-noun combination is correlated with its corpus co-occurrence frequency. In this paper, we estimate the co-occurrence frequencies of adjective-noun pairs that fail to occur in a 100 million word corpus using smoothing techniques and compare them to human plausibility ratings. Both class-based smoothing and distance-weighted averag...

The frequencies of occurrence patterns in five fields the sub-toe area soles 1,600 men and women from 15 voivodships northern Poland were demonstrated. bilateral intersexual differences examined obtained results compared with pattern population central south-eastern Poland.