Pre-trained language models (LMs) encode rich information about linguistic structure but their knowledge lexical polysemy remains unclear. We propose a novel experimental setup for analyzing this in LMs specifically trained different languages (English, French, Spanish, and Greek) multilingual BERT. perform our analysis on datasets carefully designed to reflect sense distributions, control para...

†Konan University, ‡Hyogo University of Teacher Education, *Japan Institute for Educational Measurement, Inc. We eating shshi (sushi)ski. I read a book. I play baseball everyday. And My brother play baseball to. “Becose, Let‘s play baseball in Japan.” School trip is very fun. “But, it’s very busy.” Becaes I like school trip. I like foodamathya (green tea) I i it d f K t I l I Romanized Japanese...

Codes play an important role in the study of combinatorics on words. Recently, we introduced pcodes that play a role in the study of combinatorics on partial words. Partial words are strings over a finite alphabet that may contain a number of “do not know” symbols. In this paper, the theory of codes of words is revisited starting from pcodes of partial words. We present some important propertie...

‘Words, words, words.’ This was Hamlet’s reply to Polonius’ question, ‘What do you read, my lord?’ (Shakespeare, 1603) [1]. By repeating the word three times, Hamlet suggests that what he is reading is meaningless. Before launching the journal Archives of Public Health, we have asked ourselves: ‘Do we not already produce too many words too many journals?’ or in other words ‘What is the added va...

The aim of this paper is to call to attention a very large and important area of human factors engineering that is almost entirely neglected. This area consists of the language and the words that are attached to the tools, machines, systems, and operations with which human factors engineers are concerned. Examples, illustrations, and data are cited to show that changes in the words used in man-...