Higher-level graphical and lexical punctuation (paragraphing, indentation, font changes, ...) must be taken into consideration in comprehension processes and text generation. In this paper, we analyse a class of text punctuation marks which includes lexical units (chapter, introduction). We give a method for the analysis of the semantics of these units, in terms of metalanguage. In addition, th...

(National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100080, China) Abstract: Based on the analysis of the usage and the syntactic function of Chinese punctuations, this paper proposes a new hierarchical approach to parsing the long Chinese sentences. In traditional parsing approaches, the parsing procedure is performed on one-level and the ...

We present a trainable model for identifying sentence boundaries in raw text. Given a corpus annotated with sentence boundaries, our model learns to classify each occurrence of . , ?, and / as either a valid or invalid sentence boundary. The training procedure requires no hand-crafted rules, lexica, part-of-speech tags, or domain-specific information. The model can therefore be trained easily o...