File Information
File: 05-lr/acl_arc_1_sum/cleansed_text/xml_by_section/abstr/99/w99-0702_abstr.xml
Size: 768 bytes
Last Modified: 2025-10-06 13:49:58
<?xml version="1.0" standalone="yes"?> <Paper uid="W99-0702"> <Title>Experiments in Unsupervised Entropy-Based Corpus Segmentation</Title> <Section position="1" start_page="0" end_page="0" type="abstr"> <SectionTitle> Abstract </SectionTitle> <Paragraph position="0"> The paper presents an entropy-based approach to segment a corpus into words, when no additional information about the corpus or the language, and no other resources such as a lexicon or grammar are available. To segment the corpus, the algorithm searches for separators, without knowing a priory by which symbols they are constituted. Good results can be obtained with corpora containing &quot;clearly perceptible&quot; separators such as blank or new-line.</Paragraph> </Section> class="xml-element"></Paper>