<?xml version="1.0" standalone="yes"?>
<Paper uid="I05-2014">
  <Title>ATR - Spoken language communication research labs</Title>
  <Section position="6" start_page="81" end_page="81" type="concl">
    <SectionTitle>
6 Conclusion
</SectionTitle>
    <Paragraph position="0"> We studied the equivalence of applying the BLEU formula in character M-grams instead of word N-grams. Our study showed a high correlation, a good agreement in judgement, and an analogy of behaviour for definite corresponding values of M and N. For the most widely used value of N, 4, we determined a corresponding value in characters of 18.</Paragraph>
    <Paragraph position="1"> Consequently, this study paves the way to the application of BLEU (in characters) in objective evaluation campaigns of automatic translation into languages without word delimiters, like Chinese or Japanese, as it avoids any problem with segmentation.</Paragraph>
  </Section>
class="xml-element"></Paper>