<?xml version="1.0" standalone="yes"?>
<Paper uid="W03-1612">
  <Title>Paraphrasing Rules for Automatic Evaluation of Translation into Japanese</Title>
  <Section position="7" start_page="0" end_page="0" type="concl">
    <SectionTitle>
6 Conclusion and Future Work
</SectionTitle>
    <Paragraph position="0"> This paper has proposed an automatic translation evaluation method applicable to Japanese translation evaluation. The paraphrasing rules that cancel out the differences in writing styles contributed to improve the reliability of the automatic evaluation. The proposed evaluation method with paraphrasing rules achieved a high correlation of 0.93 with the human evaluation, while the correlation was 0.80 without the rules.</Paragraph>
    <Paragraph position="1"> The experiments clarified how much the paraphrasing rules improved the evaluation by comparing the correlations. This means our system can evaluate not only the translation quality but also the paraphrasing rules under the assumption that the more properly the semantically similar sentences are judged as close sentences the more reliable the translation evaluation is. Therefore the translation evaluation gives us an objective evaluation method of the paraphrasing quality that has been difficult to evaluate. null This paper focuses on non-lexical paraphrasing since lexical paraphrasing rules make the translation evaluation inconsistent, but if an exhaustive and precise set of paraphrasing rules can be generated, it will be useful for translation evaluation, and its appropriateness should be shown by the reliability of the translation evaluation. In order to develop such desirable paraphrasing rules, the automatic acquisition of paraphrasing rules will be our next research direction.</Paragraph>
  </Section>
class="xml-element"></Paper>