<?xml version="1.0" standalone="yes"?>
<Paper uid="C00-2152">
  <Title>An Integrated Architecture for Example-Based Machine Translation</Title>
  <Section position="9" start_page="1033" end_page="1034" type="concl">
    <SectionTitle>
7 Evaluation and Conclusions
</SectionTitle>
    <Paragraph position="0"> We evaluated the trauslation system using a random 500-expression sample from the unseen test set (see Section 2 above). The translatious were manually assigned to one of the following categories o1' translatiou quality: Failure. Complete translation failure, due to lack of coverage of a rule-based component.</Paragraph>
    <Paragraph position="1">  Wrong. A translation that is COlnpletely wrong, or that has major errors in an important part, such as in the main clause.</Paragraph>
    <Paragraph position="2"> Major Problem. A translation that has a missing, extra, or incorrect constituent, such as a subject, object, or adjectival/prepositional predicate.</Paragraph>
    <Paragraph position="3"> Minor Problem. A translation that l-ms a missing, extra, or incorrect minor part, such as an intensifier, tense, aspect, temporal or locative adjunct, adverb, adjective or other prenominal modifier, prepositional phrase, verb conjugation form, adjective form, or required word or constituent order.</Paragraph>
    <Paragraph position="4"> Stylistic Problem. Slylistic problems include awkward but tolerable word order, incorrect Japanese particles, incorrect idioms, and silnilar. Flawless. A translation that does not exhibit any of the above problems is considered flawless. The results of the ewtluation are shown in Table 1 below. Overall, 84% of the translations convey the meaning in an acceptable manner.</Paragraph>
    <Paragraph position="5"> We also ewtluated the computational resource requirements of the system. On a Pentium II1 running at 500 MHz, the average translation speed was 0.44 seconds. The memory requirements are summarized in Table 2 below.</Paragraph>
    <Paragraph position="6">  Our plans for further work include extending the size of the input w)cabulary, and developing mechanisms for closer integration with speech recognition and speech synthesis components for speech-to-speech translation. We are also working on the Japanese-to-English translation direction, and we plan to report results on this in the future.</Paragraph>
  </Section>
class="xml-element"></Paper>