<?xml version="1.0" standalone="yes"?>
<Paper uid="H94-1019">
  <Title>AUTOMATIC EVALUATION OF COMPUTER GENERATED TEXT: A PROGRESS REPORT ON THE TEXTEVAL PROJECT</Title>
  <Section position="3" start_page="0" end_page="0" type="intro">
    <SectionTitle>
INTRODUCTION
</SectionTitle>
    <Paragraph position="0"> The TextEval project aims to explore and develop a new approach to the automatic evaluation of computer-generated texts, based on the use of standard sets.We believe that fast, accurate and automatic evaluation methods are vital to the development of any large piece of natural language software, and note that current methods, which involve extensive intervention by human experts, are too costly to be a routine part of the development cycle. For pragmatic reasons we are working on translations, but in principle the techniques would apply to any body of suitably comparable texts, such as alternative versions of an instruction sheet.</Paragraph>
    <Paragraph position="1"> Our purpose in this presentation is to describe a framework for the automatic evaluation of translation quality. We will start by presenting the results of an evaluation experiment, then use the results of this to assess the usefulness of several alternative automatic metrics.</Paragraph>
  </Section>
class="xml-element"></Paper>