<?xml version="1.0" standalone="yes"?>
<Paper uid="N03-2024">
  <Title>References to Named Entities: a Corpus Study</Title>
  <Section position="7" start_page="0" end_page="0" type="evalu">
    <SectionTitle>
6 Evaluation
</SectionTitle>
    <Paragraph position="0"> The rules were used to rewrite 11 summaries produced by the Columbia University summarizer. Four human judges were then given the pairs of the original summary and its rewritten variant (Figure 4). They were asked to decide if they prefer one text over the other or if they are equal.</Paragraph>
    <Paragraph position="1"> The majority preference was always for the rewritten version and it could be reached in all but one case, where two of the judges preferred the rewritten version and two, the original. The distribution of the 44 individual preferences for a rewritten or original summary were 89% for the rewrite version, 9% for the original version and 2% no preference for a version.</Paragraph>
    <Paragraph position="2"> The rewrite module is currently implemented and it runs daily as part of the Columbia Newsblaster summarization system that can be found online at  Original summary: Presidential advisers do not blame O'Neill, but they've long recognized that a shakeup of the economic team would help indicate Bush was doing everything he could to improve matters. U.S. President George W. Bush pushed out Treasury Secretary Paul O'Neill and top economic adviser Lawrence Lindsey on Friday, launching the first shake - up of his administration to tackle the ailing economy before the 2004 election campaign.</Paragraph>
    <Paragraph position="3"> Rewritten summary: Presidential advisers do not blame Threasury Secretary Paul O'Neill, but they've long recognized that a shakeup of the economic team would help indicate U.S. President George W. Bush was doing everything he could to improve matters. Bush pushed out O'Neill and White House economic adviser Lawrence Lindsey on Friday, launching the first shake-up of his administration to tackle the ailing economy before the 2004 election campaign.</Paragraph>
  </Section>
class="xml-element"></Paper>