<?xml version="1.0" standalone="yes"?>
<Paper uid="P98-1084">
  <Title>Integrating Text Plans for Conciseness and Coherence*</Title>
  <Section position="9" start_page="517" end_page="517" type="evalu">
    <SectionTitle>
7 Results
</SectionTitle>
    <Paragraph position="0"> We tested RTPI using the corpus of critiques generated by TraumaTIQ. A set of critiques was extracted from the middle of each of 48 trauma cases, and RST-style text plans were automatically generated for all the critiques. Then RTPI ran each set, and messages resulting from a template-based realization of RTPTs text plans were analyzed for conciseness and coherence.</Paragraph>
    <Paragraph position="1"> We are currently using templates for sentence realization since we have been working in the domain of trauma care, where fast real-time response is essential.</Paragraph>
    <Paragraph position="2"> There was a 18% reduction in the average number of individual text plans in the 48 sets examined. The results for individual sets ranged from no integration in cases where all of the text plans were independent of one another, to a 60% reduction in sets that were heavily inter-related. More concise messages also resulted from a 12% reduction in the number of references to the diagnostic and therapeutic actions and objectives that are the subject of this domain. The new text plans also allowed some references to be replaced by pronouns during realization, making the messages shorter and more natural.</Paragraph>
    <Paragraph position="3"> To evaluate coherence, messages from twelve cases 1 were presented, in randomly ordered blind pairs, to three human subjects not affiliated with our project. The written instructions given to the subjects instructed them to note whether one set of messages was more comprehensible, and if so, to note why. Two subjects preferred the new messages in 11 of 12 cases, and one subject preferred them in all cases. All subjects strongly preferred the messages produced from the integrated text plan 69% of the time.</Paragraph>
  </Section>
class="xml-element"></Paper>