File Information
File: 05-lr/acl_arc_1_sum/cleansed_text/xml_by_section/evalu/85/e85-1030_evalu.xml
Size: 1,185 bytes
Last Modified: 2025-10-06 13:59:58
<?xml version="1.0" standalone="yes"?> <Paper uid="E85-1030"> <Title>A NATUWAL LANGUAGE INTERFACE USING A WORLD MODEL</Title> <Section position="8" start_page="209" end_page="211" type="evalu"> <SectionTitle> EVALUATION </SectionTitle> <Paragraph position="0"> We have applied KID to three different applications; housing, sales, and new drug tests. Figure 12 shows a result of an evaluation of KID.</Paragraph> <Paragraph position="1"> The target domain is a new drug test. We prepared 400 sentences for the evaluation. In a little less than a month, 91% of the sentences had been accepted. We decided a sentence is accepted, if the sentence is correctly analyzed and the correct data is retrieved from the database. We divided the 4OO sentences into four groups and performed a blind test and a full capability test for each group, in stages. In the blind test, sentences are tested without changing any knowledge of the system. In the full capability test, we make all possible extensions or modifications to accept the sentences. The acceptance ratio of the blind test is improving, so we believe KID will soon become available for practical use.</Paragraph> </Section> class="xml-element"></Paper>