<?xml version="1.0" standalone="yes"?>
<Paper uid="W98-1237">
  <Title>Position Paper on Appropriate Audio/Visual Turing Test</Title>
  <Section position="3" start_page="0" end_page="0" type="metho">
    <SectionTitle>
2. A Matter of Degree
</SectionTitle>
    <Paragraph position="0"> The question arises, though, as to how well sighted and acute of hearing does a machine need to be to qualify for the Loehner Prize? Drawing on an icon from science fiction, it seems to me that the intention of Loebner's audio/visual Turing Test is to identify a machine which is in the likeness of Author C. Clark's HAL. But does the Loebner Prize winner's entrant need to be in the state of perfection HAL was portrayed in in 20017 I believe an initial success at linguistically identifying the quality of various simple sights and sounds would be groudbreaking. On the other hand, the principle of Turing's imitation game is that the interviewer is prevented from distinguishing a machine's responses from a human's responses.</Paragraph>
  </Section>
  <Section position="4" start_page="0" end_page="0" type="metho">
    <SectionTitle>
3. Possible Methods
</SectionTitle>
    <Paragraph position="0"> There are several ways one might test for audial and visual comprehension. One technique would be to administer children's intelligence tests to computers.</Paragraph>
    <Paragraph position="1"> Such as an adaptation of the WPPSI test (Wechsler Preschool and Primary Scales of Intelligence), which requests linguistic answers to sight-vocabulary, object memory, and object relationship (e.g. which is larger) questions. Such a visually focused IQ test adaptation would not only test a machine's object identification skills, but also it's cognitive skills.</Paragraph>
    <Paragraph position="2"> David Powers has recommended testing the machines ability to discuss objects of the judges choice. The objects would be placed at a given location, and the interviewee would have the chance to examine it before and during the interview. A similar arrangement could conceivably be used to test audial comprehension. A sound could be played and the interviewee asked to describe it. I would like to register support for a test after the manner which David Powers describes, believing that it would be feasible to engineer for and easy to administer.</Paragraph>
  </Section>
  <Section position="5" start_page="0" end_page="0" type="metho">
    <SectionTitle>
4. Multimedia
</SectionTitle>
    <Paragraph position="0"> One question looms large, though. Whether the audio and visual testing will be done discretely or together.</Paragraph>
    <Paragraph position="1"> Rather then separate the tests a single test could be administered with a noise making object. This would add another layer of complexity to contestants' programs, matching sights to sounds. I believe deciding whether the audio/visual requirement of the Loehner Grand Prize is to be multimedia or discrete is an important issue.</Paragraph>
    <Paragraph position="2"> If it were decided that the audio and visual tests would be combined, then another test technique would be to have the judge and contestant both watch a short multimedia clip, and conduct interviews regarding the film. Although this expectation would indeed require Custer 287 Position Paper on Turing Test Bradley B. Custer (1998) Position Paper on Appropriate Audio/Visual Turing Test. In D.M.W. Powers (ed.) NeMLoP3/CoNLL98 Workshop on Human Computer Conversation, ACL, pp 287-288. competitors to develop recognition technology well beyond the merger of budding existing technologies (as the identifications of objects in still frames has yet a ways to go). Again, another technique might be to have the judge sit in front of a camera and microphone to conduct the interview, the computer's or confederate's responses could be returned via printed screen text. Visual questions could pertain to the judges own appearance.</Paragraph>
    <Paragraph position="3"> This could accomplish testing all three aspects of the A/V TT in one interview.</Paragraph>
  </Section>
  <Section position="6" start_page="0" end_page="0" type="metho">
    <SectionTitle>
5. In Conclusion
</SectionTitle>
    <Paragraph position="0"> I would like to conclude by simply thanking Hugh Loebner for the event he's started, David Powers and everyone who has volunteered time to give the contest the exciting feeling and potential it holds.</Paragraph>
  </Section>
class="xml-element"></Paper>