<?xml version="1.0" standalone="yes"?>
<Paper uid="W04-0820">
  <Title>The upv-unige-CIAOSENSO WSD System</Title>
  <Section position="2" start_page="0" end_page="0" type="metho">
    <SectionTitle>
1 Noun Sense Disambiguation
</SectionTitle>
    <Paragraph position="0"> In our upv-unige-CIAOSENSO WSD system the noun sense disambiguation is carried out by means of the formula presented in (Rosso et al., 2003), which gave good results for the disambiguation of nouns over the SemCor corpus (precision 0.815).</Paragraph>
    <Paragraph position="1"> This formula has been derived from the original Conceptual Density formula described in (Agirre and Rigau, 1995):</Paragraph>
    <Paragraph position="3"> where a13 is the synset at the top of subhierarchy, a16 the number of word senses falling within a subhierarchy, a34 the height of the subhierarchy, and a32a35a34a43a36a44a38 the averaged number of hyponyms for each node (synset) in the subhierarchy. The numerator expresses the expected area for a subhierarchy containing a16 marks (word senses), while the divisor is the actual area.</Paragraph>
    <Paragraph position="4"> Due to the fact that the averaged number of hyponyms for each node in WN2.0 is greater than in WN1.4 (the version which was used originally by Agirre and Rigau), we decided to consider only the relevant part of the subhierarchy determined by the synset paths (from a13 to an ending node) of the senses of both the word to be disambiguated and its context. The base formula is based on the a45 number of relevant synsets, corresponding to the marks a16 in Formula 1 (a46a45a47a46=a46a16 a46, but we determine the sub-hierarchies before adding such marks instead of vice versa like in (Agirre and Rigau, 1995)), divided by the total number a32a35a34 of synsets of the subhierarchy.</Paragraph>
    <Paragraph position="6"> The original formula and the above one do not take into account sense frecuency. It is possible that both</Paragraph>
    <Section position="1" start_page="0" end_page="0" type="sub_section">
      <SectionTitle>
Association for Computational Linguistics
</SectionTitle>
      <Paragraph position="0"> for the Semantic Analysis of Text, Barcelona, Spain, July 2004 SENSEVAL-3: Third International Workshop on the Evaluation of Systems formulas select subhierarchies with a low frequency related sense. In some cases this would be a wrong election. This pushed us to modify the CD formula by including also the information about frequency that comes from WN:</Paragraph>
      <Paragraph position="2"> where a45 is the number of relevant synsets, a12 is a constant (the best results were obtained over the SemCor corpus with a12 near to 0.10), and a0 is an integer representing the frequency of the subhierarchy-related sense in WN (1 means the most frequent, 2 the second most frequent, etc.).</Paragraph>
      <Paragraph position="3"> This means that the first sense of the word (i.e., the most frequent) gets at least a density of 1 and one of the less frequent senses will be chosen only if it will exceed the density of the first sense. The a45 a2 factor was introduced to give more weigth to the subhierarchies with a greater number of relevant synsets, when the same density is obtained among  of brake with the context words a13 horn, man, seconda14 . Example extracted from the Senseval-3 english-all-words test corpus.</Paragraph>
      <Paragraph position="5"> thea15 anda23a26a24 values for thea46 -th sense) In figure 1 are shown the resulting WordNet sub-hierarchies from the disambiguation of brake with the context words a47 horn, man, seconda48 from the sentence: &amp;quot;Brakes howled and a horn blared furiously, but the man would have been hit if Phil hadn't called out to him a second before&amp;quot;, extracted from the all-words test corpus. The areas of subhierarchies are drawn with a dashed background, the root of subhierarchies are the darker nodes, while the nodes corresponding to the synsets of the word to disambiguate and those of the context words are drawn with a thicker border. Four subhierarchies have been identified, one for each sense of brake. The senses of the context words falling out of these subhierarchies are not taken into account.</Paragraph>
      <Paragraph position="6"> The resulting CDs are, for each subhierarchy, respectively: a49a35a49 a30a22a50a0 a30a52a51 a11 a49a35a49a39a54a37a53a54a49 a17 a4a7a6a9a8 a0 a19 a49a37a55a56a53a58a57 , a49 , a49 and</Paragraph>
      <Paragraph position="8"> a57 , therefore the first one is selected and sense 1 is assigned to brake. In the upv-unige-CIAOSENSO WSD system, additional weights (Mutual Domain Weights, MDWs) are added to the densities of the subhierarchies corresponding to those senses having the same domain of context nouns' senses. Each weight is proportional to the frequency of such senses, and is calculated as a45 a9a65a64 a11a66a0 a15a9a67 a17 a19 a49a39a54 a0 a51 a49a39a54 a67 , where a0 is an integer representing the frequency of the sense of the word to be disambiguated and a67 gives the same information for the context word. E.g. if the word to be disambiguated is doctor, the domains for senses 1 and 4 are, respectively, Medicine and School. Therefore, if one of the context words is university, having the third sense labeled with the domain School, the resulting weight for doctor(4) and university(3) is a49a39a54a69a68 a51 a49a39a54a37a70 . Those weights are not considered in the upv-unige-CIAOSENSO2 system, which has been used only for the all-words task.</Paragraph>
      <Paragraph position="9"> We included some adjustment factors based on context hyponyms, in order to assign an higher conceptual density to the related subhierarchy in which a context noun is an hyponym of a sense of the noun to be disambiguated (the hyponymy relation reflects a certain correlation between the two lexemes). We refer to this technique as to the Specific Context Correction (SCC). The idea is to select as the winning subhierarchy the one where one or more senses of the context nouns fall beneath the synset of the noun to be disambiguated.</Paragraph>
      <Paragraph position="10"> An idea connected to the previous one is to give more weight to those subhierarchies placed in deeper positions. We named this technique as Cluster Depth Correction (CDC) (we use improperly the word &amp;quot;cluster&amp;quot; here to refere to the relevant part of a subhierarchy). When a subhierarchy is below a certain averaged depth (which was determined in an empirical way to be approximately 4) and, therefore, its sense of the noun to be disambiguated is more specific, the conceptual density of Formula 3 is augmented proportionally to the number of the contained relevant synsets:</Paragraph>
      <Paragraph position="12"> where a71 a53 a38a78a73a2a34 a11 a51 a34 a17 returns the depth of the current subhierarchy (a51 a34 ) with respect to the top of the WordNet hierarchy; a49a25a76a25a77 a71 a53 a38a78a73a2a34 is the averaged depth of all subhierarchies in SemCor; its value, as said before, was empirically determined to be equal to 4; and a0 is a constant (the best results were obtained, over SemCor, with a0 a19 0.70).</Paragraph>
      <Paragraph position="13"> These depth corrections have been used only in the upv-unige-CIAOSENSO-eaw and upv-unige-CIAOSENSO-ls systems for the english all-words task and english lexical sample tasks. We found that they are more useful when a large context is available, and this is not the case of the gloss disambiguation task, where the context is very small.</Paragraph>
      <Paragraph position="14"> Moreover, in the upv-unige-CIAOSENSO2 system we aimed to achieve the best precision, and these corrections usually allow to improve recall but not precision.</Paragraph>
      <Paragraph position="15"> 2 Adjectives, Verbs and Adverbs Sense Disambiguation The disambiguation of words of POS categories other than noun does not take into account the Conceptual Density. This has been done for the following reasons: first of all, it could not be used for adjectives and adverbs, since in WordNet there is not a hierarchy for those POS categories. With regard to verbs, the hierarchy is too shallow to be used efficiently. Moreover, our system performs the disambiguation one sentence at a time, and this results in having in most cases only one verb for each sentence (with the consequence that no density can be computed).</Paragraph>
      <Paragraph position="16"> The sense disambiguation of an adjective is performed only on the basis of the domain weights and the context, constituted by the Closest Noun (CN), i.e., the noun the adjective is referring to (e.g. in &amp;quot;family of musical instruments&amp;quot; the CN of musical is instruments). Given one of its senses, we extract the synsets obtained by the antonymy, similar to, pertainymy and attribute relationships. For each of them, we calculate the MDW with respect to the senses of the context noun. The weight assigned to the adjective sense is the average between these MDWs. The selected sense is the one having the maximum average weight.</Paragraph>
      <Paragraph position="17"> In order to achieve the maximum coverage, the Factotum domain has been also taken into account to calculate the MDWs between adjective senses and context noun senses. However, due to the fact that in many cases this domain does not provide a useful information, the weights resulting from a Factotum domain are reduced by a a62 a55a49 factor. E.g. suppose to disambiguate the adjective academic referring to the noun credit. Both academic(1) and credit(6) belong to the domain School. Furthermore, the Factotum domain contains the senses 1 4 and 7 of credit, and senses 2 and 3 of academic. The extra synsets obtained by means of the WN relationships are: academia(1):Sociology, pertainym of sense 1; theoretical(3):Factotum and applied(2):Factotum, similar and antonym of sense 2; scholarly(1):Factotum and unscholarly(1):Factotum, similar and antonym of sense 3. Since there are no senses of credit in the Sociology domain, academia(1) is not taken into account. Therefore, the resulting weights for aca- null a53 for sense 3.</Paragraph>
      <Paragraph position="18"> The weights resulting from the extra synsets are represented within square brackets. Since the maximum weight is obtained for the first sense, this is the sense assigned to academic.</Paragraph>
      <Paragraph position="19"> The sense disambiguation of a verb is done nearly in the same way, but taking into consideration only the MDWs with the verb's senses and the context words (i.e., in the previous example, if we had to disambiguate a verb instead of an adjective, the weights within the square brackets would not have been considered). In the all-words and the gloss disambiguation tasks the two context words are the noun before and after the verb, whereas in the lexical sample task the context words are four (two before and two after the verb), without regard to their morphological category. This has been done in order to improve the recall in the latter task, whose test corpus is made up mostly by verbs, since our experiments carried out over the SemCor corpus showed that considering only the noun preceding and following the verb allows for achieving a better precision, while the recall is higher when the 4-word context is used.</Paragraph>
      <Paragraph position="20"> The sense disambiguation of adverbs (in every task) is carried out in the same way of the disambiguation of verbs for the lexical sample task.</Paragraph>
      <Paragraph position="21"> We are still working on the disambiguation of adverbs, however, by the time we participated in SENSEVAL-3, this was the method providing the best results.</Paragraph>
    </Section>
  </Section>
  <Section position="3" start_page="0" end_page="0" type="metho">
    <SectionTitle>
3 The English All-Words Task
</SectionTitle>
    <Paragraph position="0"> We participated in this task with two systems: the upv-unige-CIAOSENSO-eaw system and the upvunige-CIAOSENSO2-eaw system. The difference between these systems is that in the latter the disambiguation of nouns is carried out considering only the densities of the subhierarchies obtained with the formula (3), while the first one considers the Word-Net Domains weights, too. The nouns have been disambiguated in both systems with a context window of four nouns. The disambiguation of verbs, as said above, has been carried out considering the noun preceding and following the verb. Adverbs have been disambiguated with a context window of four words, while adjectives have been disambiguated with the Closest Noun, as described in the previous section.</Paragraph>
    <Paragraph position="1"> The text, for every task we participated in, has been previously POS-tagged with the POS-tagger described in (Pla and Molina, 2001). In the tables below we show the results achieved by the upv-unige-CIAOSENSO and upv-unige-CIAOSENSO2 systems in the SENSEVAL-3. The table 1 shows the &amp;quot;without U&amp;quot; scores, which consider the missing answers as undisambiguated words and not errors (that is, how our system is intended to work). The  unige-CIAOSENSO2 in the english all-words task (w/o U). baseline MFU, calculated by assigning to the word its most frequent (according to WordNet) sense, is  coverage.</Paragraph>
    <Paragraph position="2"> The results are roughly comparable with those obtained in our previous work over the SemCor.</Paragraph>
    <Paragraph position="3"> Considering only the polysemous words in SemCor, our tests gave a precision of a55a1 a62 a1 and a recall of a55a56a60 a62 a1 , with a coverage of 83.55% (if monosemous words were included, the values for precision and recall would be, respectively, 0.692 and 0.602, with a coverage of 87.07%). In order to have a better understanding of the results, in the following two tables we show the precision and recall results for each morphological category, highlighting those on nouns, being the only category for which the two systems give different answers.</Paragraph>
    <Paragraph position="4"> The behaviour of our systems is the same as we observed on the SemCor: the system relying only on Conceptual Density and frequency is more precise, even more than the most-frequent heuristic (over nouns in SemCor the precision obtained by the  systems, grouped by morphological category, in the english all-words task (w/o U).</Paragraph>
    <Paragraph position="5"> spectively, 0.737 and 0.815, with a MFU baseline of .755). Whereas the precision needs to be improved over verbs, it overtakes the baseline for nouns and adjectives.</Paragraph>
  </Section>
  <Section position="4" start_page="0" end_page="0" type="metho">
    <SectionTitle>
4 The English Lexical Sample Task
</SectionTitle>
    <Paragraph position="0"> The system participating in this task works in an almost identical manner of the upv-unige-CIAOSENSO-eaw, with the difference that verbs are disambiguated in the same way of adverbs (context of four words, the two preceding and the two following the verb). The biggest difference with the all-words task is that the training corpus has been used to change the ranking of WordNet senses for the headwords, therefore, it should be more appropriate to consider this version of the upv-unige-CIAOSENSO as an hybrid system. E.g. in the training corpus the verb mean, having seven senses in WordNet, appears 40 times with the WordNet sixth sense, 23 times with the WN second sense, and eight times with the WN seventh sense; therefore, the ranking of its senses has been changed to the following: 6 2 7 1 3 4 5. In table 5 we show the POS-specific results from the total ones, in order to highlight the superior performance over nouns.</Paragraph>
    <Paragraph position="1">  unige-CIAOSENSO-ls system in the english lexical sample task.</Paragraph>
  </Section>
  <Section position="5" start_page="0" end_page="0" type="metho">
    <SectionTitle>
5 The WSD of WordNet Glosses Task
</SectionTitle>
    <Paragraph position="0"> The upv-unige-CIAOSENSO-gl system is an optimized version for this task, of the upv-unige-CIAOSENSO2-eaw which participated in the all-words task. The optimization has been done on the basis of the work we carried out over Word-Net glosses during the testing of the disambiguation of adjectives over the SemCor corpus. During that work, we tried to extract from adjective glosses the nouns to be used to calculate additional MDWs, and we obtained a precision of 61.11% for the adjectives in the whole SemCor using the disambiguated glosses, against a 57.10% of precision with the undisambiguated glosses.</Paragraph>
    <Paragraph position="1"> This improvement led us to further investigate the structure of wordnet glosses, investigation that took us to apply the following &amp;quot;corrections&amp;quot; to the original system for the SENSEVAL-3 gloss disambiguation task. First of all, it has been noted that noun glosses often contains references to the direct hypernym and/or the direct hyponyms (e.g. command(1) in the gloss of behest:&amp;quot;an authoritative command or request&amp;quot;), and its meronyms and holonyms too (e.g. jaw(3) in the gloss of chuck(3): &amp;quot;a holding device consisting of adjustable jaws...&amp;quot;). Therefore, we added a weight of a62 a55a57 for the noun senses being direct hypernyms, or direct hyponyms, of the synset to which belongs the gloss (head synset), and a62 a55a56a60 for the senses being meronyms or holonyms of the head synset. Then, it has been noted that verb glosses often contains references to the direct hypernym (e.g. walk(1) in the gloss of flounce:&amp;quot;walk emphatically&amp;quot;), thus a weight of a62 a55a56a60 is added for the verb senses being direct hypernym of the head verb synset. A weight a62 a55a56a60 is also added when an attribute or pertainymy relationship with the head synset is found. Finally, we used WordNet Domains to assign extra weights to the senses having the same domain of the head synset (e.g. heart(2) in the gloss of blood(1):&amp;quot;the fluid that is pumped by the heart&amp;quot;). The assigned weight is a49a37a55a62 if the domain is different than Factotum, a62 otherwise. E.g.</Paragraph>
    <Paragraph position="2"> blood(1) belongs to the domain Medicine; of the ten senses of heart in WordNet, only the second is in the domain Medicine, therefore the second sense of heart gets a weight of a49a37a55a62 (we gave intentionally an higher weight than the other relationships because it seemed to us more meaningful than the other ones).</Paragraph>
    <Paragraph position="3"> Although we participated in this task only with the optimized version, we tried to use the standard system for the same task in order to see the difference between them. The results show that the optimized version performs much better for the gloss disambiguation task than the standard one:  gl) and standard versions of the CIAOSENSO WSD system in the WordNet gloss disambiguation task.</Paragraph>
  </Section>
class="xml-element"></Paper>