Identification of Bilingual Suffix Classes for Classification and Translation Generation

Karimbi Mahesh Kavitha, Luis Gomes, Jose Gabriel Pereira Lopes

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

We examine the possibility of learning bilingual morphology using the translation forms taken from an existing, manually validated, bilingual translation lexicon. The objective is to evaluate the use of bilingual stem and suffix based features on the performance of the existing Support Vector Machine based classifier trained to classify the automatically extracted word-to-word translations. We initially induce the bilingual stem and suffix correspondences by considering the longest sequence common to orthogonally similar translations. Clusters of stem-pairs characterised by identical suffix-pairs are formed, which are then used to generate out-of-vocabulary translations that are identical to, but different from, the previously existing translations, thereby completing the existing lexicon. Using the bilingual stem and suffix correspondences induced from the augmented lexicon we come up with 5 new features that reflects the (non) existence of morphological coverage (agreement) between a term and its translation. Specifically, we examine and evaluate the use of suffix classes, bilingual stem and suffix correspondences as features in selecting correct word-to-word translations from among the automatically extracted ones. With a training data of approximately 35.8K word translations for the language pair English-Portuguese, we identified around 6.4K unique stem pairs and 0.25K unique suffix pairs. Further, experimental results show that the newly added features improved the word-to-word classification accuracy by 9.11% leading to an overall improvement in the classifier accuracy by 2.15% when all translations (single- and multi-word translations) were considered.

Original languageEnglish
Title of host publicationADVANCES IN ARTIFICIAL INTELLIGENCE (IBERAMIA 2014)
EditorsALC Bazzan, K Pichara
PublisherSPRINGER-VERLAG BERLIN
Pages154-166
Number of pages13
ISBN (Print)978-3-319-12026-3
DOIs
Publication statusPublished - 2014
Event14th Ibero-American Conference on Artificial Intelligence (AI) - Santiago, Chile
Duration: 24 Nov 201427 Nov 2014

Publication series

NameLecture Notes in Artificial Intelligence
PublisherSPRINGER-VERLAG BERLIN
Volume8864
ISSN (Print)0302-9743

Conference

Conference14th Ibero-American Conference on Artificial Intelligence (AI)
CountryChile
CitySantiago
Period24/11/1427/11/14

Keywords

  • Bilingual suffix classes
  • Translation classification
  • Support vector machine
  • Lexicon augmentation
  • OOV terms
  • MORPHOLOGY

Cite this