Hostname: page-component-76fb5796d-skm99 Total loading time: 0 Render date: 2024-04-26T01:09:30.934Z Has data issue: false hasContentIssue false

Interpretation of iconic utterances based on contents representation: Semantic analysis in the PVI system

Published online by Cambridge University Press:  01 March 1998

PASCAL VAILLANT
Affiliation:
Thomson-CSF LCR, Computer Science Group, Domaine de Corbeville, 91404, Orsay cedex, France; e-mail: vaillant@lcr.thomson.fr

Abstract

This article focuses on the need for technological aid for agrammatics, and presents a system designed to meet this need. The field of Augmentative and Alternative Communication (AAC) explores ways to allow people with speech or language disabilities to communicate. The use of computers and natural language processing techniques offers a range of new possibilities in this direction. Yet AAC addresses speech deficits mainly, not linguistic disabilities. A model of aided AAC interfaces with a place for natural language processing is presented. The PVI system, described in this contribution, makes use of such advanced techniques. It has been developed at Thomson-CSF for the use of children with cerebral palsy. It presents a customizable interface helping the disabled to compose sequences of icons displayed on a computer screen. A semantic parser, using lexical semantics information, is used to determine the best case assignments for predicative icons in the sequence. It maximizes a global value, the ‘semantic harmony’ of the sequence. The resulting conceptual graph is fed to a natural language generation module which uses Tree Adjoining Grammars (TAG) to generate French sentences. Evaluation by users demonstrates the system's strengths and limitations, and shows the ways for future developments.

Type
Research Article
Copyright
1998 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)