Synergy Effects in Natural Language-Based Multimodal Interaction

Bretan, Ivan and Karlgren, Jussi (1994) Synergy Effects in Natural Language-Based Multimodal Interaction. [SICS Report]



We discuss the synergetic effects that can be obtained in an integrated multimodal interface framework comprising on one hand a visual language-based modality and on the other natural language analysis and generation components. Besides a visual language with high expressive power, the framework includes a cross-modal translation mechanism which enables mutual illumination of interface language syntax and semantics. Special attention has been payed to how to address problems with robustness and pragmatics through unconventional methods which aim to enable user control of the discourse management process.

Item Type:SICS Report
Uncontrolled Keywords:Multimodal interaction, Natural language interfaces
ID Code:2126
Deposited By:Vicki Carleson
Deposited On:22 Oct 2007
Last Modified:18 Nov 2009 16:00

Repository Staff Only: item control page