WITAS Multi-Modal Conversational Interface System

NEW: Video (mpg) of demonstration system

Video 2 (mpg)

Video 3 (mpg)

The demonstration system, described below, runs on Solaris or Windows NT/2000. Here is a transcript of text from our first demo system , completed on 7/31/2000, which was interfaced to UAV simulator on 11/6/2000, using realtime CORBA

Audio from the first demo version

Screen shots and audio from the first demo version:

Key: "Human spoken input" (human gesture input) [System synthesized speech]
"Fly to Main Street"	Hear it
"No. I meant Circle Road" [Okay]	Hear it
"Then go here (click) and look at the building" [Which building do you mean?]	Hear it
"The hospital" [Okay. The hospital]	Hear it

NL Generation examples (Semantic-Head-Driven Generation of UAV Traffic Reports, 09/2000):

"Car three is turning left onto Circle Road."
"The truck is passing the tower."
"Car eight is stopping."
"Van six is turning right onto Harbour Road."

Current system:

Platforms: