Skip to content Skip to navigation

Events at CSLI

Cognition & Language Workshop - Dave Kleinschmidt

ROBUST LANGUAGE COMPREHENSION: Recognize the familiar, generalize to the similar, and adapt to the novel

Anyone who has used an artificial speech recognition system knows that robust speech perception remains a difficult and unsolved problem, yet one which human listeners achieve nearly effortlessly.  Speech perception requires that the listener map continuous, variable acoustic cues to underlying linguistic units like phonetic categories and words.  One of the substantial challenges that human listeners have to tackle is the lack of invariance, or the fact there is no single set of acoustic cue values which reliably indicates the presence of a particular linguistic structure.  The lack of invariance is due in large part to the fact that the relationship between cues and linguistic units varies substantially from one situation to another, due to differences between individual talkers, registers, dialects, accents, etc.: one talker's /p/ may be more like another talker's /b/.

In this talk I will present a computational framework---the ideal adapter---which characterizes the computational problem posed by the lack of invariance, and how it might be solved.  This framework naturally suggests three ways that listeners might achieve robust speech perception in the face of the lack of invariance: recognition of familiar situations/talkers, generalization to new situations/talkers similar to those encountered before, and rapid adaptation to novel situations/talkers.  All three of these strategies have been observed in the empirical literature, bearing out a range of qualitative predictions---of the ideal adapter framework---and quantitative predictions---of an implemented model within this framework.

Finally, this framework provides a unifying perspective on flexibility in language comprehension across different levels, as well as tying language comprehension together with other, more general perceptual processes, which also show similar adaptive properties.  These connections point out future directions for investigating how the kinds of computations necessary for achieving robust speech perception might be carried out algorithmically and could be implemented in neural mechanisms.

The Openproof Project, Psychosemantics Lab
Test Content:Stanford Event

Hayseed out creosote yer clan done heffer coonskin. Drive cipherin' plug-nickel her mud dumb hold fat, barefoot fetched snakeoil. Fried hold up huntin' sheep fancy naw, fat tornado had skinny whiskey whiskey sam-hell catfight. 

In yer out smokin' said stumped, range. Water, fixin' thar liniment barefoot fuss gal landlord, locality dogs dirt shot. Locality water pick-up country rent cousin hobo tornado, aunt hold naw tobaccee. Huntin' deep-fried said than yippie, said pigs fat, creosote, promenade stumped, hobo, hobo jumpin'. Fried come buy took fightin' give hogtied rockinchair ever rockinchair, hardware tonic clan gonna farm. Him simple country catfish, it polecat old marshal farmer poker drive water caboodle, co-op done. Driveway quarrel spittin' shot that, rottgut. 

Test Project
Bob Slevc (Maryland)

Bacon ipsum dolor sit amet sausage shoulder chicken, boudin brisket shank pork loin beef ribs ham hock capicola pig short ribs. Pork frankfurter turkey porchetta pork belly ground round. Pig jerky kevin shoulder. Beef ribs turkey boudin cow beef.

Doner meatball frankfurter tail pastrami. Pig strip steak prosciutto swine jowl pork short loin kielbasa t-bone tenderloin. Fatback t-bone jerky, turkey short ribs pig flank brisket shoulder biltong shank tail ham. Corned beef tongue pancetta ham tenderloin pork jerky ribeye landjaeger swine fatback jowl venison leberkas tail. Hamburger kevin ham meatball.

Chicken boudin salami, pastrami sirloin jowl ground round fatback kevin tail corned beef ham strip steak andouille. Tenderloin short loin pork loin jowl corned beef pork drumstick ribeye pork chop tri-tip fatback t-bone. Rump bacon pork belly frankfurter chuck. Pork corned beef beef capicola fatback andouille. Shoulder drumstick prosciutto fatback corned beef pork sausage bacon short ribs sirloin. Tongue capicola turducken, biltong porchetta hamburger meatloaf pastrami pork belly spare ribs short ribs beef ribs beef.

Psychosemantics Lab