SPEECON Deliverable D13

Project ref. no. Project acronym Project full title Security (distribution level) Contractual date of delivery Actual date of delivery Deliverable number Deliverable name Type Status & version Number of pages WP contributing to the deliverable WP / Task / Deliverable responsible Other contributors Author(s) EC Project Officer Project Coordinator IST-1999-10003 SPEECON Speech Driven Interfaces for Consumer Applications Public M05 = June 2000 08-Jan-2001 D13 Functionalities of Speech Driven Interfaces Technical Report Final version, revision 8 (v1.8) 22 WP1 WP1: Nokia / T1.3: Philips / D13: Philips Nokia, IBM, Sony, Temic, Siemens/Infineon, L&H, Ericsson Rainer Siemund (Philips Speech Processing) Domenico Perrotta Name: Company: Address: Harald Hge Siemens AG, ZT IK 5 Otto-Hahn-Ring 6, D-81739 Mnchen, Germany Phone: +49-89-636-44195 Fax: +49-89-636-49802 E-mail: harald.h.hoege@mchp.siemens.de Project web site: http://www.speecon.com consumer devices, functionalities The present document presents an overview of functionalities future consumer devices will have, ranging from rather general to application-specific.

Keywords Abstract (for dissemination)

SPEECON (IST-1999-10003)

D1.3

Document evolution:
Version 1.0 1.1 1.2 Date 10-May-2000 1-Aug-2000 19-Aug-2000 Security draft version, internal draft version, 1st revision, internal draft version, 2nd revision, internal draft version, 3rd revision, internal draft version, 4th revision, internal draft version, 6th revision, internal draft version, 7th revision, internal final version, 8th revision draft mailed prior to Barcelona meeting version agreed on in Barcelona and circulated prior to Warszaw meeting Notes draft mailed before Ulm meeting draft mailed after discussion in Voss draft incorporating input from Siemens/Infineon, Ericsson and Nokia draft incorporating input from Ericsson and Sony draft incorporating input from Sony, pre-final version mailed prior to Paris meeting

1.3 1.4

31-Aug-2000 15-Sep-2000

1.6 1.7 1.8

10-Oct-2000 06-Nov-2000 08-Jan-2001

Table of contents
1. Introduction.......................................................................................................................3 2. Functionalities of speech driven interfaces......................................................................3
2.1 Functionalities.........................................................................................................................4
2.1.1 Basic IVR operations..........................................................................................................................5 2.1.2 Directory navigation...........................................................................................................................8 2.1.3 Editing.................................................................................................................................................9 2.1.4 Output control.....................................................................................................................................9 2.1.5 Messaging and Internet browsing.....................................................................................................11 2.1.6 Organiser functions...........................................................................................................................13 2.1.7 Routing..............................................................................................................................................14 2.1.8 Automotive........................................................................................................................................16 2.1.9 Audio & video...................................................................................................................................16 2.1.10 Toys.................................................................................................................................................18

of 22 2

SPEECON (IST-1999-10003)

D1.3

1. Introduction
The present deliverable D1.3 is part of the first project workpackage (WP1), whose goal it is to determine the needs of voice-driven interfaces based on application and market analysis. The project targets consumer market applications with voice driven interfaces such as mobile phones information kiosks hand-held computers automotive devices audio/video devices toys

WP1 makes an effort to determine the market relevance of speech driven consumer applications (D1.1), to estimate the range of applications available in the near future (D1.2), to describe their functionalities (D1.3) and to define the acoustic conditions under which they are supposed to operate (D1.4).

2. Functionalities of speech driven interfaces

The functionalities listed in the present document form a body of semantic command descriptions, which outline the potential functions of devices in the consumer electronics domain. The list derived from the current document will be used as a basis for theultimately result in the specification of the vocabulary to be sampled in the SPEECON data collections. Additional material, not listed within the command & control categories below, will be recorded from spontaneous, elicited and/or read utterances and consist of
isolated and connected digits (e.g. one and one two three) natural numbers (e.g. one hundred seventy two) yes/no, including variants (e.g. yep, nope, correct, false) money amounts (Euro, Dollar, local currency) dates and times relative (e.g. tomorrow, next week), also containing week-days (MondaySunday) and month names (January-December) absolute (e.g. 9th of May, September 10) digital (e.g. nineteen hours fifteen, five twenty) analogue (e.g. seven fifteen p.m., twenty minutes past five in the morning)

spelled items (e.g. L O N D O N, S M I T H) special keyboard characters (e.g. hash, star) lists of most common names proper names (e.g. John Smith, Hillary Jones) company names (e.g. Philips ;-) place names (countries, cities, streets)

of 22 3

SPEECON (IST-1999-10003) -

D1.3

coverage of grammatical units (e.g. verbs, modal verbs, adverbs, adjectives, deictics, nouns, pronouns, conjunctions, prepositions) and most common sentence types (e.g. imperatives, interrogatives)

phonetically rich words and sentences misc. words to politely ask for/demand s.th. email and web addresses

The material will provide background data for the functionalities and the vocabulary used to activate them. Proper names, for example, will be needed for name dialling, various time formats will be needed to set timers and alarms, digits and spellings will be needed to input data for, e.g., volume control, address books, or route navigation. 2.1 Functionalities The functionalities of future consumer devices are increasingly characterised by overlaps between formerly separate application areas. While until recently one could easily distinguish between functionalities of mobile phones, palmtop computers, audio & video equipment, navigation systems and toys, borders along those lines are increasingly difficult to draw. The PDA, for example, can easily (and will) be used for purposes such as the ones below:

downloading and viewing video files placing and receiving phone calls navigating and planning journeys

sending and receiving SMS fax email voice mail

accessing databases

making online reservations

internet browsing

playing games or operating virtual toys remote control of consumer devices downloading and listening to audio files

Figure 1: Multifunctionality of consumer devices, e.g.: PDA.

of 22 4

SPEECON (IST-1999-10003)

D1.3

Even though the PDA is probably the most obvious device in terms of overlap, similar tendencies can be perceived in other applications as well. Television sets serve to browse the internet, mobile telephones displays guide you through crowded cities, car navigation systems offer not only traffic but also stock market infos and mp3-players not only play but also download music from the internet - to name but a few functionalities that have already grown beyond the prototype level. The field of consumer electronics, in short, is heading towards multi-purpose applications. Rather than distinguishing between various application-specific functions, therefore, the following sections will outline utilities future consumer devices are likely to possess.
Basic IVR operations more general

Directory navigation

Editing

Output control

Messaging + internet browsing

Organiser functions

Routing

Audio & Video

Automotive

less general

Figure 2: Functionalities of future consumer devices from top (most basic) to bottom (applicationspecific)

'Toys' as a functional area are missing from figure 2 since they represent a special case (cf. 2.1.10): toy functionalities can hardly be described in terms of command and control functions such as the ones listed above. They require an entirely separate set of prompts and thus form a database in its own right. Toy functionalities are described in 2.1.10. 2.1.1 Basic IVR operations 'Basic IVR operations' serve to activate and deactivate the whole system and its attached devices. The body of keywords, largely consisting of activation and end commands, forms the most basic set of functions needed to operate speechdriven consumer devices. Keyword
on off standby

Function
Activating and deactivating the system activate a device deactivate a device put device into standby mode

Keyword
wake_up

Function
awaken device from standby mode

of 22 5

SPEECON (IST-1999-10003) cancel password register | login keylock logout voice control lock unlock enter exit | quit set cancel current operation indicate that you want to change password gain access to a protected device/mode activate keylock leave a protected mode activate speech recognition mode lock current settings, device etc. unlock current settings, device, etc. finalize an input (as <CR>) quit a running application to adjust settings Devices device name: radio device name: camcorder device name: camera device name: cassette device name: CD player device name: CD writer device name: DAT player/recorder device name: DVD player/writer device name: HiFi system device name: MiniDisk player/recorder device name: MP3 player device name: microphone device name: television device name: mobile telephone, cellular device name: PDA device name: set-top box device name: video device name: computer device name: phone

D1.3

radio camcorder camera cassette CD CD-R DAT DVD HiFi MD MP3 microphone TV mobile | cellular PDA set-top_box video computer phone

start | activate restart abort | end | stop pause continue open close confirm help information assistant verify check

Operating devices start service, device, function start again end service, function temporarily interrupt the current function resume the current function open an object (file/item/window) close an object (file/item /window) confirm an operation activate help mode ask for information activate an assistant verify an operation check if any event has happened, e.g. check mail-box

of 22 6

SPEECON (IST-1999-10003)

D1.3

Keyword
switch

Function
switch on or off or between, e.g. functions/menu items, etc. Voice control settings greeting the system (e.g. saying Hello enables the system to define English as dialogue language) list command & control vocabulary start a demo name of the current language (e.g. for German recordings select word Deutsch) tell the recognizer to learn a new word enter spelling mode enter digit mode to record a command or message Timer control address timer function; activate/program timer function address clock function; activate clock address time function; announce/display/set time address date function; announce/display/set date address alarm function; activate alarm function activate device or function daily at a preset time activate device or function weekly at a preset time activate device or function monthly at a preset time go to an earlier time go to a later time Programming program advanced features or options, or enter submenu to do this select automatic mode select manual mode reset to the system to default save current item, configuration, etc. initiate recording/activation of a macro enter settings menu; select settings functions noun, activate device/system control System status show the status of the system show battery status display signal strength activate checking procedure Connectivity connect to network infrared interface select bluetooth operation address (internet) host

hello vocabulary demo <language> learn spell digit record

timer clock time date alarm daily weekly monthly earlier later

program automatic manual reset save | store macro settings control

status battery signal_strength self-test

network infrared bluetooth host

Keyword

Function

of 22 7

SPEECON (IST-1999-10003) network synchronize go to network function synchronize data with PC entries

D1.3

2.1.2 Directory navigation Directory navigation subsumes all functions that are needed to move within lists and menus of all sorts and to select items displayed in them. # indicates that all alternatives should be translated Keyword
menu directory options detail list

Function
Calling up menus go to a menu enter directory (e.g. of files) or list directory entries show options from a menu, etc. go to a sub-menu, i.e. give more details to show an inventory of items Menu browsing go to the beginning of a dialogue or to top-level menu noun or adverb, go to the beginning of list go to end of list go up one item go down one item go left from present position go right from present position go forward one item in the list go back one item in the list colour: blue colour: red colour: yellow colour: green colour: black colour: white search for an item make a suggestion (e.g. hotel) browse through a list conduct a fuzzy search based on written or spoken input (e.g. Krzysztof sounds like or is written something like 'Christoph') go to item, identified by name, number etc. go to row go to column go to page (+ number) Selecting items select menu/item select all items skip a marked item

home start # top # front # first bottom # end # last up # plus down # minus left right next # forward previous # back blue red yellow green black white search | lookup | find suggest browse like go_to row column page

select | choose all skip | ignore

of 22 8

SPEECON (IST-1999-10003)

D1.3

2.1.3 Editing The present section lists all features needed to edit documents, macros and lists of all sorts. The functions are comparable to the edit functions that are part of every word processor, even though the scope of applications for which they are used in the context of speech processing applications is larger. Keyword
new entry enter dictate modify correct copy cut paste insert add create delete | remove mark sort undo repeat replace

Function
Editing create a new item object of operation: entry input an item dictate text change an entry correct an entry copy (to clipboard) cut from chosen source to chosen destination paste an entry insert an entry or item add an entry or an item create an entry or an item delete or remove an entry/item highlight points of interest sort elements by name, date, undo last operation repeat last function replace an item

2.1.4 Output control The term output control denotes the ways in which users get feedback from the devices they operate. This can happen either via a screen of one sort or another, such as television or cellular phone, or through audio output. The functions listed here are needed to manipulate the ways in which data or programs are presented. Keyword
profile neutral | normal | default maximum minimum level high low medium more less channel | program

Function
General personal picture and/or sound set settings to normal/neutral reach the top value of a certain range reach the smallest value of a certain range set level (+ number, range etc.) set level high set level low set level medium increase or get more decrease or get less select channel/program (+ number or name) VISUAL OUTPUT

of 22 9

SPEECON (IST-1999-10003)

D1.3

show | display maximize hide | minimize clear zoom_in zoom_out format | picture_size scale resolution update | refresh freeze

Display format display results, file etc. enlarge window to full-scale hide window on a display clear display zoom in zoom out determine format or scale of displayed object noun, e.g. scale of the map e.g. of an image in pixels refresh current display hold picture Brightness initiate control of light function enter brightness menu set picture more bright set picture less bright Colour balance enter and manipulate colour balance menu set more intensive colours set less intensive colours Contrast enter contrast menu set contrast to be sharper set contrast to be softer AUDIO OUTPUT Volume enter volume menu increase volume decrease volume turn sound off turn sound on again let volume fade Sounds and signal control choose sounds select melody/ring-tone function vibrator signal Tone control enter tone menu set bass level (+ number, range, etc.)

light brightness brighter darker

colour more colour less colour

contrast sharper softer

volume louder quieter mute | silent unmute fade

sounds melody | ring_tone vibrating_alert

tone bass

Keyword
treble bass-boost equalizer

Function
set treble level (+ number, range, etc.) bass boost access equalizer

of 22 10

SPEECON (IST-1999-10003)

D1.3

loudspeaker headphones line-in line-out hands-free play | playback slow fast repeat shuffle | random_play reverse eject

Output mode output to loudspeakers (+on/off) output to headphones (+on/off) data source data target switch to hands-free (muting head-set) Play playback play at slower speed play at faster speed repeat the last play play in shuffle mode change side of tape eject medium Print create hardcopy of ticket, map, timetable, etc Read Read (aloud) a file/item

print

read

2.1.5 Messaging and Internet browsing The present section lists several ways of sending messages such as phone, email, SMS or fax and the functions needed to operate the devices' software properly. Since many functions needed to send and receive messages of various sorts are overlapping to a large extent, they are subsumed under the present category. Internet access and reservation facilities complete the set of functions needed to interact with other users. Keyword
message connect answer | reply answer_all | reply_all forward | transfer | divert send receive urgent callback

Function
General message functions enter message mode make a connection answer the call/message answer to everyone in a list forward message or call (+ name, number etc.) send message receive a message or broadcast or phone call declare message as urgent call someone back Voice Memo enter voice memo program

memo | voice memo

Keyword
vacation

Function
invoke vacation mode; set vacation notification Email send/receive email enter mailbox

email mailbox

of 22 11

SPEECON (IST-1999-10003) get inbox header get an item, e.g. get an e-mail from a server go to Inbox ask for information on mail header Fax enter fax menu program SMS enter SMS menu program DTMF activate transfer by DTMF Infrared/Bluetooth messaging transfer e.g. business card via infrared set / edit business card Internet browsing enter/leave internet program activate/deactivate internet browser enter/leave favorites menu set bookmark follow hyperlink address hyperlink TELEPHONE Dialing options place a call call last number again place a call by saying a name place a call digit by digit initiate call by its short number choose an item from a finite list set a call-back reminder make a conference phone call use prepaid operation list recent calls, incoming and outgoing Shortcuts emergency call(s) call customer care transfer call to human operator

D1.3

fax

SMS

DTMF

beam | transfer business_card

internet browser favorites | bookmarks bookmark follow hyperlink | link

dial # call redial name_dialing digit_dialing speed_dialing choose reminder conference prepaid call-list

emergency customer_care | support operator

Keyword
extension car home mobile office pager

Function
Extensions activate extension mode connect to extension connect to extension connect to extension connect to extension connect to extension

of 22 12

SPEECON (IST-1999-10003) secretary work international connect to extension connect to extension use an international phone number extension User profiles activate profile setting activate user profile activate user profile activate user profile activate user profile activate user profile activate user profile activate user profile activate user profile activate user profile

D1.3

profile car home mobile office pager work city hands-free meeting

greeting hang-up hold accept call refuse call | reject call | busy missed calls received calls duration voice_mail | answering_machine

Call handling recording a greeting for answering to the incoming call hang-up the phone put the call on hold accept call refuse call list missed calls list received calls getting the time length of the call go to voice mail Making reservations ask for arrival time ask for departure time make a reservation

arrival departure book

2.1.6 Organiser functions Organiser functions take over tasks traditionally offered by paper-based organisers, such as keeping address books and task management. Keyword
calendar today

Function
Organiser invoke calendar application display today's tasks, appointments etc.

Keyword
tomorrow week month year agenda appointment | meeting tasks birthday schedule

Function
display tomorrow's tasks, appointments etc. display calendar of week + number display calendar of month + month or number display calendar of week + year call agenda function set appointment date enter tasks menu display all birthdays display date(s) of delivery

of 22 13

SPEECON (IST-1999-10003) contacts reminder go to contacts remind of task, appointment etc. accessories activate accessories menu activate calculator activate word processor activate notes editor mode name: games

D1.3

accessories | utilities calculator text-editor notes games

phone-book address-book business private name address company # street # city # zip-code # province/state # country phone_number fax_number email_address

Address book go to phonebook operations go to address book operations activate professional address or number list activate private address or number list add name to address book add address (company, street, P.O. box, city, zip code, state, country) to address book add address categories add phone number(s) to address book add fax number(s) to address book add email address(es) to address book

2.1.7 Routing Routing functions have traditionally been associated with car navigation systems. They offer positioning, tourist infos and guidance both for car drivers and pedestrians though traffic in and outside cities. Keyword
locate | position position GPS

Function
Positioning enter/state the actual position show actual position on a map enter GPS (global positioning system) menu Journey planning acoustic guidance on/off

acoustic_guidance

of 22 14

SPEECON (IST-1999-10003)

D1.3

Keyword
guide | navigate guide_to route fastest_route shortest_route alternative_route new_route distance hotel hotel information parking rest_area service_station sightseeing traffic_jam points_of_interest

Function
activate navigation program directly guide to pre-stored destination suggest route suggest fastest route suggest shortest route suggest alternative route calculate a new route show distance to destination suggest/book/guide to a hotel/accommodation inform about facilities of an hotel/accommodation suggest/guide to a car lot suggest and/or provide info about rest areas propose a gas/service station suggest route with points of interest calculate a route avoiding traffic jams suggest points of interest Enter landmarks enter start point enter destination enter airport enter border-point enter car rental station enter city centre enter name of a crossing street enter place of exhibition enter ferry crossing point enter car service (garage) enter gas / Petrol station enter highway crossing enter highway exit enter highway service station enter hospital enter railway station enter restaurant enter house number get general traffic information Maps toggle to map mode toggle to pictogram mode show map of destination area move east from current position move west from current position move north from current position move south from current position

start_point destination airport border car rental centre crossing | junction point fair | trade show | exhibition ferry garage gas station highway crossing | motorway junction highway exit | motorway exit highway service station hospital railway_station restaurant house-number traffic_information

map pictogram destination East West North South

of 22 15

SPEECON (IST-1999-10003)

D1.3

2.1.8 Automotive Automotive functions describe genuine car utilities such as air conditioning or seat adjustment and offer various car-related information. Keyword
air-conditioning heater re-circulation ventilation seat temperature window

Function
Cabin Control enter or leave air-conditioning menu activate or deactivate heater air re-circulation choose air flow/fan/ventilation/blower enter seat menu set cabin temperature open or close window Vehicle control enter auto PC menu activate or deactivate defroster give status of fuel give status of maintenance

auto PC defroster fuel | gas maintenance

2.1.9 Audio & video While many audio and video functions have already been summarised under output control, the ones listed here are too specific for general-purpose applications such as the ones listed above. Keyword Function

Sound control stereo#mono#channel_one#channel_tw select audio channels o surround select surround level balance set balance level Picture control select PALPlus display mode select 16:9 display mode Normal display mode Videotext activate and deactivate videotext switch subtitles on and off Programming channels select next memory position store selected program in memory position number

PALPlus 16to9 PAL

Videotext Subtitles

slot store_in

Keyword

Function
Connectivity

of 22 16

SPEECON (IST-1999-10003) antenna satellite cable AUX input from terrestrial antenna input from satellite dish input from cable network select auxiliary input number Electronic Program Guide + Radio Data system enter EPG menu enter RDS menu Select EPG/RDS category

D1.3

EPG RDS thriller# love story # musical # show # news # weather information # western # comedy # series # movie# stock information # children# sports# traffic, entertainment # drama # jazz # pop # education artist title director actor

show EPG/RDS information on artist show EPG information on program title show EPG information on director of the program show EPG information on actor name Audio Devices select hi-fi system select midi tower select mini tower Record record store with normal capacity store with extended capacity save chosen source on media (MD, diskette, etc.) media for information storage Winding and search commands rewind medium in the device wind medium in the device select music types object: index mark remove index mark skip index mark object: counter activate changer Noise reduction system activate Dolby B activate Dolby C activate Dolby THX

hi-fi midi mini

record normal longplay save_on <media> MD # diskette # memory_stick # memory_card # CD#disk

Rewind fast_forward country # hip-hop # pop # rock # classic# film_music#. index remove_index skip_index Counter changer

Dolby B Dolby C Dolby THX

of 22 17

SPEECON (IST-1999-10003)

D1.3

Keyword
Prologic

Function
activate Prologic Portable devices options electronic shock protection set portable mode Indications show remaining capacity of named medium (tape, MD, CD, etc.) indicate peak level of the signal indicate average level of the signal Video device/ camera recording/mixing mode record still picture instead of movie insert audio-video track insert sound only insert video only set white balance Search/Move play single picture Radio select DAB (digital audio broadcasting) select FM bandwidth select AM bandwidth ask for stored traffic information messages (TiM)

ESP carrying_mode

capacity peak_level mean _level

still_picture insert)_AV insert_sound insert_ video white_balance

still_picture

D.A.B. F.M. A.M. traffic messages

2.1.10 Toys Speech driven toys can interact with their users, typically children. They give answers to simple questions and observe simple commands. Even though some of the functions listed below overlap with the ones listed in 2.1.1 to 2.1.9, they are listed here because children will be recorded with separate prompt sheets and thus form a database somewhat independent from the majority of the recordings. Keyword
mathematics physics chemistry geography astronomy sport English Spanish French

Function
Select teaching discipline select mathematics select physics select chemistry select geography select astronomy select Sport select English select Spanish select French

Keyword
Italian

Function
select Italian

of 22 18

SPEECON (IST-1999-10003) German Chinese technology biology history select select select select select German Chinese technology biology history

D1.3

show current lesson load next lesson load last lesson load previous lesson choose exercise store results compare results show results last page previous page solution help next question next page increase difficulty decrease difficulty judge

Working with teaching discipline start with the last lesson before system shutdown load next lesson for teaching load last lesson for teaching load last lesson for teaching choose the lesson specific exercise store the results of that exercise compare this exercise with the last one display the results load the previous page load the previous page show the solution of the problem gives some help to solve the problem give the next question load the next page increases the difficulty of the lesson or exercise decreases the difficulty of the lesson or exercise judge the result Playing games next degree of difficulty lower degree of difficulty highest degree of difficulty lowest degree of difficulty show the result of the game make a break stop the game show the available games starts playing music stops playing music show the best results of the game show the different players load the level with the chosen number store the result of the game Controlling of sound system (playing music) showing the sound level for changing showing the balance level for changing showing the volume level for changing show the titles of the list on the cd choosing the title

next level one level back highest level lowest level show result pause stop | end show me the games music on music off show ranking show players level number one | two | three | four | five | six | seven | eight | nine store result

show sound level show balance level show volume level show track list select track number

Keyword
next track previous track repeat last track

Function
playing the next track playing the previous track repeat the last track

of 22 19

SPEECON (IST-1999-10003) last track next cd activate cd-player record play stop | end repeat the last track choose next cd activating the cd-player recording something starts playing music stop playing music

D1.3

Numbers from one to thirty for choosing tracks of CDs one two three four five six seven eight nine ten eleven twelve thirteen fourteen fifteen sixteen seventeen eighteen nineteen twenty twenty-one twenty-two twenty-three twenty-four twenty-five twenty-six twenty-seven twenty-eight twenty-nine thirty Printing printing the current file in the editor Dialogue with the device activates the speech output of the device deactivates the speech output of the device

print current file

speech output on speech output off

of 22 20

SPEECON (IST-1999-10003)

D1.3

Keyword
load games load editor internet e-mail load money manager load painter

Function
Main level of the device activate the path to the games activating the editor for text processing connection to the internet activating e-mail manager activating money manager program activating painting program Commands for directing the doll doll shall look to its owner doll shall go right doll shall go left doll shall close its eyes doll shall open its eyes doll shall move straight on doll shall stand still doll shall turn to the right doll shall turn to the left doll shall look to the right doll shall look to the left doll shall turn its head to the right doll shall turn its head to the left doll shall turn its head up doll shall turn its head down doll shall come to the child doll shall go backwards doll shall run Question to the doll (doll will give answer) child asks the doll doll reacts child asks the doll doll reacts child asks the doll doll reacts child asks the doll doll reacts child asks the doll doll reacts child asks the doll doll reacts child asks the doll doll reacts child asks the doll doll reacts child asks the doll doll reacts child asks the doll doll reacts child asks the doll doll reacts child asks the doll doll reacts child asks the doll doll reacts child asks the doll doll reacts child asks the doll doll reacts child asks the doll doll reacts child asks the doll doll reacts child asks the doll doll reacts

(please) look at me (please) go right (please) go left (please) close your eyes (please) open your eyes (please) go straight on (please) stand still (please) turn right (please) turn left (please) look right (please) look left (please) turn your head right (please) turn your head left (please) turn your head up (please) turn your head down (please) come to me (please) go backwards (please) run

are you hungry? are you tired? are you sad? do you want to sleep? how old are you? whats your name? do you want to be my friend? dont you hear? are you merry? are you happy? how are you? are you thirsty? do you like me? do you want to play? are you bored? where are you? what do you do? what do you want to do?

Keyword
whos your friend? why do you cry?

Function
child asks the doll doll reacts child asks the doll doll reacts

of 22 21

SPEECON (IST-1999-10003) why are you angry? why are you happy? do you sleep? why dont you hear? what did I say? child asks the doll doll reacts child asks the doll doll reacts child asks the doll doll reacts child asks the doll doll reacts child asks the doll doll reacts Statements of the child (doll will give answer) child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts child gives the statement to the doll doll reacts Training the name of the doll activates the learning routine

D1.3

you are bad I dont like you go away shut up | be quiet I like you | I love you you are my friend you dont hear sing me a song Im bored I want to have fun you are funny Im angry Im tired I want to play Im sad sleep wake up (please) tell me a tale sit down you are boring I hate you dont cry dont be sad (please) be nice dont be angry dont be a little baby you are my baby you are stupid dont be so stupid (please) tell me your name

train your name

of 22 22