Webex Assistant for Devices

Domain

Intent

Example Command

Typical Reply

Description

active_meeting

are_you_there

are you listening? is Webex Assistant on the call?

Here I am! Right where you left me.

Asks if the assistant is active. Small talk intent.

active_meeting

decision

We decided to move ahead with the latest proposal.

OK! Decision created.

Adds the text after the "decision" keywords to

active_meeting

highlight_that

Highlight that

Highlighted!

Adds the last sentence in the transcript as a highlight to the highlight reel for the meeting.

active_meeting

note

Note that we updated the proposal.

Note taken!

Adds the text after the "note" keyword to the highlight reel for the meeting.

active_meeting

post_action_item

Action item to review the deck

Ok! Action item added.

Adds the text after the "action item" keyword to the highlight reel for the meeting.

active_meeting

set_summary

In summary, we are moving ahead with Friday's release plan

Ok! Summary created.

Adds the text after the "set_summary" keyword to the highlight reel for the meeting.

active_meeting

task

Create a task to look at the UI fix

Got it! New task created.

Adds the text after the "task" keyword to the highlight reel for the meeting.

device

decrease_volume

just the volume down

lower the volume

Directs the system to lower the audio output level, without specifying an amount.

device

disable_bluetooth

bluetooth off

Bluetooth is disabled. To enable Bluetooth, say "OK Webex, turn on Bluetooth".

Directs the system to disable the bluetooth system. Note the actual effect is disabling the system not ending a particular connection, though we don't expect users to make this distinction well.

device

disable_camera

turn off the video

camera off

This device doesn't currently support camera control.

Directs the system to stop sending the video stream from the device's camera into the call.

device

disable_do_not_disturb

get out of do not disturb mode

I turned off Do Not Disturb mode. This device can receive incoming calls.

Directs the system to leave do-not-disturb mode, i.e. stop blocking incoming calls.

device

disable_speaker_tracking

turn off speaker tracking

I turned SpeakerTrack off.

Directs the system to disable SpeakerTrack, which dynamically crops the video feed around the speaker (detecting motion + sound).

device

disable_speakers

mute the audio output

mute video

Directs the system to disable the audio output on the device.

device

display_information_page

Bring up the information page

software version

Let me show you what I found on the touch panel.

Directs the system to display information about the device, e.g. IP address, software version, settings

device

enable_bluetooth

enable bluetooth

I turned on Bluetooth. This device is now discoverable as "Test".

Directs the system to enable the bluetooth system. Note the actual effect is enabling the system not making a particular connection, though we don't expect users to make this distinction well.

device

enable_camera

activate camera

turn on the camera

This device doesn't currently support camera control.

Directs the system to start sending the video stream from the device's camera into the call.

device

enable_do_not_disturb

block all calls

I turned on Do Not Disturb mode. All incoming calls will be automatically rejected.

Directs the system to enter do-not-disturb mode, i.e. start blocking incoming calls.

device

enable_speaker_tracking

enable speaker tracker

turn on speaker track

I turned SpeakerTrack on.

Directs the system to enable SpeakerTrack, which dynamically crops the video feed around the speaker (detecting motion + sound).

device

enable_speakers

unmute the sound level

speaker speaker

Directs the system to enable the audio output on the device.

device

increase_volume

raise the volume level

turn up the volume

Directs the system to raise the audio output level, without specifying an amount.

device

maximize_selfview

maximize selfview please

full screen self review

Directs the system to show the camera feed preview in fullscreen mode.

device

minimize_selfview

corner video view

smaller camera preview

Directs the system to show the camera feed preview in a small frame in the corner of the screen.

device

mute_microphone

mute mic

mute

Hmmm. I can't control the microphone when we're not in a meeting.

Directs the system to disable all audio input on the device (both to the call and to the Assistant).

device

pause_recording

Pause current recording

I'm not able to help you with that just yet.

Directs the system to pause a meeting recording, i.e. temporarily stop the recording process without closing the recording file.

device

resume_recording

return to recording

That feature isn't supported on this device yet.

Directs the system to continue recording after being paused.

device

set_volume

Could you please turn that down to 30 percent

set the volume to 8

volume control

Directs the system to set the audio output level to a particular value.

device

start_recording

start recording please

record this meeting

Hmmm. We're not in a meeting, so I can't start a recording.

Directs the system to begin recording the ongoing meeting.

device

start_screen_share

shared screen

share my screen

show my presentation

Hmmm. There aren't any screens to share. You can use your Webex app to share wirelessly, or try plugging in a display cable.

Directs the system to share the screen from an attached personal device to the display. Note that wireless screen share will not work until authentication is implemented, but queries about wireless screen share still belong in this intent.

device

stop_recording

stop recording me

stop recording

end meeting recording

Hmmm. We're not in a meeting, so I can't start a recording.

Directs the system to end the meeting recording (closing the recording file).

device

stop_screen_share

screen sharing off

stop sharing

stop my presentation

Hmmm. There aren't any screens being shared. If you're sharing wirelessly, check your Webex app and stop sharing there.

Directs the system to stop sharing from a personal device screen to the Room device display, whether connected wirelessly or with a display cable.

device

turn_off_selfview

hide self view

turn off self view

Directs the system to disable the on-screen camera feed preview.

device

turn_on_selfview

display self view

South view

turn on self view

Directs the system to show the on-screen camera feed preview (in minimized mode by default).

device

unmute_microphone

switch on microphone

turn microphone on

I turned the microphone on.

Directs the system to enable all audio input on the device.

general

back

back back back

go back

previous page

earlier screen

Within a scrollable view, directs the system to shift the view leftward or upward. Elsewhere, return to previous dialogue state.

general

cancel

cancel now

cancel

nevermind

stop it

abort

Directs the system to stop the current or most recent activity, whatever it is, e.g. an outgoing call, a search carousel, or a screen share.

  1. Specifies that some temporary situation or change currently/soon happening should abort.

  2. Does not specify what should stop.

general

confirm

sounds good

yes

okay

right

Hmmm. I'm not sure how to help with that.

Accepts a suggested action.

general

dismiss

disappear

dismiss

sleep

shut up

leave me alone

Directs the system to immediately stop listening, hide the UI, and end the dialogue.

general

exit

that was all i needed

done

please quit

i want to exit

i'm finished

Hmmm. I'm not sure what you meant by that.

Directs the system to exit or end the current activity, whatever it is e.g. an ongoing call or a dialogue.

  1. Specifies that some ongoing activity should end.

  2. Does not specify what should end.

general

get_date

is today the weekend

what day is it today

Hmmm. There's no timezone information available for this device.

Requests the date information for a particular day.

general

get_time

tell me the time now

what time is it

what is the time

Hmmm. There's no timezone information available for this device.

Requests the current time.

general

goodbye

talk to you later

goodbye

OK, see you later!

Bids goodbye to the system, ending the current activity, whatever it is.

general

greet

yo

hello

morning

Hey there!

Greets the system to get attention.

general

help

please assist me

what can you do

help me with meetings

how do I call a personal room

help on device control

I'm Webex Assistant. I'm here to help you and your team work better together.

Requests general assistance about what commands are supported.

general

how_are_you

how is everything

how are you

I'm great, thanks! Hope you're doing well, too.

Greets the system expressing sympathy for its wellbeing.

general

more

show more

next page

go down

show me the next page

Hmmm. I'm not sure how to help with that.

Within a scrollable view, directs the system to shift the view rightward or downward. In a focus view, directs the system to deselect the focused item.

general

negate

no

sorry no

none of these

not yet

that's wrong

Rejects suggested action(s).

general

select

call 8

option 1

Hmmm. I'm not sure how to help with that.

Within a numbered carousel view, directs the system to select a particular option.

general

select_page

page 5

Hmmm. I'm not sure how to help with that.

Within a scrollable view, directs the system to shift the view to a particular page. (Not supported.)

general

specify_time_or_duration

for 3 hours

until 3 PM

for 1 hour at 3 PM

from 1:30 PM to 4

Provides time requirements of a meeting or calendar view.

general

specify_number

1

3

1

3

Provides numeric requirements for selecting an option, or, can be used to specify a time in context of calendaring flow.

general

start_over

Begin again

restart

Within a dialogue flow, directs the system to reset at the first stage of the dialogue flow.

general

timeout

?

Hmmm. I'm not sure how to help with that.

Intent for queries that are empty (other than punctuation).

general

whats_up

what are you up to

I'm exploring new ways on how to make the workplace even more productive.

Greets the system expressing interest in activities.

identity

age

what is your age

I am ageless.

Requests information about the system's age.

identity

creator

who made you

Cisco Systems created me.

Requests information about the system's development.

identity

introduce

what is your name

I'm Webex Assistant. I can help you work with your team better.

Requests information about the system's identity.

identity

other_languages

what languages do you speak

English is my first language, but I'd like to learn other languages, too.

Requests information about language support.

identity

other_smart_assistants

is alexa way smarter than you

I'm an assistant for meetings and collaboration, not a personal assistant.

Requests information comparing the system to other intelligent assistants.

identity

spark_and_ai

are you a genius

I'm a meeting assistant trained using advanced language and machine learning algorithms.

Requests information about the system's intelligence.

identity

where_are_we

what is this place

Hmmm. This room doesn't seem to have a name.

Requests information about the user's location.

identity

where_from

where you from

I come from Cisco Systems, which has offices all over the world.

Requests information about the system's origin.

meetings

accept_incoming_call

get that

answer

Hmmm. There aren't any calls to answer.

Directs the system to connect (answer) an incoming call.

meetings

calendar

is my calendar up to date?

I'm not able to access personal calendars. However, this room is free.

Requests information about the user's personal calendar.

meetings

call_number

Start a call to this phone number

telephone number

OK. Tell me the phone number you'd like to call.

Directs the system to start a call to an unspecified phone number.

meetings

call_person

Begin a video conference with denny robins, sourcing partner manager

add Robert to this video call

make a webex call

Dial Chad

call 867-5309

Hmmm. There isn't anyone named 'denny robins'.

Directs the system to start a call to a person. The person may be unspecified or identified by name, spelled out name or phone number, and potentially restricted by job title, group affiliation or location.

meetings

confirm_name

Carlton Farmer.

M A J I N D E R

Hmmm. I'm not sure how to help with that.

Provides or reiterates the name of a person.

meetings

confirm_title

the senior corporate counsel

the C S M

Hmmm. I'm not sure how to help with that.

Provides or reiterates the job title of a person.

meetings

end_call

disconnect me from this call

end call

end the meeting

hang up

disconnect the call

Hmmm. There aren't any calls to end.

Directs the system to leave or end a call or meeting.

meetings

ignore_incoming_call

mute the incoming call

Hmmm. There isn't a call to answer.

Directs the system to ignore an incoming call, i.e. let it ring silently.

meetings

join_meeting

Join the meeting

Initiate the video conference with Santos Bailey

Hmmm. There isn't anyone named 'Santos Bailey'.

Directs the system to connect to a meeting on the device's calendar.

meetings

join_pmr

call my personal room

Call Owen's personal meeting room

personal room for M I K H I L

There's no Personal Room for Owen.

Directs the system to connect to a Webex Personal Room.

meetings

reject_incoming_call

decline that

Hmmm. There isn't a call to answer.

Directs the system to reject an incoming call.

meetings

room_availability

show calendar

is the room booked now

is this briefing room free at noon on thursday

when is this room available

Sorry, I can only check room availability for today, not for days in the future.

Requests information about the room's availability according to the device's calendar.

meetings

schedule_meeting

schedule a meeting with Howard please

book a meeting with Samantha at noon

I'm not able to schedule meetings just yet.

Directs the system to create a meeting invitation with another person.

meetings

schedule_room

set up a meeting at 11 AM

I want to book this room

schedule a 30 minute meeting

Directs the system to block out a reservation in the room.

meetings

unsupported_operation

can you check someone's availability for me

I can't help with that just yet.

Directs the system to do one of a variety of actions that are not (yet) supported, e.g. cancel meetings, send meeting notifications, display directory information.

unrelated

ask_about_ai

tell me more about machine learning

Artificial Intelligence and Machine Learning help computers to learn from experience without being explicitly programmed.

Requests information about artificial intelligence.

unrelated

ask_about_cisco

what's cisco

Cisco is a market leader in networking hardware, telecommunication equipment and collaboration technology.

Requests information about Cisco.

unrelated

book_flights_and_hotels

Can you book 3 adult flight tickets to Hawaii in mid November for three nights stay as well?

Travel booking is outside my area of expertise.

Directs the system to arrange a flight or hotel booking.

unrelated

calculate

what is ten minus eleven

Math isn't my strongest subject.

Directs the system to perform a mathematical calculation.

unrelated

check_weather

what is the forecast next week for busan in c

Weather forecasts aren't my specialty.

Requests information about weather forecasts.

unrelated

compliment

You're a perfect arrangement of atoms

I'm always trying my best to help you.

Expresses appreciation of system abilities.

unrelated

control_timer_and_alarm

remove all alarms tomorrow

I'm not designed to set timers or alarms.

Directs the system to set or change a timer or alarm.

unrelated

convert_unit

convert 5 liters to ounces

I'm not trained to convert units.

Directs the system to perform a conversion between units.

unrelated

get_date_time_unsupported

Provide me with game time for Cubs?

I'm not sure how to help with that.

Requests the date or time for another timezone, another day or a non-meeting calendar event, e.g. holidays.

unrelated

get_finance_info

How many shares of Wells Fargo has been traded today.

Sorry, I'm not a finance guru.

Requests information about financial markets.

unrelated

get_music

Something like a 90's punk song that is alternative.

I don't know much about music.

Directs the system to find or play a music album, artist or track.

unrelated

get_news

What's the latest headline from the New York Times?

Current events aren't my strong suit.

Requests information about headline news.

unrelated

get_ride

get us a cab please

I'm not able to help with transportation.

Directs the system to arrange a car ride.

unrelated

get_traffic_navigation

How long will it take to get to Chicago?

I don't have information about traffic and navigation.

Requests information about road traffic or navigation.

unrelated

insult

that's not a good answer at all

That's nice of you to say!

Expresses dissatisfaction with system abilities.

unrelated

send_feedback

there is a critical issue I need to report

Directs the system to note feedback about system behavior.

unrelated

tell_joke

know any jokes

Sorry, I'm all business.

Directs the system to tell a joke.

unrelated

unknown

when was the twilight written

I'm not sure how to help with that.

Requests any other information or action.

whiteboards

close_whiteboard

close the whiteboard please

This device doesn't support whiteboards.

Directs the system to close the whiteboard display.

whiteboards

delete_all_whiteboards

delete whiteboards

This device doesn't support whiteboards.

Directs the system to delete all on-device whiteboards.

whiteboards

delete_whiteboard

get rid of that board

This device doesn't support whiteboards.

Directs the system to delete a particular whiteboard.

whiteboards

open_new_whiteboard

a new whiteboard please

This device doesn't support whiteboards.

Directs the system to open a new blank whiteboard.

whiteboards

open_whiteboard

open a whiteboard please

This device doesn't support whiteboards.

Directs the system to show whiteboards that are available to open.

whiteboards

save_whiteboard

i need you to keep the whiteboard

This device doesn't support whiteboards.

Directs the system to save a whiteboard to a Teams space.

Proactive Join Responses

Response

Example

Description

Accepted

Yes

Yes, please

Join

The user confirms the proactive prompt to join the upcoming meeting

Rejected

No

Oh, no no

Go away

The user rejects the proactive prompt to join the upcoming meeting

No Response

" "

Either there was no user in the room at the time of the Proactive Join prompt or the user chose to stay silent until the prompt times out in 15 sec

Unrelated

Looks like there is a

What’s the news?

There was an unexpected response to the Proactive Join prompt that cannot be categorized under any of the supported intents.

This usually happens when people in the room are having a conversation and the the Assistant picks up random chatter instead of the response to Proactive Join.

Exited

Help

Call

The user exited the Proactive Join prompt by giving another command to the Assistant instead.

Error

" "

These prompts were never seen by the user because they were triggered under the wrong conditions but were registered as a problematic prompt on the metrics services.