Voice Commands

ToonTalk can respond to voice commands while holding widgets or tools. This is currently enabled only if listen=1 is a URL parameter. It works in Chrome and some versions of FireFox. Click to learn if your browser supports speech recognition.

Note that the first time ToonTalk attemmpts to access the microphone a dialog will appear asking permission. This will happen repeatedly if you are accessing ToonTalk via HTTP instead of HTTPS.

The magic wand

{ "semantic": { "type": "wand" }, "view": { "frontside_width": 191, "frontside_height": 31, "frontside_left": 6, "frontside_top": 6 }, "version": 1 }

While holding the Magic Wand over a widget you can say "copy" or "abracadabra" and the widget will be copied.

Dusty the Vacuum

{ "semantic": { "type": "vacuum" }, "view": { "frontside_width": 123, "frontside_height": 45, "frontside_left": 6, "frontside_top": 6 }, "version": 1 }

You can say "suck" or "erase" while the vacuum is over a widget to remove or erase it. Each time you say "restore" the vacuum will unerase a widget if selected otherwise it will spit out a previously removed item. If you say "remove all" then everything will be removed (but still can be restored).

Voice commands that work for all widgets

You can say "I am ..." or "I'm ..." to provide a description of the widget that is held. The description will appear in tool tips and on the back side of the widget.

Voice commands for named widgets

If the widget has a name (currently robots, birds, and nests) then you can change their name by saying "my name is ..." or "call me ...".

Numbers

{ "semantic": { "type": "number", "operator": "+", "numerator": "1", "denominator": "1", "format": "improper_fraction" }, "view": { "frontside_width": 76, "frontside_height": 55, "frontside_left": 57, "frontside_top": 82, "drag_x_offset": 19, "drag_y_offset": 46 }, "version": 1 }

The value of a number can be changed by saying the number while holding it. The operation of a number can be changed by saying "add", "plus", "sum", "addition", "subtract", "subtraction", "take away", "times", "multiply", "multiplication", "divide", "division", "equal", or "equals". The format of the number can be changed by saying "decimal number", "decimal", "mixed number", "mixed", "improper fraction", "improper", "fraction", "scientific notation", or "scientific".

Boxes

{ "semantic": { "type": "box", "size": 2, "contents": [ null, null ], "horizontal": true, "running": true }, "view": { "frontside_width": 164, "frontside_height": 68, "frontside_left": 268, "frontside_top": 53, "backside_geometry": { "x_scale": 1, "y_scale": 1, "original_width": 171, "original_height": 39 }, "drag_x_offset": 68, "drag_y_offset": 66 }, "version": 1 }

You can change the number of holes of a box while holding it by saying a whole number. You can change the box's orientation by saying "left to right", "horizontal", "top to bottom", or "vertical".