BREAKING NEWS Justice Ruth Bader Ginsburg dead at 87 Full Story

How Alexa knows the difference between a breaking window and a wine glass

For Amazon, getting Alexa's new security-guard feature to work meant literally breaking a lot of windows....

Posted: Jan 15, 2019 6:47 PM
Updated: Jan 15, 2019 6:47 PM

For Amazon, getting Alexa's new security-guard feature to work meant literally breaking a lot of windows.

In December, the company started inviting Amazon Echo users to try out Alexa Guard, a new setting that turns the smart speakers into home security devices. It listens for suspicious sounds when you're away and sends a smartphone alert if it detects, say, a window breaking and a possible break in.

Alcoholic beverages

Amazon.com Inc

Artificial intelligence

Beverages

Business and industry sectors

Business, economy and trade

Companies

Computer science and information technology

Consumer products

Food and drink

Kinds of foods and beverages

Technology

Voice and virtual assistants

Wine

According to Prem Natarajan, vice president of Alexa's AI division, Amazon employees had to destroy different types of glass, such as window glass, wine glasses and drinking glasses, with tools like baseballs or hammers to train the technology.

Considering most of us have all kinds of glass things in our homes, it was important for Alexa to learn the difference between a cat knocking over a wine glass and a burglar smashing a living-room window.

"You don't want [Alexa] to respond to any glass breaking," Natarajan told CNN Business.

Machine learning -- a type of artificial intelligence that learns from data and improves over time -- underpins Alexa's ability to respond to a trigger word and command.

Alexa Guard is activated by the spoken command, "Alexa, I'm leaving," which is picked up by the Echo's built-in microphones. In addition to detecting broken glass, the feature lets the Echo keep an ear out for a smoke or carbon-monoxide detector blaring, and can turn on smart lights to make it look like someone is home.

Natarajan said Amazon first tried to train Alexa Guard to recognize window-smashing sounds with audio of glass breaking from movies. But that proved unsuccessful when the software was tasked with sorting through real-world sounds.

However, breaking real windows and dropping glass from different heights allowed Amazon to collect data that showed differences in acoustic characteristics for various objects and scenarios. This data was then used to train a machine-learning algorithm to recognize the right kind of noise.

Alexa Guard is a way for Amazon to differentiate Alexa from Google's Assistant, Apple's Siri, and others in the rapidly growing market for voice assistants. Plenty of home-security systems can detect breaking glass, but they typically require a separate sensor and may only work over a small area.

According to MIT spoken language systems group leader Jim Glass -- yes, that's his real last name -- Amazon should be able to train Alexa to recognize anything that average human can learn to discern with their ears.

"They can use it to try and pick up the sound of a breaking window; maybe they can train it to try and learn when your bathtub is overflowing," he suggested.

But perhaps the team will need to stock up on bathtubs first.

West Lafayette
Clear
60° wxIcon
Hi: 67° Lo: 40°
Feels Like: 60°
Kokomo
Clear
55° wxIcon
Hi: 64° Lo: 37°
Feels Like: 55°
Rensselaer
Clear
50° wxIcon
Hi: 64° Lo: 37°
Feels Like: 50°
Fowler
Clear
50° wxIcon
Hi: 64° Lo: 37°
Feels Like: 50°
Williamsport
Clear
52° wxIcon
Hi: 66° Lo: 38°
Feels Like: 52°
Crawfordsville
Clear
49° wxIcon
Hi: 66° Lo: 40°
Feels Like: 49°
Frankfort
Clear
49° wxIcon
Hi: 64° Lo: 38°
Feels Like: 47°
Delphi
Clear
53° wxIcon
Hi: 67° Lo: 38°
Feels Like: 53°
Monticello
Clear
53° wxIcon
Hi: 66° Lo: 38°
Feels Like: 53°
Logansport
Clear
52° wxIcon
Hi: 64° Lo: 36°
Feels Like: 52°
Below normal temperatures & patches of frost in the north & northeast.
WLFI Radar
WLFI Temps
WLFI Planner

Indiana Coronavirus Cases

Data is updated nightly.

Confirmed Cases: 108646

Reported Deaths: 3478
CountyConfirmedDeaths
Marion20341757
Lake10013312
Elkhart6198106
St. Joseph586796
Allen5785198
Hamilton4600109
Vanderburgh318126
Hendricks2607120
Monroe224336
Johnson2241122
Tippecanoe211313
Clark205056
Porter197843
Cass19209
Delaware180159
Vigo169621
Madison153075
LaPorte134837
Floyd127961
Howard125163
Kosciusko116717
Bartholomew113257
Warrick104134
Marshall97423
Boone93846
Dubois92118
Hancock89242
Noble86432
Grant85132
Henry73424
Jackson7259
Wayne72214
Morgan68038
Shelby65529
LaGrange62811
Daviess61627
Dearborn61428
Clinton59111
Harrison54824
Putnam5098
Lawrence49928
Montgomery49421
White47114
Knox4659
Decatur44739
Gibson4344
DeKalb42511
Miami4202
Greene40935
Fayette40413
Jasper3732
Scott34410
Steuben3447
Sullivan32612
Jennings30512
Franklin29225
Posey2900
Clay2855
Orange27924
Ripley2768
Carroll26713
Wabash2547
Washington2491
Whitley2456
Wells2422
Starke2387
Jefferson2363
Adams2303
Fulton2292
Tipton21522
Huntington2073
Randolph2047
Perry20014
Spencer1984
Jay1640
Newton16411
Owen1621
Martin1560
Rush1484
Pike1331
Vermillion1210
Fountain1152
Pulaski1121
Blackford1072
Crawford980
Brown933
Parke902
Benton880
Union760
Ohio757
Switzerland660
Warren381
Unassigned0225

COVID-19 Important links and resources

As the spread of COVID-19, or as it's more commonly known as the coronavirus continues, this page will serve as your one-stop for the resources you need to stay informed and to keep you and your family safe. CLICK HERE

Closings related to the prevention of the COVID-19 can be found on our Closings page.

Community Events