Home / News & Analysis / Siri is now trained to recognize your local, weirdly named small businesses

Siri is now trained to recognize your local, weirdly named small businesses

Getting directions to the nearest Starbucks or Target is a task Apple’s virtual assistant can handle with ease. But what about local businesses with names that Siri has never heard, and might mistake for another phrase or the user misspeaking? To handle these, Apple has created libraries of hyper-local place names so Siri never hears “Godfather’s Pizza” as “got father’s piece.”

Speech recognition systems have to be trained on large bodies of data, but while that makes them highly capable when it comes to parsing sentences and recognizing phrases, it doesn’t always teach them the kind of vocabulary that you and your friends use all the time.

When I tell a friend, “let’s go to St John’s for a drink,” they know I don’t mean some cathedral in the midwest but the bar up the street. But Siri doesn’t really have any way of knowing that — in fact, unless the system knows that “Saint John’s” is a phrase in the first place, it might think I’m saying something else entirely. It’s different when you type it into a box — it can just match strings — but when you say it, Siri has to make her best guess at what you said.

But if Siri knew that in the Seattle area, when someone says something that sounds like St John’s, they probably mean the bar, then she can respond more quickly and accurately, without having to think hard or have you select from a list of likely saints. And that’s just what Apple’s latest research does. It’s out now in English, and other languages are likely only a matter of time.

To do this, Apple’s voice recognition team pulled local search results from Apple Maps, sorting out the “places of interest” — you (or an algorithm) can spot these, because people refer to them in certain ways, like “where is the nearest…” and “directions to…” and that sort of thing.

Obviously the sets of these POIs, once you remove national chains like Taco Bell, will represent the unique places that people in a region search for. Burger-seekers here in Seattle will ask about the nearest Dick’s Drive-in, for example (though we already know where they are), while those in L.A. will of course be looking for In-N-Out. But someone in Pittsburgh likely is never looking for either.

Apple sorted these into 170 distinct areas: 169 “combined statistical areas” as defined by the U.S. Census Bureau, which are small enough to have local preferences but not so small that you end up with thousands of them. The special place names for each of these were trained not into the main language model (LM) used by Siri, but into tiny adjunct models (called Geo-LMs) that can be tagged in if the user is looking for a POI using those location-indicating phrases from above.

So when you ask “who is Machiavelli,” you get the normal answer. But when you ask “where is Machiavelli’s,” that prompts the system to query the local Geo-LM (your location is known, of course) and check whether Machiavelli’s is on the list of local POIs (it should be, because the food is great there). Now Siri knows to respond with directions to the restaurant and not to the actual castle where Machiavelli was imprisoned.

Doing this cut the error rate by huge amount – from as much as 25-30 percent to 10-15. That means getting the right result 8 or 9 out of 10 times rather than 2 out of 3; a qualitative improvement that could prevent people from abandoning Siri queries in frustration when it repeatedly fails to understand what they want.

What’s great about this approach is that it’s relatively simple (if not trivial) to expand to other languages and domains. There’s no reason it wouldn’t work for Spanish or Korean, as long as there’s enough data to build it on. And for that matter, why shouldn’t Siri have a special vocabulary set for people in a certain jargon-heavy industry, to reduce spelling errors in notes?

This improved capability is already out, so you should be able to test it out now — or maybe you have been for the last few weeks and didn’t even know it.

Read more

Check Also

Y Combinator is launching a startup program in China

U.S. accelerator Y Combinator is expanding to China after it announced the hiring of former Microsoft and Baidu Qi Lu who will develop a standalone startup program that runs on Chinese soil. Shanghai-born Lu spent 11 years with Yahoo and eight years with Microsoft before a short spell with Baidu, where he was COO and head of the firm’s AI research division. Now he becomes founding CEO of YC China while he’s also stepping into the role of Head of YC Research. YC will also expand its research team with an office in Seattle, where Lu has plenty of links. There’s no immediate timeframe for when YC will launch its China program, which represents its first global expansion, but YC President Sam Altman told TechCrunch in an interview that the program will be based in Beijing once it is up and running. Altman said Lu will use his network and YC’s growing presence in China — it ran its first ‘Startup School’ event in Beijing earlier this year — to recruit prospects who will be put into the upcoming winter program in the U.S.. Following that, YC will work to launch the China-based program as soon as possible. It appears that the details are still being sketched out, although Altman did confirm it will run independently but may lean on local partners for help. The YC President he envisages batch programming in the U.S. and China overlapping to a point with visitors, shared mentors and potentially other interaction between the two. China’s startup scene has grown massively in recent years, numerous reports peg it close to that of the U.S., so it makes sense that YC, as an ‘ecosystem builder,’ wants to in. But Altman believes that the benefits extend beyond YC and will strengthen its network of founders, which spans more than 1,700 startups. “The number one asset YC has is a very special founder community,” he told TechCrunch. “The opportunity to include a lot more Chinese founders seems super valuable to everyone. Over the next decade, a significant portion of the tech companies started will be from the U.S. or China [so operating a] network across both is a huge deal.” Altman said he’s also banking on Lu being the man to make YC China happen. He revealed that he’s spent a decade trying to hire Lu, who he described as “one of the most impressive technologists I know.” Y Combinator President Sam Altman has often spoken of his desire to get into the Chinese market Entering China as a foreign entity is never easy, and in the venture world it is particularly tricky because China already has an advanced ecosystem of firms with their own networks for founders, particularly in the early-stage space. But Altman is confident that YC’s global reach and roster of founders and mentors appeals to startups in China. YC has been working to add Chinese startups to its U.S.-based programs for some time. Altman has long been keen on an expansion to China, as he discussed at our Disrupt event last year, and partner Eric Migicovsky — who co-founder Pebble — has been busy developing networks and arranging events like the Beijing one to raise its profile. That’s seen some progress with more teams from China — and other parts of the world — taking part in YC batches, which have never been more diverse. But YC is still missing out on global talent. According to its own data, fewer than 10 Chinese companies have passed through its corridors but that list looks like it is missing some names so the number may be higher. Clearly, though, admission are skewed towards the U.S. — the question is whether Qi Lu and creation of YC China can significantly alter that.

Leave a Reply

Your email address will not be published. Required fields are marked *

Disclaimer: Trading in bitcoins or other digital currencies carries a high level of risk and can result in the total loss of the invested capital. theonlinetech.org does not provide investment advice, but only reflects its own opinion. Please ensure that if you trade or invest in bitcoins or other digital currencies (for example, investing in cloud mining services) you fully understand the risks involved! Please also note that some external links are affiliate links.