Smart homes are a broken mess and Nest wants to fix it

“If you have multiple Google Homes today in your house, sometimes it’ll answer in the wrong place,” Chandra pointed out. That’s been one of my biggest complaints about the Assistant, and I vehemently agreed when he brought that up. Thankfully, Chandra is aware of the issue and said, “We’re working on that.”

“But that, in my mind, summarizes the problem,” he added.

Chandra believes there are two key pieces that are missing. “One is a connectivity layer that actually connects all these devices to share context in a trustworthy secure way,” he said. This layer might be WiFi, Bluetooth Low Energy or Thread radios, a Nest-initiated low-power network protocol.

The second missing piece, according to Chandra, is an intelligence system. “It has to be able to process: ‘Oh, here’s all the signals I’m understanding, here’s the right output,'” he explained. So the next time you’re in your kitchen and you ask your Google Home for a cookie recipe, for example, it should display the steps on the Nest Hub rather than, say, your phone.

Ideally, for Chandra, the processing of these decisions would happen locally within the home, rather than relying on the Google Cloud. On-device processing is a core focus of the Face Match tool that debuted on the Nest Hub Max that Google announced in May. The smart display’s camera will look out for faces of people in front of it to show personalized information and notifications. During the launch, Google stressed that the data involved in that recognition process stays on the Hub Max.

This means your data (like pictures of your face, in this case) won’t be sent to the cloud for processing and the verification will happen on your device itself. This minimizes the chances for people to intercept and obtain your info. The idea doesn’t just have privacy benefits either. Google’s already planning to make its next-generation Assistant eventually run completely on your phone, without relying on an internet connection. “We’re not stopping at the phone,” Chandra said. “We want to continue to see how we can bring a lot of elements of the Assistant onto as many devices as possible to unlock this value of intelligence that sits inside the home as well.”

With a powerful and secure contextual engine in place, smart home companies can focus on creating experiences that are helpful and intuitive. One of the improvements or shifts that Chandra would like to see is a switch from social personal computing — that is, your phone existing solely to serve you — to communal computing. That’s when you have a device in your home that’s meant to be used by several people who share your space.

“We have to understand the context of multiple people in the house and react to it,” Chandra said. If he’s listening to music by himself, for example, he wants the device to play his favorite songs. When one of his kids walks in the room, though, he wants it to be smart enough to not play anything explicit.

“That’s kind of the next thing we have to go build,” Chandra said. And a key component is making the transitions between personal and communal seamless. But how can Google go about doing this? “We’re not going to ask users to log in and out of their homes,” Chandra said. He points to some Google technologies as some of those building blocks — Voice Match on Home speakers and Face Match on the Nest Hub Max.

There also needs to be a unified platform to help reduce the friction and frustration facing consumers who buy devices from different companies. “That’s where I see the biggest innovation happening,” Chandra said. He recalled a time when web developers had to code four different versions of their sites for the many different browsers and rendering engines that people were using. The industry aligned then with the W3C standardized protocols for web design. Chandra believes something similar must happen for the smart home.

Other companies generally agree. Yianni said that in future, “We expect more consolidation to happen.” De Masi said that the future of IoT cannot be different products with a separate app controlling each one. The good news is, it sounds like we’re closer to a simple unified smart home than we’ve ever been.

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission.