Skip to content
Tech News
← Back to articles

Google's In-Car Gemini Dimmed the Sunroof, Ordered Dinner and Became My Tour Guide

read original get Google Nest Hub Max → more articles
Why This Matters

Google's new in-car AI features, showcased at I/O, demonstrate how voice-activated AI can enhance driver safety and convenience by enabling hands-free control of vehicle functions and providing real-time information without distraction. This advancement signifies a step toward more integrated, intelligent, and safer automotive experiences for consumers and the industry alike.

Key Takeaways

On a balmy, 86-degree day in Mountain View, just outside Google's sprawling campus, I sought refuge from the glaring California sun in a Volvo EX60 -- or so I thought. The air conditioning wasn't working.

To mitigate the heat even slightly, we opted to darken the transparent sunroof. And all we had to do was ask Gemini.

"Can you make the sunroof opaque?" Vivek Radhakrishnan, a technical program manager at Google, asked the car via voice command. Like magic, the electrochromic window stretching over us blocked the light beaming in from above. We didn't have to rummage through the car's settings to find the right button.

At Google's I/O developer conference on Tuesday, I got an early look at a handful of new features coming to cars supporting Google Built-in and Android Auto. The upcoming capabilities, rolling out later this year, are designed to help you keep your eyes on the road while offering useful information. You can lean on Gemini AI to handle tasks like sharing your ETA, describing that landmark that caught your eye and even helping you order dinner.

Watch this: Google's Car Update Helps You Keep Your Eyes on the Road 02:10

The Volvo EX60 comes equipped with Google Built-in, a native operating system for car infotainment systems that lets you tap directly into Google's services. We could ask Gemini to identify a dashboard warning light, for example, or have it gauge whether a 65-inch TV we just bought would fit in the back.

Although we were technically parked outside of Shoreline Amphitheater, a giant TV in front of us simulated driving along a San Francisco road toward one of the city's signature skyscrapers. We asked Gemini, "What's that tall building in front of me, and can you tell me something interesting about it?"

Using the car's front-facing camera, Gemini identified the Transamerica Pyramid, "which stood as the tallest building in San Francisco for 45 years." We got some bonus information, too, as Gemini said, "Nearby, on your right, you'll find the historic copper-clad Sentinel Building, a landmark that miraculously survived the 1906 earthquake and later became home to Francis Ford Coppola's film studio." It was neat to get that much detail and learn something new.

Afterward, we hopped over to the Kia EV9 (which thankfully had functioning A/C) to get a look at upcoming Android Auto features, which are available by connecting your phone to the vehicle. They include a more personalized dashboard design built on Google's Material 3 Expressive, so you can display a picture of your cat alongside custom widgets, for instance.

While still parked, we then opened up YouTube and watched videos in 4K resolution at 60 frames per second, which can make the time you spend charging your vehicle a little more entertaining. Once you start driving, those videos automatically shift to audio-only so they're not distracting.

... continue reading