+

Voice User Interface • Multi-modal Design

Supercharging your Google Home experiences with Gemini.

💡 Ideation

Phase 1: Design a vision on how Gemini can address core user needs in the Home

💡 Explore, Learn & Discuss with Gemini

Get answers about any topic in the universe from the smartest assistant right in your home.

Available anytime, enabling anyone at home to participate.

🎬 Keep You Entertained & Informed

Find the perfect song

Create the perfect playlist

Locate a photo memory

Get a personalized summary of the latest news

Hear a bedtime story just for your family

📆 Keep Your Household On-Track & On-Schedule

Communal calendaring, task management & reminders for the home

Easier task creation & management with a more natural & resilient voice interface

Your home can pull in events & tasks from multiple sources

📖 Learning companion

Get creative inspiration

Get into deep discussions about any subject

Have a personal tutor at home to create quizzes and study documents

🧪 Prototype & Test

Phase 2: Design and build a Proof of Concept that works across in-market home hardware

Launch baseline experience across existing Home surfaces

In-Market Displays

In-Market Speakers

New Voices

Launched new LLM powered voices into the home as a more conversational & capable agent.

Existing Assistant voice

0:00/1:34

New Gemini voices

After rigorous user testing we are introducing a new set of radically more natural LLM powered voices, tailored uniquely to the home.

Aloe

Calm, Mid-range voice

0:00/1:34

Oxalis

Bright, Mid-range voice

0:00/1:34

Ivy

British accent, Mid-range voice

0:00/1:34

Eucalyptus

Australian accent, Higher voice

0:00/1:34

User feedback

This voice actually sounds like someone I would meet walking down the street or at the grocery store. This voice feels nostalgic and open.

Home Agent

Applying new Gemini powered capabilities across in-market Home devices.

Problem

Noisy Events

Motion event detection is particularly noisy today. So we sought a way to use LLM's to search home camera footage for us and only surface what's needed.

Proactive notifications

Everyone can see & take action on important home events & insights with fullscreen notifications

Gemini Notifications are communal, timely & actionable, and use AI captions to be more helpful

Design Concept

Searchable Home across Nest Camera footage

Ask about recent home activity on your Google smart display

*Above concept was created still using the Classic Assistant Voice Plate

🚀 Launch Public Preview

Phase 3: Quickly bring Gemini to the Home on speakers and Smart Displays across our Public Preview testers

Meet GiA

Launch baseline experience across existing Home surfaces

Education & Opt-in

Users are educated and can opt-in to Gemini in Home via the Google Home App

Demo: Launch Gemini in Home to our home hardware

Engage in free and natural conversation on your smart home speaker

A Gemini-boosted Google Assistant is now available on some Nest speakers.

🚧 ACTIVE WORK TO BE UPDATED

🔮 Vision for Agent Expression

Phase 4: Introduce a new visual expression for Home Agent that’s modernized for the Gemini Era

We want to introduce a new visual expression for Home Agent that’s modernized for the Gemini Era, and that can scale across Speakers, Displays & TVs

Concepts

Listening

Color from bottom responds to users voice

Thinking

Rotating color while Gemini is thinking

Responding

Color from top responds to Gemini Voice