Google had their I/O presentation, and unsurprisingly there was heaps about AI. Everything from AI helping your sort your stuff, to potentially being a really handy assistant.
You can check out the Short recap video here or check out the bullet points below:
Below is a summary of some of the highlights announced:
- Search with video when you’re lost for words: Soon you’ll be able to ask questions about videos even as you take them. Searching with video will save you the time and trouble of finding the right words to describe what you’re looking for, and you’ll get an AI Overview that guides you to helpful information. Searching with video will be available soon to Search Labs users in English in the US, and expected to expand to more regions over time.
- Ask Photos in Google Photos: With Ask Photos, you can request what you’re looking for in a natural way, like: “Show me the best photo from each national park I’ve visited.” Google Photos can show you what you’re looking for, saving you from all that scrolling.
- Homework Help with Circle to Search: With Circle to Search built directly into the user experience, you can search anything you see on your phone using a simple gesture. Now, Circle to Search can help students with homework, giving them a deeper understanding, not just an answer — directly from their phones and tablets. When students circle a prompt they’re stuck on, they’ll get step-by-step instructions to solve a range of physics and math word problems without leaving their digital info sheet or syllabus.
- LearnLM enhancing learning experiences: Soon you’ll be able to use Gems, custom versions of Gemini that can act as personal experts on any topic. Learning coach, one of the pre-made Gems, can support you in building knowledge by providing step-by-step study guidance, along with helpful practice activities like quizzes and games.
- Receive alerts for suspected scams during phone calls: Google is testing a new feature that uses Gemini Nano to provide real-time alerts during a call if it detects conversation patterns commonly associated with scams. For example, you would receive an alert if a “bank representative” asks you to urgently transfer funds, make a payment with a gift card or requests personal information like card PINs or passwords, which are uncommon bank requests. This protection all happens on-device, so your conversation stays private to you.
- An improved version of Gemini 1.5 Pro: Starting today, Google are introducing a series of updates across the Gemini family of models, including Gemini 1.5 Pro, and extending its context window to 2 million tokens to further enhance performance.
- AI Assistants: Today, Google also shared their progress in building the future of AI assistants with Project Astra – advanced seeing and talking responsive agent. This is their vision for the future of AI assistants.
- Transform your ideas: Googleannounced VideoFX, a new experimental tool powered by Veo, Google DeepMind’s new and most capable generative video model to date. It’s designed to help support creatives through the storytelling journey. They’re also releasing updates for ImageFX and MusicFX as they continue to help people bridge the gap between inspiration and their final creations.
- Expansion of SynthID: A technology that adds watermarks to AI-generated images and audio so they’re easier to identify and to protect against misuse.
