Explorer

Google I/O 2024: Google's Next-Gen AI Assistant Project Astra Launched To Rival OpenAI's GPT-4o

Project Astra's functionalities will be integrated into various Google products, including the Gemini app through the Gemini Live interface, later this year.

During the annual I/O developer conference, Demis Hassabis, the top executive spearheading the company's AI resurgence at Google, unveiled Project Astra, a "next-generation AI assistant." Project Astra is a cutting-edge multimodal AI agent designed to respond to user queries instantly through text, audio, or video inputs. A demo video released by Google showcased the AI assistant engaging in real-time conversations with users, mirroring the capabilities demonstrated by OpenAI's just-launched GPT-4o model.

Project Astra's functionalities will be integrated into various Google products, including the Gemini app through the Gemini Live interface, later this year.

Also read: Google Pixel 8a Review: Excellent Mid-Ranger With Flagship Features

A video clip demonstrated its functionality as a smartphone app and showcased a prototype of smart glasses. This new innovation fulfills a pledge made by Hassabis regarding Gemini's potential upon its initial introduction in December last year.

Astra demonstrated its ability to understand spoken commands, interpret objects and environments captured by the device cameras, and engage in natural language conversations about them. It successfully identified a computer speaker, answered inquiries about its features, recognised a London neighbourhood from an office window view, analysed code displayed on a computer screen, crafted a limerick about pencils, and recalled the location of misplaced glasses.

Also read: Google I/O 2024 Conference: Scam Call Detection Coming To Android

According to Google, Project Astra accelerates information processing by encoding video frames, merging video and speech inputs into a chronological sequence of events, and caching this data for retrieval. Additionally, Google has enhanced the sound of the new AI assistant, rendering it more natural, and offers users the flexibility to switch between various voices.

“To be truly useful, an agent needs to understand and respond to the complex and dynamic world just like people do -- and take in and remember what it sees and hears to understand context and take action. It also needs to be proactive, teachable and personal, so users can talk to it naturally and without lag or delay," Demis Hassabis, Google DeepMind CEO, said during the event.

Top Headlines

Workday Outage Disrupts HR Services, Leaves Employees Unable To Access Payroll And Leave Functions
Workday Outage Disrupts HR Services, Leaves Employees Unable To Access Payroll And Leave Functions
'Deeply Sorry For Disruption': Microsoft Apologises For Global Outage, Rules Out Cyberattack As Cause
Microsoft Apologises For Global Outage, Rules Out Cyberattack, AI Agents As Cause
Microsoft Says Network Upgrade Glitch Caused Outlook, Teams Outage, Rules Out AI Or Cyber Link
Microsoft Says Outage Was Caused By Network Upgrade Issue, Apologises To Users
Waited For Your Outlook Emails? Microsoft Begins Restoring Services After 16-Hour Disruption
Microsoft Outlook Is Back, But There’s A Catch: Why Email Recovery Could Take Longer

Videos

Surat Fire News: Massive Blaze Erupts at Textile Warehouse, Goods Worth Lakhs Feared Damaged
J&K Weather News: Fresh Snowfall Covers Gulmarg, Bhaderwah & Kathua as Tourists Enjoy Winter Magic
Maharashtra Politics: Deputy CM Sunetra Pawar Meets Devendra Fadnavis Amid NCP Merger Buzz
Godhra Train Fire: Ex-Investigator Rakesh Asthana Calls Sabarmati Express Blaze a Planned Conspiracy
West UP Political Showdown: Yogi, Owaisi & Akash Anand Rally Ahead of 2027 Assembly Elections

Photo Gallery

25°C
New Delhi
Rain: 100mm
Humidity: 97%
Wind: WNW 47km/h
See Today's Weather
powered by
Accu Weather
Embed widget