What We Know About Google DeepMind’s Newest AI Agent’s Ability to Play 3D Games

Google DeepMind has introduced its AI-based virtual gaming partner, SIMA, which can play multiple 3D games like a human and respond to instructions. This innovative model is designed to understand and act based on the gamer’s instructions, allowing it to play like professional gamers by responding to instructions and performing tasks accordingly.

The AI agent’s capabilities extend beyond linear games, enabling it to operate in open-world settings and follow specific paths or stories.

THE VIRTUAL GAMING PARTNER, GOOGLE DEEPMIND

SIMA, a ‘Scalable, Instructable, Multiworld Agent’, has been trained on various video games and effectively performs tasks using natural language commands and image recognition in the 3D gaming world.

Google has partnered with game developers to train SIMA on various video games, including No Man’s Sky, Teardown, Valheim, and Goat Simulator 2, and has translated advanced AI models’ capabilities into real-world actions using a language interface.

SIMA is an AI agent capable of recognizing and understanding various environments, taking actions to achieve a goal. It uses a precise image-language mapping model and a video model to predict on-screen events. The agent doesn’t require access to game source code or APIs, but simply requires user-provided images and simple instructions.

SIMA, a virtual environment management system, utilizes keyboard and mouse outputs to control the game’s central character, allowing users to interact with any virtual environment.

DeepMind’s SIMA AI agent is currently evaluated across 600 basic skills, including navigation, object interaction, and menu use. DeepMind researcher Tim Harley stated that future agents will be trained to handle high-level strategic planning and multiple sub-tasks, aiming to improve the AI’s performance in gaming.

General News Platform – https://ihtlive.com/
Entertainment News Platforms – anyflix.in
Construction Infrastructure and Mining News Platform – https://cimreviews.com/
Podcast Platforms – https://anyfm.in