NVIDIA Wants To Assist Gamers With Project G-Assist, An RTX Powered & Contextually Aware AI Assistant For All Your Gaming Needs

NVIDIA is rolling out a new personal RTX assistant designed specifically for gamers to help them in various circumstances known as Project G-Assist.

Some of you who have been reading us for the last couple of years might already know about Project G-Assist. First unveiled in 2017 as the GeForce GTX G-Assist, the tech was nothing more than a teaser however, it did tease us of a future where AI could be used to help gamers out. So today, we finally get to see G-Assist, but as a very different solution. It's not a physical device but rather an AI-based assistant that runs on your PC. Now I know that an RTX GPU-shaped USB would have looked cooler (it was available for a limited time) but Project G-Assist has a lot of use cases for gamers.

PC games offer vast universes to explore and intricate mechanics to master, which are challenging and time-consuming feats even for the most dedicated gamers. Project G-Assist aims to put game knowledge at players’ fingertips using generative AI.

Project G-Assist takes voice or text inputs from the player, along with contextual information from the game screen, and runs the data through AI vision models. These models enhance the contextual awareness and app-specific understanding of a large language model (LLM) linked to a game knowledge database, and then generates a tailored response delivered as text or speech.

via NVIDIA

The way this technology came to be was some cool guys at NVIDIA thought about how certain games have so much depth that it can become too overwhelming for beginners. Certain RPG, RTS and SIM mechanics in PC games are too intense with infinite skill tree permutations, labyrinthine questlines, and endings & rich and intricate gameplay systems. Games will multiple paths and endings often lead users to load the game segment again or start it again or they might miss a crucial sidequest that leads to story development or just unlocking a new character or item.

Right now, gamers can find the required information by heading to dedicated wiki/encyclopedia pages, searching hundreds of sources on the web, or diving into the endless forums that are managed by the community. So in one way, the data is already there but it's not often that easy to find the correct information that you are looking for.

That's where NVIDIA's Project G-Assist comes in. The RTX-powered AI Assistant will take input from the user (voice/text), the gameplay screen, and the game app itself. The input will then go through the AI Agent Framework that uses speech recognition, computer vision, and APIs that are run through an LLM which searches through the knowledge databases and is then run through a text-to-speech agent that provides gamer with the required information.

So the next time any gamer has trouble with a specific quest or anything in general with the game, gameplay mechanics, or story, you will have your assistant next to you. Furthermore, you can also use RTX assistant to get the best optimization guide based on user-fed information.

So let's say you are having trouble in an Unreal Engine game while running an RTX 4090 and 14900K CPU. Project G-Assist will go through the database and official data provided by NVIDIA and let users know that the issue stems from their CPU and they might have to use the "Intel Baseline Profile" for the best gaming experience on that specific chip. It can also tune the system itself when prompted by the user for optimal gaming performance.

Project G-Assist can configure the player’s gaming system for optimal performance and efficiency. It can provide insights into performance metrics, optimize graphics settings depending on the user’s hardware, apply a safe overclock, and even intelligently reduce power consumption while maintaining a performance target.

via NVIDIA

NVIDIA showcased a demo of Project G-Assist "RTX AI" Assistant running in ARK: Survival Ascend, asking it questions about the creature's items and objectives. It's a cool and easier way to help a gamer out and we look forward to the launch of the G-Assist technology so we can try it out ourselves.