华硕和微星新款笔记本电脑亮相 Computex 2024，现已有超过 200 款 RTX AI PC 于市面发售

Project G-Assist is an RTX-powered AI assistant technology demo that provides context-aware help for PC games and apps.

PC games offer vast universes to explore and intricate mechanics to challenge even the most dedicated gamer. Project G-Assist aims to put game and system knowledge at players’ fingertips.

Project G-Assist takes voice or text inputs from the player, along with a snapshot of what’s in the game window. The snapshot is fed into AI vision models that provide context awareness and app-specific understanding for the Large Language Model (LLM), which is connected to a database of game knowledge such as a wiki. The output of the LLM is an insightful and personalized response—either text, or speech from the AI —based on what’s happening in-game.

NVIDIA partnered with Studio Wildcard to demo the technology with ARK: Survival Ascended. Project G-Assist can help answer questions about creatures, quests, items, lore, difficult to tackle bosses and more. And because Project G-Assist is context-aware, it personalizes its responses to the user’s playthrough.

Additionally, Project G-Assist can evaluate your system’s configuration and performance, and instantly tune it for an optimal experience. Apply NVIDIA app’s optimized game settings, based on extensive testing on thousands of hardware configurations; enable Performance Tuning to apply a safe GPU overclock; switch on NVIDIA Reflex to reduce system latency for more responsive gaming; plus so much more.

We envision AI assistants transforming the way we engage with our favorite games and apps. Imagine getting instant context-aware assistance with a complex creative workflow in a photo or video app. Or an AI coach analyzing your multiplayer replays, teaching you strategies to move up the ranks in competitive matches. Project G-Assist is a glimpse into that future.

Project G-Assist won’t play a game for you like we suggested in our prophetic 2017 April Fool’s video, but it can help you get more out of your favorite games, and find help for a troublesome boss. Takeout ordering, however… we could definitely add that to the roadmap.

For further details, check out our dedicated Project G-Assist article.

NVIDIA ACE technology for powering digital humans is now coming to RTX AI PCs and workstations with NVIDIA NIM — a collection of inference microservices that make it easier for developers to deploy language, speech, and animation applications

At Computex 2024, the debut of NIM for ACE will be featured in the Covert Protocol tech demo. Developed in collaboration with Inworld AI, the demo now showcases Audio2Face and NVIDIA Riva automatic speech recognition running locally on GeForce RTX AI PCs and laptops.

Additionally, leading developers are transforming character interactions by integrating ACE technology into real-time applications across gaming, customer service, digital influencers, and more. Below, you can check out videos from Perfect World’s Legends tech demo, OurPalm’s Code Z, and Aww Inc. For further details about each, head here.

NVIDIA is also integrating RTX AI acceleration into apps for creators, modders and video enthusiasts.

Last year, NVIDIA introduced RTX acceleration using TensorRT for one of the most popular Stable Diffusion user interfaces, Automatic1111. Starting this week, RTX will also accelerate the highly popular ComfyUI, delivering up to a 60% improvement in performance over the currently shipping version, and 7x faster performance compared to the MacBook Pro M3 Max.

NVIDIA RTX Video, the popular AI-powered super-resolution feature supported in the Google Chrome, Microsoft Edge and Mozilla Firefox browsers, is now available as an SDK to all developers, helping them natively integrate AI for upscaling, sharpening, compression artifact reduction and high-dynamic range (HDR) conversion.

Coming soon to video editing software Blackmagic Design’s DaVinci Resolve and Wondershare Filmora, RTX Video will enable video editors to upscale lower-quality video files to 4K, as well as convert standard dynamic range source files into HDR. Additionally, the free media player VLC media will soon add RTX Video HDR to its existing super-resolution capability.

NVIDIA RTX Remix is a modding platform for remastering classic DirectX 8 and DirectX 9 games with full ray tracing, NVIDIA DLSS 3.5 and physically accurate materials. RTX Remix consists of a runtime renderer, and an app called RTX Remix Toolkit that facilitates the modding of game assets and materials.

Since RTX Remix Toolkit launched earlier this year, 20,000 modders have experimented with using it to mod classic games, resulting in over 130 RTX remasters in development on the RTX Remix Showcase Discord.

Last year, NVIDIA made RTX Remix Runtime open source, allowing modders to expand game compatibility and advance rendering capabilities. This month, NVIDIA will make the RTX Remix Toolkit open source, allowing modders to streamline how assets are replaced and scenes are relit, increase supported file formats for RTX Remix’s asset ingestor, and bolster RTX Remix’s AI Texture Tools with new models.

In addition, NVIDIA is making the capabilities of RTX Remix Toolkit accessible via a REST application programming interface, allowing modders to livelink RTX Remix to digital content creation tools such as Blender, modding tools such as Hammer and generative AI apps such as ComfyUI. NVIDIA is also providing an SDK for RTX Remix Runtime to allow modders to deploy RTX Remix’s renderer into other applications and games beyond DirectX 8 and 9 classics.

With more of the RTX Remix platform being made open source, modders across the globe can build even more stunning RTX remasters. For further details about the update launching later this month, head here.

Microsoft and NVIDIA are collaborating to help developers bring new generative AI capabilities to their Windows native and web apps. The collaboration will provide application developers with easy application programming interface (API) access to GPU-accelerated small language models (SLMs) and retrieval-augmented generation (RAG) capabilities that run on-device powered by Windows Copilot Runtime.

SLMs provide tremendous possibilities for Windows developers including content summarization, content generation, and task automation. RAG capabilities augment SLMs by giving the AI model access to domain-specific information not well represented in the base models. RAG APIs enable developers to harness application-specific data sources and tune SLM behavior and capabilities to application needs.

These AI capabilities will be accelerated by NVIDIA RTX GPUs, as well as AI accelerators from other hardware vendors, providing end users with fast, responsive AI experiences across the breadth of the Windows ecosystem.  

The API will be released in developer preview later this year.

These new AI features, apps and experiences join our ever-growing list of AI advancements powered by GeForce RTX and NVIDIA RTX AI PCs. Be sure to check out our other Computex 2024 announcements to see how NVIDIA is advancing gaming and creating with AI and NVIDIA RTX technologies.