Nvidia is offering users the opportunity to try out its new AI chatbot that runs natively on your PC called Chat with RTX.
Well, it is not a chatbot in the traditional sense like ChatGPT. It is more of an AI summarizer, as Chat with RTX does not come with its own knowledge base. The data you refer to must come from documents you provide. According to the company, its software supports multiple file formats, including .txt, .pdf, .doc, and .xml. The way it works is to upload a single file or an entire folder to the Chat with RTX library. You then ask questions related to the uploaded content or ask them to summarize the text in a large paragraph.
As TheVerge notes, the tool can help professionals analyze long documents. And since it runs locally on your PC, you can ask Chat with RTX to process sensitive data without worrying about potential leaks.
The software can also summarize YouTube videos. To do this, you will first need to change the Folder Path data set to the YouTube URL and then paste said clip URL into Chat with RTX. It will then transcribe the entire video for the app to use as a knowledge base. You can also paste YouTube playlist URLs. You can also list how many videos are in the playlist. In any case, the software will transcribe everything normally.
Rough around the edges
Please note that chat with RTX is far from perfect. As TheVerge says, “the app is a little clunky.”
He is reportedly quite good at summarizing documents as he “had no problems extracting all the key information.” However, it fails with YouTube videos. The publication uploaded one of its clips to Chat with RTX to transcribe it. After reading the summary, they discovered that it was a completely different video. Also, you don't understand the context. If you ask a follow-up question “based on the context of a previous question,” the AI won't know what you're talking about. Each message should be treated as a completely new one.
Requirements
The demo is free for everyone, although your computer must meet certain requirements. You must have a GeForce RTX Series 30 or higher graphics card with the latest Nvidia drivers, at least 8GB of VRAM, and Windows 10 or Windows 11 built-in.
TheVerge claims that Chat with RTX took about 30 minutes to finish installing on its PC that housed an Intel Core i9-14900K CPU and a GeForce RTX 4090 GPU. So even if you have a powerful machine, it will still take a while. The file size of the app is almost 40 GB and it will consume around 3 GB of RAM when activated.
We've reached out to Nvidia to ask if there are plans to expand support for RTX 20 series graphics cards and when the final version will be released (assuming there is one). This story will be updated later.
Until then, check out TechRadar's list of the best graphics cards for 2024.
