Nvidia’s new app lets you run an AI chatbot on your RTX-powered PC
Nvidia is offering users the opportunity to try out their new AI chatbot that runs natively on your PC, called Chat with RTX.
Well, it’s not a chatbot in the traditional sense of the word ChatGPT. It’s more of an AI summary Chat with RTX does not have its own knowledge base. The data referred to must come from documents you provide. According to the company, their software supports multiple file formats, including .txt, .pdf, .doc, and .xml. The way it works is that you upload a single file or an entire folder to Chat with RTX’s library. Then ask questions about the uploaded content or have the text summarized in a paragraph format.
If The edge points out that the tool can help professionals analyze long documents. And because it runs locally on your PC, you can ask Chat with RTX to process sensitive data without worrying about potential leaks.
The software can also summarize YouTube videos. To do this, you first need to change the dataset from Mappad to YouTube URL and then paste the said URL of the clip into Chat with RTX. Then the entire video is transcribed so that the app can use it as a knowledge base. YouTube playlist URLs can also be pasted. You can also indicate how many videos are in the playlist. Either way, the software will transcribe everything as normal.
Rough around the edges
Keep in mind that chatting with RTX is far from perfect. As TheVerge puts it, “the app is a bit rough around the edges.”
It is reportedly quite good at summarizing documents, as it “had no problem extracting all the important information.” However, it glitches with YouTube videos. The publication uploaded one of their clips for Chat with RTX to transcribe. After going through the summary, they discovered that it was a completely different video. Moreover, it does not understand the context. If you ask a follow-up question “based on the context of a previous question,” the AI won’t know what you’re talking about. Each prompt should be treated as a completely new one.
Requirements
The demo is free for everyone to try, although your computer must meet certain requirements. It requires a GeForce RTX 30 series or higher graphics card running the latest Nvidia drivers, at least 8 GB of VRAM and Windows 10 or Windows 11 on board.
TheVerge claims that Chat with RTX took about 30 minutes to complete the installation on their PC, which featured an Intel Core i9-14900K CPU and a GeForce RTX 4090 GPU. So even if you have a powerful machine, it will still take a while. The file size for the app is almost 40 GB and will eat up about 3 GB of RAM upon activation.
We reached out to Nvidia to ask if there are any plans to expand support for the RTX 20 series graphics cards and when the final version will launch (assuming it does). This story will be updated at a later date.
Until then, check out Ny Breaking’s list of the best graphics cards for 2024.