Note: This feature was first published on 8 May 2024.
Image Source: HardwareZone
NVIDIA has launched the latest update for its ChatRTX app and is now available for download it its website.
The new version comes with new features that were first shown at the NVIDIA GTC conference back in March, and these include advanced photo search capabilities, AI-powered speech recognition, and expanded compatibility with various large language models (LLMs).
For the uninitiated, ChatRTX is a ChatGPT-like app that runs locally on a machine (not the cloud) that is powered by an NVIDIA RTX graphics card. This allows users to harness their own data for AI apps without the concern of it being misused for training or to keep their confidential data secured.
At a special media preview at their Taipei office, NVIDIA showcased some of the new features. For one, ChatRTX has expanded its range of supported LLMs, including Google's latest, Gemma, and the new open-source model, ChatGLM3. The flexibility in allowing you to pick your choice of LLM is important, as different LLMs perform the same tasks differently and the results may not be what you are looking for.
NVIDIA also showed an example where ChatRTX allows you to build and train your own dataset based on text and images on your local machine. You can point it to a folder with documents such as plaintext, Word documents and PDFs, as well as images; and it will train itself on answering queries related to the dataset. It’s quite cool.
New photo support also enables you to easily search and interact locally with your own photo data without the need for complex metadata labeling, thanks to OpenAI’s Contrastive Language-Image Pre-training (CLIP). With ChatRTX, you can now speak with your own data too, with added support for Whisper, an AI automatic speech recognition system that now enables ChatRTX to understand verbal speech.
Here's a video that probably best show off ChatRTX's capabilities:
But that's not all. NVIDIA also showcased a couple of other RTX-powered AI apps, such NVIDIA ACE and Topaz Labs Photo:
The entry barrier to ChatRTX is relatively low hardware wise; you’ll need an NVIDIA RTX 30- or 40- series GPU, or the professional-grade Ampere and Ada GPUs. RTX 20-series GPUs are not supported, unfortunately.
NVIDIA says it will continue to improve on ChatRTX and currently has no firm date on a version 1.0 release.
NVIDIA ChatRTX is available for download here.
Our articles may contain affiliate links. If you buy through these links, we may earn a small commission.