Nvidia’s AI chatbot now supports Google’s Gemma model, voice queries, and more


Nvidia is updating its experimental ChatRTX chatbot with more AI models for RTX GPU owners. The chatbot, which runs locally on a Windows PC, can already use Mistral or Llama 2 to query personal documents that you feed into it, but now the list of supported AI models is growing to include Google’s Gemma, ChatGLM3, and even OpenAI’s CLIP model to make it easier to search your photos.
Nvidia first introduced ChatRTX as “Chat with RTX” in February as a demo app, and you’ll need an RTX 30- or 40-series GPU with 8GB of VRAM or more to be able to run it. The app essentially creates a local chatbot server that you can access from a browser and feed your local documents and even YouTube videos to get a powerful search tool complete with summaries and answers to questions on your own data.
Google’s Gemma model was designed to run directly on powerful laptops or desktop PCs, so its inclusion in ChatRTX is fitting. Nvidia’s app takes some of the complexity away of running these models locally, and the resulting chatbot interface lets you pick between models so you can find the one that fits best with your own data that you want to analyze or search through.
ChatRTX, available as a 36GB download from Nvidia’s website, also now supports ChatGLM3, an open bilingual (English and Chinese) large language model that’s based on the general language model framework. OpenAI’s Contrastive Language–Image Pre-training (CLIP) has also been added, which allows you to search and interact with local photo data and essentially train the model to recognize images.
Finally, Nvidia is also updating ChatRTX to support voice queries. Nvidia has integrated Whisper, an AI speech recognition system that lets you search your data using your voice.
Nvidia is updating its experimental ChatRTX chatbot with more AI models for RTX GPU owners. The chatbot, which runs locally on a Windows PC, can already use Mistral or Llama 2 to query personal documents that you feed into it, but now the list of supported AI models is growing…
Recent Posts
- Gabby Petito murder documentary sparks viewer backlash after it uses fake AI voiceover
- The quirky Alarmo clock is no longer exclusive to Nintendo’s online store
- The government is still threatening to ‘semi-fire’ workers who don’t answer an email from Elon Musk
- Sigma’s latest camera is so minimalist it doesn’t have a memory card slot
- Freedom of speech is ‘on the line’ in a pivotal Dakota Access Pipeline trial
Archives
- February 2025
- January 2025
- December 2024
- November 2024
- October 2024
- September 2024
- August 2024
- July 2024
- June 2024
- May 2024
- April 2024
- March 2024
- February 2024
- January 2024
- December 2023
- November 2023
- October 2023
- September 2023
- August 2023
- July 2023
- June 2023
- May 2023
- April 2023
- March 2023
- February 2023
- January 2023
- December 2022
- November 2022
- October 2022
- September 2022
- August 2022
- July 2022
- June 2022
- May 2022
- April 2022
- March 2022
- February 2022
- January 2022
- December 2021
- November 2021
- October 2021
- September 2021
- August 2021
- July 2021
- June 2021
- May 2021
- April 2021
- March 2021
- February 2021
- January 2021
- December 2020
- November 2020
- October 2020
- September 2020
- August 2020
- July 2020
- June 2020
- May 2020
- April 2020
- March 2020
- February 2020
- January 2020
- December 2019
- November 2019
- September 2018
- October 2017
- December 2011
- August 2010