Chat With RTX is a free chatbot released by Nvidia. This chatbot can be used as an AI chatbot, RAG with documents, and RAG with YouTube videos. In this video, I show how to install and use the chatbot. I also test its inference time, accuracy, and hallucination with both Mistral 7B and Llama2 13B parameter Large Language models (LLMs).

Link to download the chatbot: https://www.nvidia.com/en-us/ai-on-rt...

00:00 Intro to Chat with RTX
01:14 Installation guide
02:12 UI walk-through
03:08 Testing the AI chatbot (testing response accuracy, inference time, memory, and hallucination)
07:12 RAG with documents
11:10 RAG with Youtube videos

#rag #chatbot #nvidia #llm #openai #gpt #chatgpt