Build an Ai Server for less than $1k and Run LLM's Locally FREE
Dylan The Technogizguy Dylan The Technogizguy
204 subscribers
3,141 views
100

 Published On Sep 6, 2024

In this Video:
I’m going to show you how to build a budget AI server for under $1200 that can be used for machine learning tasks and Ai Exploration/Training. Im also going to show you how to run large language models (LLMs) at home for free using LM Studio, a program that runs AI models locally, and can download AI models right from HuggingFace.. We'll walk through the components you need, like a Dell R730 server, Nvidia Tesla P40s, and Power. If you already have a powerful gaming PC or Apple Silicon Mac, you don't need the server

If you enjoy this video, Consider liking and subscribe for more tech tutorials, home lab setups, and self-hosting guides!



---------------------------------------------------------|
Links from the video:
LM Studio: http://tgzg.xyz/lmstudio
SaveMyServer(Refurb store where I buy servers from time to time): http://tgzg.xyz/savemyserver
CraftComputings Cloud Gaming Series:    • Cloud Gaming Server Build  

---------------------------------------------------------|
Connect with me:
{Coming Soon}

---------------------------------------------------------|
Music from the video:
End Song generated with Suno.Ai


---------------------------------------------------------|
Timestamps:
00:00 - Intro
00:49 - Parts and Cost
03:45 - Pulling the R730 Out
05:08 - Nvidia Tesla P40 Wiring and fan setup
07:37 - The Bootup
08:00 - Installing NVIDIA drivers
09:00 - Installing LM Studio
11:30 - Testing Models
13:45 - Looking at more Models
14:40 - Outro

show more

Share/Embed