UPDATED Easy Setup Guide with NO DOCKER NEEDED    • Ollama Local AI Server ULTIMATE Setup Guid...  
I'm learning and sharing my Home Server Ai quest in realtime. This video is a step-by-step, how to guide focusing on installing a complete self-hosted Ollama on WebUI powerhouse. I also show you how to install docker and nvidia container toolkit as well as downloading and running some tests on the 8b and 70b meta llama 3.1 new hotness. These models are great! This Homelab mega Ai server is built to help me in understanding and deploying the most cutting edge self hosted LLM Ai tools.

We start by installing ubuntu and docker with Nvidia Container Toolkit. Then we setup WebUI and Ollama. Next I show you how to download your first models and load them into the client. Finally I showcase some of the speed of llama3.1 70b model. This tutorial builds off our quad 3090 GPU rig we built in the last video.

Open WebUI powered Ollama running LLAMA 3.1 70b in Docker on Ubuntu 22.04

Local Ai Rig Quad 3090s    • INSANE Ollama AI Home Server - Quad 3090 H...  
Written piece and GPU Rack Modification Instructions
digitalspaceport.com/ollama-gpu-3090-home-server-q…

AI Playlist    • AI Rigs, Testing, Reviews, Use Cases and C...…

LOCAL AI QUAD 3090 SERVER    • INSANE Ollama AI Home Server - Quad 3090 H...  
GPU Rack Frame geni.us/GPU_Rack_Frame
Supermicro H12ssl-i MOBO (better option vs mz32-ar0) geni.us/MBD_H12SSL-I-O
Gigabyte MZ32-AR0 MOBO geni.us/mz32-ar0_motherboard
AMD 7V13 (newer, faster vs 7702) geni.us/EPYC_7V13_CPU
RTX 3090 24GB GPU (x4) geni.us/GPU3090
256GB (8x32GB) DDR4 2400 RAM geni.us/256GB_DDR4_RAM
PCIe4 Risers (x4) geni.us/PCIe4_Riser_Cable
AMD SP3 Air Cooler (easier vs water cooler) geni.us/EPYC_SP3_COOLER
iCUE H170i water cooler geni.us/iCUE_H170i_Capellix
(sTRX4 fits SP3 and retention kit comes with the CAPELLIX)
CORSAIR HX1500i PSU geni.us/Corsair_HX1500iPSU
4i SFF-8654 to 4i SFF-8654 (x4, not needed for H12SSL-i) geni.us/SFF8654_to_SFF8654
ARCTIC MX4 Thermal Paste geni.us/Arctic_ThermalPaste
Kritical Thermal GPU Pads geni.us/Kritical-Thermal-Pads
HDD Rack Screws for Fans geni.us/HDD_RackScrews

Be sure to 👍✅Subscribe✅👍 for more content like this!

Join this channel youtube.com/channel/UCiaQzXI5528Il6r2NNkrkJA/join

Digital Spaceport Website digitalspaceport.com/

Patreon www.patreon.com/digitalspaceport
Buy Me a Coffee buymeacoffee.com/digitalspaceport

Please share this video to help spread the word and drop a comment below with your thoughts or questions. Thanks for watching!

Chapters
0:00 Ollama Server Setup Guide
0:30 Quad GPU Ai Rig Updates
1:40 Setup Ubuntu 22.04 Desktop for Nvidia
10:05 Installing Docker Nvidia Toolkit
11:33 Open WebUI and Ollama Setup
14:24 How To install LLAMA 3.1 70b
18:52 LLAMA 3.1 405b
20:59 LLAMA 3.1 8b
22:48 LLAMA 3.1 Stats
24:32 The Ultimate Ollama Setup Guide for Noobs


*****
As an Amazon Associate I earn from qualifying purchases.

When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network.
***