8B LLM Starter Build
The smallest sensible desktop for running 7B and 8B class models well: a 16 GB graphics card, a fast 6 core CPU, 64 GB of system memory and a quick 2 TB drive.
See the parts listAI hardware directory
Every GPU, CPU, mini PC, server and part in this directory carries manufacturer specs, and every price we show names the maker or store that lists it. Find the card that fits your model, then find the store near you that sells parts.
Consumer cards from the directory with a US list price in the data, sorted by memory. VRAM decides which models you can run locally.
| GPU | VRAM | AI TOPS | TDP | US price |
|---|---|---|---|---|
| AMD Instinct MI350X | 288 GB | Not published | 1400 W | $39,999 (Estimate) |
| AMD Instinct MI355X | 288 GB | Not published | 1400 W | $42,999 (Estimate) |
| NVIDIA B300 SXM | 288 GB | Not published | 1400 W | $69,999 (Estimate) |
| NVIDIA GB300 NVL72 | 288 GB | Not published | 1400 W | $3,750,000 (Estimate) |
| AMD Instinct MI325X | 256 GB | Not published | 1000 W | $34,999 (Estimate) |
| AMD Instinct MI300X | 192 GB | Not published | 750 W | $29,999 (eBay) |
| NVIDIA B200 SXM | 192 GB | Not published | 1200 W | $54,999 (Estimate) |
| NVIDIA GB200 NVL72 | 192 GB | Not published | 1200 W | $3,000,000 (Estimate) |
| NVIDIA H200 NVL | 141 GB | Not published | 600 W | $39,999 (Estimate) |
| NVIDIA H200 SXM | 141 GB | Not published | 700 W | $42,999 (Estimate) |
Ready made parts lists assembled from the directory, each with its prices shown the honest way.
The smallest sensible desktop for running 7B and 8B class models well: a 16 GB graphics card, a fast 6 core CPU, 64 GB of system memory and a quick 2 TB drive.
See the parts listA 24 GB card is the classic way to run a 70B model on one GPU at INT4, or a 32B model at FP16. This build pairs the RTX 4090 with a strong CPU and Gen5 class storage.
See the parts listTwo RTX 5090 cards give 64 GB of combined VRAM for training runs and big inference jobs, with a 16 core CPU feeding them and a Gen5 drive for checkpoints.
See the parts listOne small box, nothing else to buy: the Mac mini M4 with 16 GB of unified memory runs 7B and 8B models quietly on a desk and sips power.
See the parts listA compact workstation with 36 GB of unified memory that runs 32B class models at INT4 without a fan roaring next to you: the Mac Studio M4 Max.
See the parts listData center class inference and training: 8 GPU systems and EPYC powered nodes. These are sold on vendor quote, so the build is priced per part rather than totaled.
See the parts listPick a model and a precision, and the checker works out the memory it needs and lists every GPU, mini PC and workstation in the directory that can hold it.
Run the free checker421 PC hardware stores, from national chains to single city shops, listed by state across the US, India, Australia and the UK.
Tell it the model you want to run and your budget, and BuildSmith assembles a parts list from this directory, checks VRAM fit, PSU size and case room, and finds the stores in your state. Join the waitlist for the launch note.
All 171 GPUs in the directory sorted into the seven VRAM tiers, with the cheapest way into each tier and the models that honestly fit there, from 8 GB quantization territory to the H200.
November 7, 2026All 171 GPUs in the directory lined up by memory, from 288 GB accelerators to 8 GB entry cards, and what each band is good for.
November 7, 2026Every GPU in the directory with 24 GB or more and a published US list price, ranked by price and by cost per gigabyte.
November 7, 2026The mini PCs in our directory that publish an NPU figure, ranked, with memory and list prices beside the headline number.
November 7, 2026Peak read figures from the spec sheets in our directory, what they mean for model loading and datasets, and when Gen4 is the smarter buy.
November 7, 2026Core counts, TDP and lineup shape for the two server CPU families in our directory, and what matters when the GPUs do the heavy lifting.