8B LLM Starter Build
The smallest sensible desktop for running 7B and 8B class models well: a 16 GB graphics card, a fast 6 core CPU, 64 GB of system memory and a quick 2 TB drive.
Total of listed US prices$2,047.98
See the parts listAI PC build recipes
Six builds assembled from parts in this directory, from a one box mini PC setup to an 8 GPU rack server. Totals sum the US prices in our data, retailer listings and labeled estimates combined; every build is also priced per part, plainly.
70B Single GPU Inference Build
A 24 GB card is the classic way to run a 70B model on one GPU at INT4, or a 32B model at FP16. This build pairs the RTX 4090 with a strong CPU and Gen5 class storage.
Total of listed US prices$3,847.98
See the parts listDual GPU Training Build
Two RTX 5090 cards give 64 GB of combined VRAM for training runs and big inference jobs, with a 16 core CPU feeding them and a Gen5 drive for checkpoints.
Total of listed US prices$6,165.99
See the parts listBudget AI Mini PC Setup
One small box, nothing else to buy: the Mac mini M4 with 16 GB of unified memory runs 7B and 8B models quietly on a desk and sips power.
Total of listed US prices$599
See the parts listQuiet AI Workstation
A compact workstation with 36 GB of unified memory that runs 32B class models at INT4 without a fan roaring next to you: the Mac Studio M4 Max.
Total of listed US prices$1,999
See the parts listRack AI Server
Data center class inference and training: 8 GPU systems and EPYC powered nodes. These are sold on vendor quote, so the build is priced per part rather than totaled.
Total of listed US prices$688,740
See the parts list