Rack AI Server
Data center class inference and training: 8 GPU systems and EPYC powered nodes. These are sold on vendor quote, so the build is priced per part rather than totaled.
Parts list
| Part | Category | Key specs | US price in our data |
|---|---|---|---|
| NVIDIA DGX H100 System 8x H100 | Servers | 8 GB VRAM · 56 cores · 2048 GB RAM | $350,000 (Estimate) |
| Dell PowerEdge XE9680 8x H100 SXM | Servers | 8 GB VRAM · 64 cores · 512 GB RAM | $330,000 (Estimate) |
| AMD EPYC 9755 | CPUs | 128 cores · 5 W | $8,740 (Estimate) |
The total is the sum of the US prices listed in our dataset for these parts, nothing added and nothing estimated. Street prices move; check the stores before you buy.
Why these parts
At this level the buying process runs through vendor quotes and lead times, not list prices. The parts below are the systems and processors in our directory that anchor a rack deployment; use the retailer directory to find server specialists in your state.
Not sure which size of build you need? Run the VRAM Fit Checker with your model and precision, then come back to the parts list that matches. Store options are in the retailer directory by state.
Supporting parts in the directory
These boards, power, case and cooling picks complete the build. Our dataset does not carry US list prices for them yet, so they are not in the total. ASRock Rack GENOA2D24G-2L EPYC Server · ASRock Rack ROMED8-2T Server EPYC