VRAM Fit Checker: Will It Run Your Model?

Pick an open model and a precision. The checker estimates the memory the weights need and lists every GPU, mini PC, workstation and server in our directory that can hold it.

How the estimate works: parameters x bytes per parameter x 1.2, where the extra 20 percent covers the KV cache and runtime overhead for a typical chat workload. Long contexts need more. Two free checks a day; after that, an email unlocks the checker for the rest of the day.

Your results land here: the memory needed, and the hardware in the directory that fits it, tightest fit first.

The reference table behind the checker

The same math, printed out for the models in the checker.

ModelParamsFP16 needsINT8 needsINT4 needsNote
Llama 3.1 8B8B19.2 GB9.6 GB4.8 GBDense model
Llama 3.1 70B70B168 GB84 GB42 GBDense model
Llama 3.1 405B405B972 GB486 GB243 GBDense model
Qwen 2.5 7B7B16.8 GB8.4 GB4.2 GBDense model
Qwen 2.5 32B32B76.8 GB38.4 GB19.2 GBDense model
Qwen 2.5 72B72B172.8 GB86.4 GB43.2 GBDense model
Mistral 7B7B16.8 GB8.4 GB4.2 GBDense model
Mixtral 8x7B46.7B112.08 GB56.04 GB28.02 GBMoE: all experts must fit in memory
DeepSeek V3671B1.61 TB805.2 GB402.6 GBMoE: 37B active per token, but all 671B of weights must fit
DeepSeek R1671B1.61 TB805.2 GB402.6 GBMoE: 37B active per token, but all 671B of weights must fit
FLUX.1 dev12B28.8 GB14.4 GB7.2 GBImage model: estimate covers the transformer, add room for the text encoders
SDXL3.5B8.4 GB4.2 GB2.1 GBImage model: small weights, activations grow with resolution