PrimordialPC

AI GPU calculator: will my model fit, and rent or buy?

Check whether an AI model fits in GPU memory, how fast it runs, and whether renting cloud GPUs or buying H100, B300 or MI355X servers costs less.

Pick a model size such as 8B, 70B or 405B, the precision and context length, and see how many GPUs it needs, the expected tokens per second, and the cost to rent or buy over three years, including electricity. For local AI on a gaming PC, the builder shows which graphics cards run 7B to 32B models.

Open the ai gpu calculator

Questions people ask

How much VRAM do I need for a 70B model?

About 40GB at 4-bit, before context. That means two 24GB cards, a 32GB card plus offloading, or data centre GPUs.

Is it cheaper to rent or buy GPUs?

Renting wins for light or uneven use. Buying pays off when GPUs run busy most of the day for more than a year or two.

Related