PC terms decoded · AI and work
What does 7B, 70B mean?
The number of parameters in an AI model, in billions. Bigger models are smarter but need more memory.
Why is it called that?
Decode any part nameA 4-bit compressed model needs about 0.6GB of VRAM per billion parameters, so a 14B model fits on a 12GB card.
Questions people ask
What does 7B, 70B mean?
The number of parameters in an AI model, in billions. Bigger models are smarter but need more memory.
Why is it called 7B, 70B?
A 4-bit compressed model needs about 0.6GB of VRAM per billion parameters, so a 14B model fits on a 12GB card.