PrimordialPC

PC terms decoded · AI and work

What does 7B, 70B mean?

The number of parameters in an AI model, in billions. Bigger models are smarter but need more memory.

Why is it called that?

A 4-bit compressed model needs about 0.6GB of VRAM per billion parameters, so a 14B model fits on a 12GB card.

Decode any part name

Questions people ask

What does 7B, 70B mean?

The number of parameters in an AI model, in billions. Bigger models are smarter but need more memory.

Why is it called 7B, 70B?

A 4-bit compressed model needs about 0.6GB of VRAM per billion parameters, so a 14B model fits on a 12GB card.

Related