NVIDIA GeForce RTX 3060 12GB
NVIDIA · Budget
A budget favourite for getting into local AI. The 12GB variant offers more memory than several pricier cards, which makes it a sensible, affordable entry point for running small and mid-sized models.
Specifications
| VRAM | 12GB |
|---|---|
| Memory bandwidth | 360 GB/s |
| Power draw | 170W |
| Type | gpu |
Often available used at a modest price. Confirm you are getting the 12GB version, not the 8GB one, which is a meaningfully different card for this use.
NVIDIA GeForce RTX 3060 12GB: common questions
- What models can the NVIDIA GeForce RTX 3060 12GB run?
- With 12GB of VRAM it can run models up to roughly 17B parameters at a 4-bit quantisation, or smaller models with more context. Use the hardware matrix for specifics; these figures are approximate.
- How much power does the NVIDIA GeForce RTX 3060 12GB draw?
- About 170W under load, so pair it with a power supply that has real headroom.
Strengths
- 12GB is generous for the price and runs 7B to 8B models well
- Modest power draw and easy to cool
- A low-risk way to try local AI before committing to more expensive hardware
Weaknesses
- Lower memory bandwidth caps inference speed on larger models
- 12GB rules out bigger models except at low quantisations
- Slower than current-generation cards on compute-heavy work
Entry last verified 30 July 2026. Specifications and especially prices change; verify before buying.