NVIDIA GeForce RTX 3060 12GB
NVIDIA · Budget
A budget favourite for getting into local AI. The 12GB variant offers more memory than several pricier cards, which makes it a sensible, affordable entry point for running small and mid-sized models.
Specifications
| VRAM | 12GB |
|---|---|
| Memory bandwidth | 360 GB/s |
| Power draw | 170W |
| Type | gpu |
Often available used at a modest price. Confirm you are getting the 12GB version, not the 8GB one, which is a meaningfully different card for this use.
Strengths
- 12GB is generous for the price and runs 7B to 8B models well
- Modest power draw and easy to cool
- A low-risk way to try local AI before committing to more expensive hardware
Weaknesses
- Lower memory bandwidth caps inference speed on larger models
- 12GB rules out bigger models except at low quantisations
- Slower than current-generation cards on compute-heavy work
Entry last verified 15 January 2026. Specifications and especially prices change; verify before buying.