NVIDIA GeForce RTX 3090
NVIDIA · Mid-range
A previous-generation card that remains one of the best value choices for local AI, thanks to 24GB of VRAM at used-market prices. Slower than current cards, but the 24GB is what matters most for fitting models.
Specifications
| VRAM | 24GB |
|---|---|
| Memory bandwidth | 936 GB/s |
| Power draw | 350W |
| Type | gpu |
Most attractive on the used market, where its 24GB often costs less than newer 16GB cards. Condition and warranty vary, so buy carefully.
NVIDIA GeForce RTX 3090: common questions
- What models can the NVIDIA GeForce RTX 3090 run?
- With 24GB of VRAM it can run models up to roughly 37B parameters at a 4-bit quantisation, or smaller models with more context. Use the hardware matrix for specifics; these figures are approximate.
- How much power does the NVIDIA GeForce RTX 3090 draw?
- About 350W under load, so pair it with a power supply that has real headroom.
Strengths
- 24GB of VRAM at often-lower used prices than newer 16GB cards
- Runs models up to around 32B at Q4, like the 4090
- Mature CUDA support across every engine
Weaknesses
- A previous generation, so slower than 40 and 50 series cards
- High power draw and heat under load
- Used-market condition and remaining lifespan are a gamble
Featured in builds
Entry last verified 30 July 2026. Specifications and especially prices change; verify before buying.