Skip to content
local-ai

NVIDIA A100 80GB

NVIDIA · Server

A previous-generation data-centre accelerator with 80GB of HBM memory. Slower than the H100, but still highly capable and often more available or cheaper to rent, which keeps it common in professional and academic deployments.

Specifications

VRAM 80GB
Memory bandwidth 2039 GB/s
Power draw 400W
Type accelerator

A data-centre part, usually rented by the hour or bought for a server. Often cheaper to rent than an H100, which keeps it popular.

NVIDIA A100 80GB: common questions

What models can the NVIDIA A100 80GB run?
With 80GB of VRAM it can run models up to roughly 130B parameters at a 4-bit quantisation, or smaller models with more context. Use the hardware matrix for specifics; these figures are approximate.
How much power does the NVIDIA A100 80GB draw?
About 400W under load, so pair it with a power supply that has real headroom.

Strengths

  • 80GB of high-bandwidth HBM memory
  • Widely available to rent, often at lower cost than newer parts
  • Very well supported across serving and training software

Weaknesses

  • A generation behind the H100 on throughput
  • Data-centre power and cooling requirements
  • Not consumer hardware, so no realistic home use
See what models fit in 80GB →

Entry last verified 30 July 2026. Specifications and especially prices change; verify before buying.