NVIDIA RTX A6000

The RTX A6000 is NVIDIA's professional Ampere workstation GPU with 48 GB of GDDR6 ECC memory and 768 GB/s bandwidth. In 2026, used prices around $2,500-3,500 make it a more affordable alternative to the RTX 6000 Ada for running large models, with the same 48 GB VRAM capacity but on the older Ampere architecture.

Quick verdict

The A6000 is the best value 48 GB GPU in 2026. It runs 70B models entirely in VRAM for half the price of the RTX 6000 Ada. The slower Ampere architecture means lower tok/s, but for capacity-sensitive workloads, it delivers.

Spec breakdown

• VRAM: 48 GB GDDR6 ECC
• Memory bandwidth: 768 GB/s (16 Gbps)
• TDP: 300 W
• Architecture: Ampere GA102
• CUDA cores: 10,752
• Tensor cores: 336 (3rd gen)

Real-world AI inference

Model	Tokens/sec	Source
Llama 3.3 70B Q4_K_M	~10 tok/s	r/LocalLLaMA
Qwen3-30B Q8_0	~14 tok/s	Community
Mistral Small 3 Q5_K_M	~22 tok/s	Community

Honest alternatives

• RTX 6000 Ada (~$5,800): Faster, newer, double the price
• Dual RTX 4090 (~$2,600): 48 GB total, faster inference
• RTX 3090 used (~$700): 24 GB - half the VRAM, quarter the price

What the community says

"Got two A6000s for my workstation - 96 GB total. Runs Mixtral 8x22B at Q4 without breaking a sweat. Best prosumer setup you can build."

• u/workstation-ai on r/LocalLLaMA, 89 upvotes