← Back to GPUs
NVIDIA · RTX Pro
NVIDIA RTX 6000 Ada
$6500$6800 MSRP
The NVIDIA RTX 6000 Ada Generation is the flagship professional GPU with 48GB of GDDR6 ECC memory on the Ada Lovelace architecture. It runs 70B models at Q8 quantization entirely in VRAM with faster inference than any previous workstation card. NVLink support enables multi-GPU configurations for even larger models. This is the card for organizations running production AI inference locally.
Best ForProduction AI inference and professional visualization
VerdictThe most capable workstation GPU available — for those with the budget to match.
AI
10/10
Gaming
5/10
Specifications
VRAM48GB GDDR6 ECC
Memory Bandwidth960 GB/s
CUDA Cores18,176
Boost Clock2505 MHz
TDP300W
Power Connector1x 8-pin
Length267mm
Form FactorDual Slot
Release Year2023
AI Capabilities
Unrivaled48GB VRAM
Run 70B+ models, no compromises. The AI power user's dream.
Can run (Q4 quantized)
Llama 3.1 70BLlama 3.1 8BQwen 2.5 72BQwen 2.5 32BQwen 2.5 14BMistral 7BDeepSeek R1 70BFLUX.1 DevStable Diffusion XLStable Diffusion 3.5 LargeHunyuanVideoCogVideoX-5BMochi 1LTX VideoStable Video DiffusionWan Video 14BCodestral 22BQwen 2.5 Coder 32BLLaVA 1.6 34BAlphaFold 2ESMFold (ESM-2 15B)ESM-2 3BscGPTRFdiffusionFine-tune Llama 8BFine-tune Llama 70BTrain SDXL LoRATrain FLUX LoRA
Recommended system RAM for AI: 96GB+ (2x GPU VRAM for model overflow)
Performance Estimates
Estimated tokens/sec for LLM inference based on 960 GB/s memory bandwidth — not hardware benchmarks. Methodology · What is Q4/Q8?
Llama 3.1 70B70B
Q4~15-19 tok/sUsableLlama 3.1 8B8B
FP16~34-42 tok/sFastQwen 2.5 72B72B
Q4~14-18 tok/sSlowQwen 2.5 32B32B
Q8~18-22 tok/sUsableQwen 2.5 14B14B
FP16~19-24 tok/sUsableMistral 7B7B
FP16~39-48 tok/sFastDeepSeek R1 70B70B
Q4~15-19 tok/sUsableCodestral 22B22B
FP16~12-15 tok/sSlowQwen 2.5 Coder 32B32B
Q8~18-22 tok/sUsablePros
- +48GB ECC VRAM on Ada architecture
- +Runs 70B models at Q8
- +Multi-GPU NVLink support
Cons
- -Extremely expensive
- -Not designed for gaming
- -Workstation drivers only
aiworkstation