Can NVIDIA GeForce RTX 4060 run Qwen 2.5 72B?
72B parameter LLM model on 8GB GDDR6
No — not enough VRAM
SpeedWill not load
QualityN/A
VRAM Requirements
Qwen 2.5 72B is a 72B parameter model. At full precision (FP16), it requires 144GB of VRAM. Your NVIDIA GeForce RTX 4060 only has 8GB — not enough even at maximum compression.
FP16 (Full Precision)144GB (need 136GB more)
Maximum quality, no quantization
Q8 (8-bit)72GB (need 64GB more)
Near-lossless, ~50% size reduction
Q4 (4-bit)42GB (need 34GB more)
Good quality, ~75% size reduction
Your GPU VRAM: 8GB GDDR6 at 272 GB/s bandwidth
Recommended system RAM: 32GB DDR5 (2x GPU VRAM minimum for model overflow)
Recommended system RAM: 32GB DDR5 (2x GPU VRAM minimum for model overflow)
NVIDIA GeForce RTX 4060 Specs
VRAM8GB GDDR6
Memory Bandwidth272 GB/s
TDP115W
CUDA Cores3,072
Street Price~$280
AI Rating3/10
Other GPUs That Run Qwen 2.5 72B
Other LLM Models on NVIDIA GeForce RTX 4060
About Qwen 2.5 72B
Top open LLM for reasoning. Similar requirements to Llama 70B.
Category: LLM · Parameters: 72B · CUDA required: No (runs via llama.cpp/GGUF)