Can AMD Radeon RX 7700 XT run Qwen 2.5 72B?
72B parameter LLM model on 12GB GDDR6
No — not enough VRAM
SpeedWill not load
QualityN/A
AMD GPUs lack CUDA. While Qwen 2.5 72B can technically run via llama.cpp/GGUF, the setup is more complex and less optimized than on NVIDIA hardware.
VRAM Requirements
Qwen 2.5 72B is a 72B parameter model. At full precision (FP16), it requires 144GB of VRAM. Your AMD Radeon RX 7700 XT only has 12GB — not enough even at maximum compression.
FP16 (Full Precision)144GB (need 132GB more)
Maximum quality, no quantization
Q8 (8-bit)72GB (need 60GB more)
Near-lossless, ~50% size reduction
Q4 (4-bit)42GB (need 30GB more)
Good quality, ~75% size reduction
Your GPU VRAM: 12GB GDDR6 at 432 GB/s bandwidth
Recommended system RAM: 32GB DDR5 (2x GPU VRAM minimum for model overflow)
Recommended system RAM: 32GB DDR5 (2x GPU VRAM minimum for model overflow)
AMD Radeon RX 7700 XT Specs
VRAM12GB GDDR6
Memory Bandwidth432 GB/s
TDP245W
CUDA CoresN/A
Street Price~$380
AI Rating2/10
Other GPUs That Run Qwen 2.5 72B
Other LLM Models on AMD Radeon RX 7700 XT
About Qwen 2.5 72B
Top open LLM for reasoning. Similar requirements to Llama 70B.
Category: LLM · Parameters: 72B · CUDA required: No (runs via llama.cpp/GGUF)