Can Intel Arc A750 run Qwen 2.5 72B?
72B parameter LLM model on 8GB GDDR6
No — not enough VRAM
SpeedWill not load
QualityN/A
Intel GPUs lack CUDA. While Qwen 2.5 72B can technically run via llama.cpp/GGUF, the setup is more complex and less optimized than on NVIDIA hardware.
VRAM Requirements
Qwen 2.5 72B is a 72B parameter model. At full precision (FP16), it requires 144GB of VRAM. Your Intel Arc A750 only has 8GB — not enough even at maximum compression.
FP16 (Full Precision)144GB (need 136GB more)
Maximum quality, no quantization
Q8 (8-bit)72GB (need 64GB more)
Near-lossless, ~50% size reduction
Q4 (4-bit)42GB (need 34GB more)
Good quality, ~75% size reduction
Your GPU VRAM: 8GB GDDR6 at 512 GB/s bandwidth
Recommended system RAM: 32GB DDR5 (2x GPU VRAM minimum for model overflow)
Recommended system RAM: 32GB DDR5 (2x GPU VRAM minimum for model overflow)
Intel Arc A750 Specs
VRAM8GB GDDR6
Memory Bandwidth512 GB/s
TDP225W
CUDA CoresN/A
Street Price~$160
AI Rating1/10
Other GPUs That Run Qwen 2.5 72B
Other LLM Models on Intel Arc A750
About Qwen 2.5 72B
Top open LLM for reasoning. Similar requirements to Llama 70B.
Category: LLM · Parameters: 72B · CUDA required: No (runs via llama.cpp/GGUF)