Skip to content

Intel Arc A750

Intel · 8GBGDDR6 · Can run 57 models

BuyAmazon
ManufacturerIntel
VRAM8 GB
Memory TypeGDDR6
ArchitectureAlchemist
Bandwidth512 GB/s
TDP225W
MSRP$289
ReleasedOct 12, 2022

AI Notes

The Intel Arc A750 provides 8GB of GDDR6 VRAM at a low price point. With only 8GB, it is limited to 7B-parameter models with quantization. Intel GPU support in AI inference frameworks is still maturing, so users should expect a less polished experience compared to NVIDIA or AMD cards.

Compatible Models

ModelParametersBest QuantVRAM UsedFitEst. Speed
Qwen 3 0.6B600MQ4_K_M2.5 GBRuns~205 tok/s
Qwen 3.5 0.8B800MQ4_K_M1.5 GBRuns~341 tok/s
Gemma 3 1B1BQ8_02 GBRuns~256 tok/s
Llama 3.2 1B1BQ8_03 GBRuns~171 tok/s
DeepSeek R1 1.5B1.5BQ8_03 GBRuns~171 tok/s
SmolLM2 1.7B1.7BQ8_02.7 GBRuns~190 tok/s
Gemma 2 2B2BQ8_04 GBRuns~128 tok/s
Gemma 3n E2B2BQ4_K_M3.3 GBRuns~155 tok/s
Gemma 4 E2B2BQ4_K_M4 GBRuns~128 tok/s
Qwen 3.5 2B2BQ4_K_M3 GBRuns~171 tok/s
Llama 3.2 3B3BQ8_05 GBRuns~102 tok/s
StarCoder2 3B3BQ4_K_M3.5 GBRuns~146 tok/s
Phi-3 Mini 3.8B3.8BQ8_05.8 GBRuns~88 tok/s
Phi-4 Mini 3.8B3.8BQ4_K_M4.5 GBRuns~114 tok/s
Gemma 3 4B4BQ4_K_M5 GBRuns~102 tok/s
Gemma 3n E4B4BQ4_K_M4.5 GBRuns~114 tok/s
Gemma 4 E4B4BQ4_K_M6 GBRuns~85 tok/s
Qwen 3 4B4BQ4_K_M4.5 GBRuns~114 tok/s
Qwen 3.5 4B4BQ4_K_M4.5 GBRuns~114 tok/s
Yi 1.5 6B6BQ4_K_M5 GBRuns~102 tok/s
Falcon 3 7B7BQ4_K_M6.8 GBRuns~75 tok/s
InternLM 2.5 7B7BQ4_K_M5.5 GBRuns~93 tok/s
StarCoder2 7B7BQ4_K_M5.5 GBRuns~93 tok/s
Aya Expanse 8B8BQ4_K_M6.5 GBRuns~79 tok/s
Dolphin 3 8B8BQ4_K_M6 GBRuns~85 tok/s
Nous Hermes 2 8B8BQ4_K_M6 GBRuns~85 tok/s
Yi 1.5 9B9BQ4_K_M6.5 GBRuns~79 tok/s
Codestral Mamba 7B7BQ4_K_M6.9 GBRuns (tight)~74 tok/s
OpenChat 3.5 7B7BQ4_K_M6.9 GBRuns (tight)~74 tok/s
Qwen 2.5 VL 7B7BQ4_K_M7 GBRuns (tight)~73 tok/s
WizardLM 2 7B7BQ4_K_M6.9 GBRuns (tight)~74 tok/s
Cogito 8B8BQ4_K_M7.5 GBRuns (tight)~68 tok/s
DeepSeek R1 8B8BQ4_K_M7.5 GBRuns (tight)~68 tok/s
Nemotron 3 Nano 8B8BQ4_K_M7.5 GBRuns (tight)~68 tok/s
Qwen 3 8B8BQ4_K_M7.5 GBRuns (tight)~68 tok/s
Qwen 3.5 9B9BQ4_K_M7.5 GBRuns (tight)~68 tok/s
DeepSeek R1 7B7BQ8_09 GBCPU Offload~17 tok/s
Mistral 7B7BQ8_09 GBCPU Offload~17 tok/s
Qwen 2.5 7B7BQ8_09 GBCPU Offload~17 tok/s
Qwen 2.5 Coder 7B7BQ8_09 GBCPU Offload~17 tok/s
Granite 3.3 8B8BQ8_010 GBCPU Offload~15 tok/s
Llama 3.1 8B8BQ8_010 GBCPU Offload~15 tok/s
Gemma 2 9B9BQ8_011 GBCPU Offload~14 tok/s
Yi Coder 9B9BQ4_K_M8 GBCPU Offload~19 tok/s
Falcon 3 10B10BQ4_K_M8.5 GBCPU Offload~18 tok/s
Llama 3.2 Vision 11B11BQ4_K_M8.5 GBCPU Offload~18 tok/s
Gemma 3 12B12BQ4_K_M10.5 GBCPU Offload~15 tok/s
Mistral Nemo 12B12BQ4_K_M9.5 GBCPU Offload~16 tok/s
DeepSeek R1 14B14BQ4_K_M9.9 GBCPU Offload~16 tok/s
Phi-4 14B14BQ4_K_M9.9 GBCPU Offload~16 tok/s
Phi-4 Reasoning 14B14BQ4_K_M11 GBCPU Offload~14 tok/s
Qwen 2.5 14B14BQ4_K_M9.9 GBCPU Offload~16 tok/s
Qwen 2.5 Coder 14B14BQ4_K_M12 GBCPU Offload~13 tok/s
Qwen 3 14B14BQ4_K_M12 GBCPU Offload~13 tok/s
StarCoder2 15B15BQ4_K_M10.5 GBCPU Offload~15 tok/s
InternLM 2.5 20B20BQ4_K_M12 GBCPU Offload~13 tok/s
Qwen 3.5 35B A3B35BQ4_K_M12 GBCPU Offload~13 tok/s
57 model(s) are too large for this hardware.