Skip to content

Which Models Can You Run?

Every model in the catalog, ranked for your hardware. We auto-detect what you're on; pick manually if it's wrong.

Detecting your hardware…
Sort
Grades
114 of 114 models
ModelParamsMin VRAMStatus
Aya Expanse 32BCohere32B22.0 GBQ4_K_M
Aya Expanse 8BCohere8B6.5 GBQ4_K_M
Codestral 22BMistral AI22B14.7 GBQ4_K_M
Codestral Mamba 7BMistral AI7B6.9 GBQ4_K_M
Cogito 32BDeep Cogito32B21.5 GBQ4_K_M
Cogito 70BDeep Cogito70B43.0 GBQ4_K_M
Cogito 8BDeep Cogito8B7.5 GBQ4_K_M
Command A 111BCohere111B61.0 GBQ4_K_M
Command R 35BCohere35B22.5 GBQ4_K_M
Command R+ 104BCohere104B57.0 GBQ4_K_M
DeepSeek R1 1.5BDeepSeek1.5B3.0 GBQ8_0
DeepSeek R1 14BDeepSeek14B9.9 GBQ4_K_M
DeepSeek R1 32BDeepSeek32B20.7 GBQ4_K_M
DeepSeek R1 671BDeepSeek671B362.0 GBQ4_K_M
DeepSeek R1 70BDeepSeek70B43.5 GBQ4_K_M
DeepSeek R1 7BDeepSeek7B9.0 GBQ8_0
DeepSeek R1 8BDeepSeek8B7.5 GBQ4_K_M
DeepSeek V3DeepSeek671B362.0 GBQ4_K_M
DeepSeek V3-0324DeepSeek671B362.0 GBQ4_K_M
DeepSeek V3.2DeepSeek671B420.0 GBQ4_K_M
Devstral 2 123BMistral AI123B67.0 GBQ4_K_M
Devstral 24BMistral AI24B17.0 GBQ4_K_M
Dolphin Mixtral 8x7BCognitive Computations47B26.0 GBQ4_K_M
Dolphin 3 8BCognitive Computations8B6.0 GBQ4_K_M
Falcon 3 10BTII10B8.5 GBQ4_K_M
Falcon 3 7BTII7B6.8 GBQ4_K_M
Gemma 2 27BGoogle27B17.7 GBQ4_K_M
Gemma 2 2BGoogle2B4.0 GBQ8_0
Gemma 2 9BGoogle9B11.0 GBQ8_0
Gemma 3 12BGoogle12B10.5 GBQ4_K_M
Gemma 3 1BGoogle1B2.0 GBQ8_0
Gemma 3 27BGoogle27B20.0 GBQ4_K_M
Gemma 3 4BGoogle4B5.0 GBQ4_K_M
Gemma 3n E2BGoogle2B3.3 GBQ4_K_M
Gemma 3n E4BGoogle4B4.5 GBQ4_K_M
Gemma 4 26BGoogle26B20.0 GBQ4_K_M
Gemma 4 31BGoogle31B22.0 GBQ4_K_M
Gemma 4 E2BGoogle2B4.0 GBQ4_K_M
Gemma 4 E4BGoogle4B6.0 GBQ4_K_M
GLM-5Zhipu AI744B300.0 GBQ2_K
GLM-5.1Zhipu AI754B305.0 GBQ2_K
GLM-5.2Zhipu AI753B274.0 GBQ2_K
gpt-oss 120BOpenAI117B70.0 GBMXFP4
gpt-oss 20BOpenAI21B15.0 GBMXFP4
Granite 3.3 8BIBM8B10.0 GBQ8_0
InternLM 2.5 20BShanghai AI Lab20B12.0 GBQ4_K_M
InternLM 2.5 7BShanghai AI Lab7B5.5 GBQ4_K_M
Kimi K2.5Moonshot AI1040B390.0 GBQ2_K
Kimi K2.6Moonshot AI1000B360.0 GBQ2_K
Kimi K2.7 CodeMoonshot AI1000B359.0 GBQ2_K
Laguna XS 2.1Poolside33B22.0 GBQ4_K_M
Llama 3.1 405BMeta405B244.5 GBQ4_K_M
Llama 3.1 70BMeta70B43.5 GBQ4_K_M
Llama 3.1 8BMeta8B10.0 GBQ8_0
Llama 3.2 1BMeta1B3.0 GBQ8_0
Llama 3.2 3BMeta3B5.0 GBQ8_0
Llama 3.2 Vision 11BMeta11B8.5 GBQ4_K_M
Llama 3.2 Vision 90BMeta90B50.0 GBQ4_K_M
Llama 3.3 70BMeta70B43.5 GBQ4_K_M
Llama 4 MaverickMeta400B228.0 GBQ4_K_M
Llama 4 Scout (109B/17B active)Meta109B72.0 GBQ4_K_M
Magistral Small 24BMistral AI24B17.0 GBQ4_K_M
MiniMax M3MiniMax428B163.0 GBQ2_K
Mistral 7BMistral AI7B9.0 GBQ8_0
Mistral Large 2 123BMistral AI123B67.0 GBQ4_K_M
Mistral Nemo 12BMistral AI12B9.5 GBQ4_K_M
Mistral Small 3.1 24BMistral AI24B18.0 GBQ4_K_M
Mixtral 8x22BMistral AI141B86.0 GBQ4_K_M
Mixtral 8x7BMistral AI47B29.7 GBQ4_K_M
Nemotron 3 Nano 8BNVIDIA8B7.5 GBQ4_K_M
Nemotron Ultra 253BNVIDIA253B155.0 GBQ4_K_M
Nous Hermes 2 34BNous Research34B19.0 GBQ4_K_M
Nous Hermes 2 8BNous Research8B6.0 GBQ4_K_M
OpenChat 3.5 7BOpenChat7B6.9 GBQ4_K_M
Phi-3 Mini 3.8BMicrosoft3.8B5.8 GBQ8_0
Phi-4 14BMicrosoft14B9.9 GBQ4_K_M
Phi-4 Mini 3.8BMicrosoft3.8B4.5 GBQ4_K_M
Phi-4 Reasoning 14BMicrosoft14B11.0 GBQ4_K_M
Qwen 2.5 14BAlibaba14B9.9 GBQ4_K_M
Qwen 2.5 32BAlibaba32B20.7 GBQ4_K_M
Qwen 2.5 72BAlibaba72B44.7 GBQ4_K_M
Qwen 2.5 7BAlibaba7B9.0 GBQ8_0
Qwen 2.5 Coder 14BAlibaba14B12.0 GBQ4_K_M
Qwen 2.5 Coder 32BAlibaba32B23.0 GBQ4_K_M
Qwen 2.5 Coder 7BAlibaba7B9.0 GBQ8_0
Qwen 2.5 VL 72BAlibaba72B41.0 GBQ4_K_M
Qwen 2.5 VL 7BAlibaba7B7.0 GBQ4_K_M
Qwen 3 0.6BAlibaba0.6B2.5 GBQ4_K_M
Qwen 3 14BAlibaba14B12.0 GBQ4_K_M
Qwen 3 235B-A22BAlibaba235B138.0 GBQ4_K_M
Qwen 3 30B-A3B (MoE)Alibaba30B22.0 GBQ4_K_M
Qwen 3 32BAlibaba32B23.0 GBQ4_K_M
Qwen 3 4BAlibaba4B4.5 GBQ4_K_M
Qwen 3 8BAlibaba8B7.5 GBQ4_K_M
Qwen 3.5 0.8BAlibaba0.8B1.5 GBQ4_K_M
Qwen 3.5 122BAlibaba122B85.0 GBQ4_K_M
Qwen 3.5 27BAlibaba27B19.0 GBQ4_K_M
Qwen 3.5 2BAlibaba2B3.0 GBQ4_K_M
Qwen 3.5 35B A3BAlibaba35B12.0 GBQ4_K_M
Qwen 3.5 4BAlibaba4B4.5 GBQ4_K_M
Qwen 3.5 9BAlibaba9B7.5 GBQ4_K_M
Qwen 3.6 27BAlibaba27B20.0 GBQ4_K_M
Qwen 3.6 35B-A3BAlibaba35B27.0 GBQ4_K_M
QwQ 32BAlibaba32B21.5 GBQ4_K_M
SmolLM2 1.7BHugging Face1.7B2.7 GBQ8_0
StarCoder2 15BBigCode15B17.0 GBQ8_0
StarCoder2 3BBigCode3B3.5 GBQ4_K_M
StarCoder2 7BBigCode7B5.5 GBQ4_K_M
WizardCoder 33BMicrosoft33B22.0 GBQ4_K_M
WizardLM 2 7BMicrosoft7B6.9 GBQ4_K_M
Yi 1.5 34B01.AI34B21.0 GBQ4_K_M
Yi 1.5 6B01.AI6B5.0 GBQ4_K_M
Yi 1.5 9B01.AI9B6.5 GBQ4_K_M
Yi Coder 9B01.AI9B8.0 GBQ4_K_M
S · Runs great

Fast inference with plenty of VRAM headroom. Score 85+.

A · Runs well

Solid speed and headroom. Score 70–84.

B · Decent

Usable speed, moderate headroom. Score 55–69.

C · Tight fit

Limited headroom or sluggish speed. Score 40–54.

D · Barely runs

Slow tokens, very tight on VRAM. Score 20–39.

F · Too heavy

Won't load well or at all. Score 0–19.

Methodology: VRAM requirements come from each model's Ollama quantization manifests. Speed estimates are memory-bandwidth-bound (bandwidth ÷ model size) with a penalty when a model spills into CPU offload. Grades weigh speed, VRAM headroom, and model quality.