Skip to content

Qwen 2.5 Coder 32B

Apache 2.0

Alibaba · 32B · transformer-decoder

2024-11-12 131K context 32B params

Use Cases

chat code reasoning

Quantization Options

QuantBitsVRAMQualityStatus
Q4_K_Mrec423.0 GBGood
Q8_0839.0 GBExcellent
F161670.0 GBExcellent

About this model

Qwen 2.5 Coder 32B is the flagship of the Qwen 2.5 Coder series and one of the strongest open-source coding models available. It rivals GPT-4o on code generation benchmarks and supports 128K context for working with large codebases. At Q4 it needs about 23 GB VRAM — fits on a RTX 3090/5090 or Mac with 24 GB+ unified memory. The go-to choice for developers who want the best possible local coding assistant and have the hardware to support it.

Benchmarks

78.0
mmlu