Skip to content

Yi 1.5 34B

Apache 2.0

01.AI · 34B · transformer-decoder

2024-05-13 4K context 34B params

Use Cases

chat code reasoning multilingual math writing

Quantization Options

QuantBitsVRAMQualityStatus
Q4_K_Mrec421.0 GBGood
Q8_0836.0 GBExcellent
F161670.0 GBExcellent

About this model

Yi 1.5 34B is the flagship of 01.AI's Yi 1.5 series, delivering top-tier performance in reasoning, coding, math, and multilingual tasks. With an MMLU score of 76, it competes with much larger models while remaining feasible for local deployment on high-end consumer hardware. At Q4 quantization it requires around 21 GB of VRAM, fitting on a 24 GB GPU like the RTX 4090 or a 32 GB Apple Silicon Mac. For users with the hardware to support it, the 34B offers a significant quality leap over its smaller siblings.

Benchmarks

76.0
mmlu