Yi 1.5 34B
Apache 2.001.AI · 34B · transformer-decoder
2024-05-13 4K context
34B params
Use Cases
chat code reasoning multilingual math writing
Quantization Options
About this model
Yi 1.5 34B is the flagship of 01.AI's Yi 1.5 series, delivering top-tier performance in reasoning, coding, math, and multilingual tasks. With an MMLU score of 76, it competes with much larger models while remaining feasible for local deployment on high-end consumer hardware.
At Q4 quantization it requires around 21 GB of VRAM, fitting on a 24 GB GPU like the RTX 4090 or a 32 GB Apple Silicon Mac. For users with the hardware to support it, the 34B offers a significant quality leap over its smaller siblings.
Benchmarks
76.0
mmlu