Skip to content

Yi 1.5 9B

Apache 2.0

01.AI · 9B · transformer-decoder

2024-05-13 4K context 9B params

Use Cases

chat code reasoning multilingual math

Quantization Options

QuantBitsVRAMQualityStatus
Q4_K_Mrec46.5 GBGood
Q8_0811.0 GBExcellent
F161620.0 GBExcellent

About this model

Yi 1.5 9B is the mid-range model in 01.AI's Yi 1.5 family, offering a strong balance of capability and efficiency. It delivers improved reasoning and multilingual performance over the 6B variant while remaining accessible on consumer hardware. With Q4 quantization requiring only around 6.5 GB of VRAM, it runs well on 8 GB GPUs and Apple Silicon Macs. A solid choice for users who want better quality than the 6B without jumping to the much larger 34B model.

Benchmarks

69.0
mmlu