Skip to content

Yi 1.5 6B

Apache 2.0

01.AI · 6B · transformer-decoder

2024-05-13 4K context 6B params

Use Cases

chat code reasoning multilingual math

Quantization Options

QuantBitsVRAMQualityStatus
Q4_K_Mrec45.0 GBGood
Q8_088.0 GBExcellent
F161614.0 GBExcellent

About this model

Yi 1.5 6B is the smallest model in 01.AI's Yi 1.5 series, designed for efficient local inference while maintaining strong multilingual and reasoning capabilities. It supports both English and Chinese with solid performance across general knowledge and coding tasks. At Q4 quantization, it fits easily on most consumer GPUs with 6 GB or more of VRAM, making it a practical choice for lightweight local deployments where speed and low resource usage are priorities.

Benchmarks

63.0
mmlu