Skip to content

OpenChat 3.5 7B

Apache 2.0

OpenChat · 7B · transformer-decoder

2023-11-01 8K context 7B params

Use Cases

chat code reasoning multilingual

Quantization Options

QuantBitsVRAMQualityStatus
Q4_K_Mrec46.9 GBGood
Q8_089.9 GBExcellent
F161617.0 GBExcellent

About this model

OpenChat 3.5 7B is an open-source language model that achieves remarkable performance through a novel training approach called Conditioned Reinforcement Learning Fine-Tuning (C-RLFT). It delivers competitive results against models many times its size on reasoning and general knowledge benchmarks. Built on the Mistral 7B architecture, OpenChat 3.5 provides strong multilingual capabilities and instruction following quality, making it one of the most capable 7B-class models for local deployment on consumer hardware.

Benchmarks

66.0
mmlu