Skip to content

Dolphin Mixtral 8x7B

Apache 2.0

Cognitive Computations · 47B · mixture-of-experts

2024-01-20 33K context 47B params

Use Cases

chat code reasoning multilingual writing

Quantization Options

QuantBitsVRAMQualityStatus
Q4_K_Mrec426.0 GBGood
Q8_0849.0 GBExcellent
F161694.0 GBExcellent

About this model

Dolphin Mixtral 8x7B is an uncensored, instruction-tuned mixture-of-experts model built on Mistral's Mixtral architecture. With 47 billion total parameters and approximately 12 billion active per inference, it delivers strong performance across text generation, coding, and multilingual tasks without alignment restrictions. This model combines the powerful MoE architecture of Mixtral with Dolphin's uncensored training approach, making it a popular choice for researchers and developers who need high-quality outputs without content filtering. It requires significant VRAM but rewards users with excellent reasoning and creative writing capabilities.

Benchmarks

70.0
mmlu