Skip to content

Codestral Mamba 7B

Apache 2.0

Mistral AI · 7B · mamba

2024-07-16 262K context 7B params

Use Cases

code chat

Quantization Options

QuantBitsVRAMQualityStatus
Q4_K_Mrec46.9 GBGood
Q8_089.9 GBExcellent
F161617.0 GBExcellent

About this model

Codestral Mamba 7B is Mistral AI's code generation model built on the Mamba state-space architecture instead of the traditional transformer. The Mamba architecture enables linear-time inference, making it exceptionally fast for code completion and generation tasks with theoretically unlimited context length. Unlike transformer-based models that slow down quadratically with longer inputs, Codestral Mamba maintains consistent speed regardless of sequence length. This makes it ideal for processing large codebases and long files where low latency is critical for developer productivity.