Skip to content

BigCode · 3B · transformer-decoder

2024-02-28 16K context 3B params

Use Cases

code chat

Quantization Options

QuantBitsVRAMQualityStatus
Q4_K_Mrec43.5 GBGood
Q8_085.0 GBExcellent
F16168.0 GBExcellent

About this model

StarCoder2 3B is the smallest model in the BigCode StarCoder2 family, trained on The Stack v2 dataset covering over 600 programming languages. Despite its compact size, it delivers surprisingly capable code generation and completion, making it ideal for resource-constrained environments. The model supports 16K context and fill-in-the-middle capabilities for IDE-style code completion. Its small footprint means it can run on virtually any modern GPU, providing fast inference for everyday coding tasks without requiring significant hardware investment.

Benchmarks

35.0
mmlu