Skip to content

WizardLM 2 7B

Apache 2.0

Microsoft · 7B · transformer-decoder

2024-04-15 33K context 7B params

Use Cases

chat code reasoning writing summary

Quantization Options

QuantBitsVRAMQualityStatus
Q4_K_Mrec46.9 GBGood
Q8_089.9 GBExcellent
F161617.0 GBExcellent

About this model

WizardLM 2 7B is Microsoft's instruction-tuned language model trained using the Evol-Instruct methodology, which progressively evolves training data to improve instruction following. It delivers strong performance across creative writing, code generation, and complex reasoning tasks for its size class. As the compact variant in the WizardLM 2 lineup, the 7B model offers an efficient option for local deployment on consumer hardware while maintaining competitive quality on benchmarks like MMLU and HumanEval.

Benchmarks

65.0
mmlu