Skip to content

InternLM 2.5 7B

Apache 2.0

Shanghai AI Lab · 7B · transformer-decoder

2024-07-03 1.0M context 7B params

Use Cases

chat code reasoning multilingual tools math

Quantization Options

QuantBitsVRAMQualityStatus
Q4_K_Mrec45.5 GBGood
Q8_089.0 GBExcellent
F161616.0 GBExcellent

About this model

InternLM 2.5 7B is Shanghai AI Lab's versatile open-source language model featuring strong reasoning, multilingual support, and tool-use capabilities. With a massive 1M token context window, it handles extremely long documents and complex multi-step tasks that most models of its size cannot. The model excels at mathematical reasoning, code generation, and function calling, making it a strong choice for agentic workflows. Its Apache 2.0 license and competitive benchmark scores position it as an excellent option for local deployment on consumer hardware.

Benchmarks

72.0
mmlu