Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.rllm-project.com/llms.txt

Use this file to discover all available pages before exploring further.

Read the full write-up

Notion blog post with full details
DeepScaleR is a 1.5B math reasoning model that achieves 43.1% Pass@1 on AIME, surpassing O1-Preview. It demonstrates that small models can match frontier-level performance when RL training is scaled effectively.

​
Results

ModelParametersAIME Pass@1
DeepScaleR1.5B43.1%
O1-PreviewUnknown42.0%

​
Approach

DeepScaleR iteratively scales Deepseek’s GRPO algorithm from 8K to 16K to 24K context length for thinking, trained on top of DeepSeek-R1-Distill-1.5B on math competition problems. See the cookbooks/math cookbook (single-turn math with \boxed{} answers) for the AgentFlow-based reproducer. Released: February 2025