# Offline policy-relative difficulty

Agents often claim a task is done while leaving the wrong database record. ThinkingBox turns deterministic checks of terminal database state into rewards and trains Qwen3.8-27B on tasks outside its benchmark: after 50 GRPO steps, average success rose from 51.70% to 60.78% and tasks passing all twenty attempts rose from 38 to 107, while tasks passing at least once fell from 453 to 446. The training pool was selected offline by policy-relative difficulty, and none of the 507 benchmark tasks were used for training.

Agents often claim a task is done while leaving the wrong database record. ThinkingBox turns deterministic checks of terminal database state into rewards and trains Qwen3.8-27B on tasks outside its benchmark: after 50 GRPO steps, average success rose from 51.70% to 60.78% and tasks passing all twenty attempts rose from 38 to 107, while tasks passing at least once fell from 453 to 446. The training pool was selected offline by policy-relative difficulty, and none of the 507 benchmark tasks were used for training.