Recursive Environment Scaling for General Long-Horizon Agents
Abstract
Recursive Environment Scaling transforms benchmarks to increase difficulty while preserving objectives, improving both agent evaluation and supervised fine-tuning performance.
We study environment scaling as a way to increase agent-benchmark difficulty while holding core task objectives fixed. Our framework, Recursive Environment Scaling (RES), transforms existing benchmark environments while preserving their objectives and completion requirements. A proposer changes information access, resource relations, and execution dependencies; execution-grounded checks validate the resulting candidate, and accepted changes are inherited across rounds. This produces related environments for paired evaluation and training-trajectory collection. Experiments on 294 initial tasks from three benchmarks show lower task success for all six evaluation models, with decreases of 57.14--77.14 percentage points on Claw-Eval-Live. With equal trajectory counts and identical optimization settings, fine-tuning on RES trajectories outperforms original-trajectory SFT in all nine model--benchmark comparisons by 7.00--14.61 percentage points. Ablations identify recursive inheritance and dependency composition as important contributors to increased difficulty. Together, these results support environment scaling for both agent evaluation and training.
Community
Hi everyone! We introduce Recursive Environment Scaling (RES), a framework that makes existing agent environments more challenging while preserving their core task objectives.
RES recursively transforms information access, resource relations, and execution dependencies, with execution-grounded checks validating each candidate. Across six models and three benchmarks, RES consistently reduces task success. Beyond evaluation, fine-tuning on RES-generated trajectories outperforms original-trajectory SFT in all nine model–benchmark comparisons, with gains of 7.00–14.61 percentage points under matched trajectory counts and optimization settings.
Code will be released at: https://github.com/Glimmerxx/recursive-environment-scaling
We welcome feedback and discussion!
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- WEFT: Scaling Tool-Use Post-Training for General-Purpose Agents (2026)
- Terminal-Universe: Turning Agent Trajectories into Scalable Terminal Environments (2026)
- SkillHorizon: Constructing Long-Horizon Agent Tasks through Skill Composition (2026)
- BizBench: Unveiling Hidden Challenges in Deploying Long-Horizon Agents for Real-World Business (2026)
- CompoWorld: Compositional Environment Scaling for General Agents (2026)
- CoEvoke: Evoking Multi-Agent Collaboration for Trajectory Collection (2026)
- Cowork-Gym: Synthesizing Interactive Work Environments at Scale (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2610.16397 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper