Real frontier tasks expose capability gaps; a generator–critic loop
turns them into high-quality synthetic data; the trained model is
validated on real tasks — and the next round of evolution begins.
Ⅰ
Generator Agent
Strategy Update · Task Construction
A code agent running a continuous search over programs: it
directly modifies, executes, and debugs the data-synthesis code,
then refines its generation strategy from critic feedback. An
agent harness records motivation, results, and failure causes
each round, enabling long-horizon exploration.
Ⅱ
Critic Agent
Quality Evaluation · Constraint Checks
A two-level adversarial review. Basic constraints — trajectory
information, tool-use validity, format integrity — quickly remove
degraded outputs. Higher-level evaluation judges evidence,
contradiction, verifiability, and research depth: a fast proxy
for training value.
Ⅲ
Meta-Critic
Outcome-Calibrated Co-Evolution
Model variants trained on sampled pipelines are evaluated on
held-out real research tasks. The meta-critic compares the
critic's assessments with observed training outcomes —
distinguishing tasks that merely appear difficult from
those that genuinely improve capability.