Simulation and Synthetic Environments
Research question
Where should a system be tested when production is the wrong place to find out?
Working thesis
Agents should meet replayable synthetic environments before they meet consequences. Generated environments, traced rollouts, deterministic replay, and scored evidence turn agent testing into something repeatable — and the traces are themselves a dataset.
A thesis is the lab’s current position, not a result. What supports it is listed below; what remains unresolved is stated at the end of this page.
Publications
2 attributedApparatus
1 systemSystems attached to this program are what the lab builds to investigate the question. Maturity, evidence level, and current activity are recorded separately on each system — a system attached here is not thereby claimed to be production-ready.
Open questions
Published as open. These are the parts of the program the lab does not consider settled.
- 01
How closely must a synthetic environment match reality before its scores transfer?
- 02
What makes a rollout trace worth training on rather than merely worth reading?
- 03
How is determinism preserved once real tools enter the loop?