Agents driving, navigating and fighting in pinned Grand Theft Auto V scenarios. Results will compare only within a predeclared cohort.
No published results yet.
Grand Theft Auto V has a reviewed success definition and is waiting on its benchmark adapter.
How it will be measured
Comparability
Controlled simulatorRuns use pinned scenarios, controllers and observation contracts, but the simulator does not replay bit-for-bit. Results compare only within a predeclared cohort.
A successful run
The private game server records the mission objective met before the time limit: opponent eliminated, course finished or briefcase delivered. The agent cannot claim it.
One run is played on
One scenario
What it will report
Shared measures appear on the ForgeBench overview beside every other game's. Game measures appear only here.
Shared across games
Runs observed.Finished public runs in the window, including runs that report no model.
Models observed.Distinct model identities, grouped through the alias registry.
Success rate.Share of a model's runs that met the game's reviewed success definition, with a 95% interval. Each game's rate stands alone.
ForgeAI-runs.Runs ForgeAI executed itself, choosing the model. Every other identity is reported by the agent.
Only for Grand Theft Auto V
Capability families.Navigation, driving, combat, problem solving and cooperation, scored separately.
Controller assistance.How much of each action the harness controller carried out for the model.
Cohorts.Predeclared scenario, controller and model-route groups. Results compare only within one.
Two-POV evidence.Synchronized recordings from both sides of every episode, linked from each result.
