Leaderboard Submission: GPT-5.6 Terra (max) + Codex

[github-actions]

Promoted from #114 (author @alexgshaw, head 16149aa).
Trials are cloned into leaderboard-owned copies; the checks below ran against the cloned trials.

Maintainer comments /judge then /apply to recompute metrics with disqualified trajectories.

---

✅ Static Analysis [PASS]

9 checks passed

Check	Result
Valid source_filter	✅
Valid metadata	✅
timeout_multiplier default (None or 1.0)	✅
No agent timeout overrides	✅
No verifier timeout overrides	✅
No resource overrides	✅
Valid trial count (89 tasks × ≥5)	✅
Valid per-trial records	✅
Valid task digests	✅

Trial Summary

Result	Count
No error	433
AgentTimeoutError	12
Total	445

Submission Summary

Model [org]	Effort	Agent [org]	Date	Accuracy	± SE	Tokens	Cost
GPT-5.6 Terra [OpenAI]	max	Codex [OpenAI]	2026-07-11	78.65%	1.23%	902,641,810	$421.15

_{Ran on 16149aa. Errored trials count reward 0 in the metric computation.}

[alexgshaw]

/judge

[github-actions]

Harness cheating 🔴 [maintainer reviews - renders a submission invalid]

• e7fa1f4c · fix-code-vulnerability · judge verdict

Reward hacking 🟡 [submitter comments on any false positive - maintainer can uncheck and /apply]

• 05d9e506 · code-from-image · judge verdict
• 4678c751 · fix-code-vulnerability · judge verdict

Refusals ⚪ [for information - sometimes a cause of agent failure]

• none

No Trajectory ⚫ [infra error - no trajectory to judge]

• none

_{Ran on 0a2a493. 350 trajectories judged, 3 flagged. Judge job: Job. ✅ 1 disqualified trials applied at 51833ae.}

[alexgshaw]

/apply

[github-actions]

Applied Disqualifications on 1 trial(s)

Accuracy 78.65% (± 1.23%) → 78.43% (± 1.25%)

Submission Summary

Model [org]	Effort	Agent [org]	Date	Accuracy	± SE	Tokens	Cost
GPT-5.6 Terra [OpenAI]	max	Codex [OpenAI]	2026-07-11	78.43%	1.25%	902,641,810	$421.15

_{Ran on 51833ae. Submission json updated with disqualified_trials and updated metrics.}

[github-actions]

✅ Entry submitted to the leaderboard

Model [org]	Effort	Agent [org]	Accuracy	Tokens	Cost	PR	Hacks
GPT-5.6 Terra [OpenAI]	max	Codex [OpenAI]	78.4% ± 1.3%	902,641,810	$421.15	#115	-0.2%

_{Ran on d49e28f.}