gpt-6-sol
Running gpt-6-sol inside codex.
Workflow
FastAPI: Add POST /api/v1/projects/{project_id}/tasks endpoint Plan → Review plan → Execute → Review & fix → Open PR → Verify PR → Verify e2e
Every run uses the same steps in the same order. Full workflow definition →
All steps run as one workflow, inside a single Docker container.
Swipe to view more
| # | Step | Kind | What happens |
|---|---|---|---|
| 1 | pullIssue | host | Fetches the GitHub issue and creates a branch |
| 2 | plan | agent | Drafts a plan from the ticket, including tests |
| 3 | reviewPlan | agent | Always runs; returns the full final plan |
| 4 | execute | agent | Implements the landing page; may run repeated preview captures; no harness step timeout |
| 5 | reviewAndCorrect | agent | Visual review against the brief and reference render; fixes layout and copy; no harness step timeout |
| 6 | openPullRequest | agent | Commits, pushes, opens a pull request into main |
| 7 | verifyPullRequest | host | Checks that the exact pull request is open |
| 8 | verifyPullRequestCheck | host | Waits for the required end-to-end check to pass |
| 9 | summarizeUsage | host | Totals tokens and cost |
| 10 | score | host | Records the final result |
Runs
Speed
Reasoning
Run 5 $0.71 PASS
Steps
Swipe to view more
| Step | Status | Cost | Time | In tok | Out tok | Tools |
|---|---|---|---|---|---|---|
| pullIssue | succeeded | $0.00 | — | 0 | 0 | 0 |
| plan | succeeded | $0.06 | 0m 28s | 204 | 2,185 | 2 |
| reviewPlan | succeeded | $0.06 | 0m 31s | 204 | 2,670 | 2 |
| execute | succeeded | $0.26 | 1m 48s | 1,088 | 11,094 | 12 |
| reviewAndCorrect | succeeded | $0.17 | 1m 08s | 952 | 4,290 | 10 |
| openPullRequest | succeeded | $0.15 | 0m 57s | 952 | 3,969 | 13 |
| verifyPullRequest | succeeded | $0.00 | 0m 01s | 0 | 0 | 0 |
| verifyPullRequestCheck | succeeded | $0.00 | 0m 11s | 0 | 0 | 0 |
| summarizeUsage | succeeded | $0.00 | — | 0 | 0 | 0 |
| score | succeeded | $0.00 | — | 0 | 0 | 0 |
Run totals
- Cost
- $0.71
- Agent time
- 4m 51s
- Input tokens
- 3,400
- Output tokens
- 24,208
- Cache-read tokens
- 908,738
- Tool calls
- 39
Tool call mix
- command_execution
- 36
- file_change
- 3
Run 4 $0.71 PASS
Steps
Swipe to view more
| Step | Status | Cost | Time | In tok | Out tok | Tools |
|---|---|---|---|---|---|---|
| pullIssue | succeeded | $0.00 | — | 0 | 0 | 0 |
| plan | succeeded | $0.06 | 0m 28s | 201 | 2,167 | 2 |
| reviewPlan | succeeded | $0.06 | 0m 32s | 199 | 2,646 | 2 |
| execute | succeeded | $0.26 | 1m 49s | 1,091 | 11,022 | 12 |
| reviewAndCorrect | succeeded | $0.18 | 1m 06s | 972 | 4,343 | 10 |
| openPullRequest | succeeded | $0.15 | 0m 56s | 953 | 4,029 | 13 |
| verifyPullRequest | succeeded | $0.00 | 0m 01s | 0 | 0 | 0 |
| verifyPullRequestCheck | succeeded | $0.00 | 0m 11s | 0 | 0 | 0 |
| summarizeUsage | succeeded | $0.00 | — | 0 | 0 | 0 |
| score | succeeded | $0.00 | — | 0 | 0 | 0 |
Run totals
- Cost
- $0.71
- Agent time
- 4m 52s
- Input tokens
- 3,416
- Output tokens
- 24,207
- Cache-read tokens
- 914,079
- Tool calls
- 39
Tool call mix
- command_execution
- 35
- file_change
- 4
Run 3 $0.72 PASS
Steps
Swipe to view more
| Step | Status | Cost | Time | In tok | Out tok | Tools |
|---|---|---|---|---|---|---|
| pullIssue | succeeded | $0.00 | — | 0 | 0 | 0 |
| plan | succeeded | $0.06 | 0m 28s | 205 | 2,175 | 2 |
| reviewPlan | succeeded | $0.07 | 0m 32s | 202 | 2,686 | 2 |
| execute | succeeded | $0.27 | 1m 50s | 1,112 | 11,251 | 12 |
| reviewAndCorrect | succeeded | $0.18 | 1m 08s | 946 | 4,302 | 10 |
| openPullRequest | succeeded | $0.15 | 0m 56s | 957 | 3,914 | 13 |
| verifyPullRequest | succeeded | $0.00 | 0m 01s | 0 | 0 | 0 |
| verifyPullRequestCheck | succeeded | $0.00 | 0m 11s | 0 | 0 | 0 |
| summarizeUsage | succeeded | $0.00 | — | 0 | 0 | 0 |
| score | succeeded | $0.00 | — | 0 | 0 | 0 |
Run totals
- Cost
- $0.72
- Agent time
- 4m 54s
- Input tokens
- 3,422
- Output tokens
- 24,328
- Cache-read tokens
- 920,455
- Tool calls
- 39
Tool call mix
- command_execution
- 34
- file_change
- 5
Run 2 $0.71 PASS
Steps
Swipe to view more
| Step | Status | Cost | Time | In tok | Out tok | Tools |
|---|---|---|---|---|---|---|
| pullIssue | succeeded | $0.00 | — | 0 | 0 | 0 |
| plan | succeeded | $0.06 | 0m 27s | 203 | 2,204 | 2 |
| reviewPlan | succeeded | $0.06 | 0m 31s | 208 | 2,641 | 2 |
| execute | succeeded | $0.26 | 1m 48s | 1,092 | 11,108 | 12 |
| reviewAndCorrect | succeeded | $0.17 | 1m 08s | 968 | 4,260 | 10 |
| openPullRequest | succeeded | $0.15 | 0m 57s | 943 | 4,048 | 13 |
| verifyPullRequest | succeeded | $0.00 | 0m 01s | 0 | 0 | 0 |
| verifyPullRequestCheck | succeeded | $0.00 | 0m 11s | 0 | 0 | 0 |
| summarizeUsage | succeeded | $0.00 | — | 0 | 0 | 0 |
| score | succeeded | $0.00 | — | 0 | 0 | 0 |
Run totals
- Cost
- $0.71
- Agent time
- 4m 51s
- Input tokens
- 3,414
- Output tokens
- 24,261
- Cache-read tokens
- 890,645
- Tool calls
- 39
Tool call mix
- command_execution
- 37
- file_change
- 2
Run 1 $0.71 PASS
Steps
Swipe to view more
| Step | Status | Cost | Time | In tok | Out tok | Tools |
|---|---|---|---|---|---|---|
| pullIssue | succeeded | $0.00 | — | 0 | 0 | 0 |
| plan | succeeded | $0.06 | 0m 27s | 199 | 2,217 | 2 |
| reviewPlan | succeeded | $0.06 | 0m 31s | 201 | 2,645 | 2 |
| execute | succeeded | $0.26 | 1m 49s | 1,101 | 11,186 | 12 |
| reviewAndCorrect | succeeded | $0.17 | 1m 07s | 948 | 4,194 | 10 |
| openPullRequest | succeeded | $0.15 | 0m 58s | 974 | 4,042 | 13 |
| verifyPullRequest | succeeded | $0.00 | 0m 01s | 0 | 0 | 0 |
| verifyPullRequestCheck | succeeded | $0.00 | 0m 10s | 0 | 0 | 0 |
| summarizeUsage | succeeded | $0.00 | — | 0 | 0 | 0 |
| score | succeeded | $0.00 | — | 0 | 0 | 0 |
Run totals
- Cost
- $0.71
- Agent time
- 4m 53s
- Input tokens
- 3,423
- Output tokens
- 24,284
- Cache-read tokens
- 907,952
- Tool calls
- 39
Tool call mix
- command_execution
- 36
- file_change
- 3
No runs match these filters.