Ways to Get a Scorecard
- Manually — See Full Play Test for details
- Python Toolkit — See Get Scorecard guide
- Swarm — Running a swarm will automatically open/close a scorecard for each agent
Scorecard Fields
| Field | Description |
|---|---|
| tags | Array of strings used to categorize and filter scorecards (e.g., [“experiment1”, “v2.0”, “test”]) |
| source_url | Optional URL field returned in the scorecard response |
| opaque | Optional field for arbitrary data |
Sharing
Scorecards are not public, however you can share replays from scorecards created via the API with others. Local scorecards cannot be shared.Notes
- Scorecards auto close after 15 minutes
- Agent scorecards are automatically added to the leaderboard in batch every ~15 minutes
- Stopping the program prematurely with Ctrl‑C mid‑run will not allow you to see the scorecard results

