Skip to main content

Overview

While the Toolkit automatically manages a default scorecard, you can create your own custom scorecards with tags and metadata to organize your experiments.

Creating a Custom Scorecard

Use create_scorecard() to create a scorecard with custom fields:
import arc_agi

arc = arc_agi.Arcade()

# Create a scorecard with custom fields
scorecard_id = arc.create_scorecard(
    source_url="https://github.com/my/repo",
    tags=["experiment", "v1"],
    opaque={"custom_field": "any data you want"}
)

print(f"Created scorecard: {scorecard_id}")

Using Your Scorecard

Pass the scorecard ID when creating environments:
# Use your custom scorecard when making environments
env = arc.make("ls20", scorecard_id=scorecard_id, render_mode="terminal")
All game runs will now be tracked under your custom scorecard.

Scorecard Fields

FieldDescription
tagsArray of strings to categorize and filter scorecards
source_urlOptional URL field (e.g., link to your code repository)
opaqueOptional field for arbitrary data

Next Steps