Skip to content

Remove submission schema version field#57

Merged
isPANN merged 3 commits into
mainfrom
codex/clarify-submission-contract
Jul 19, 2026
Merged

Remove submission schema version field#57
isPANN merged 3 commits into
mainfrom
codex/clarify-submission-contract

Conversation

@isPANN

@isPANN isPANN commented Jul 18, 2026

Copy link
Copy Markdown
Collaborator

What changed

  • remove schema_version from runner output, intake validation, private scored results, and both JSON schemas
  • have the official scorer recognize the current ledger-backed structure directly
  • retain shape-based handling only for historical local data; official submissions require the current ledger fields
  • document the current problem-reductions tag/full commit and pred version in README
  • clarify that the runner records library_commit and the scorer owns the round gate
  • add drift tests linking README to the code-level round pins

Validation

  • uv run pytest -q: 217 passed, 4 skipped
  • focused runner/submit/ledger/scorer/docs tests: 79 passed
  • generated a fake runner submission, confirmed schema_version is absent, and passed benchmark.submit --dry-run --test
  • simplify review: reuse, quality, and efficiency passes completed; actionable cleanup applied

@isPANN isPANN changed the title Clarify submission schema ownership Remove submission schema version field Jul 18, 2026
@isPANN
isPANN marked this pull request as ready for review July 19, 2026 09:49
@isPANN
isPANN merged commit 76e78fb into main Jul 19, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant