fix(pilot): freeze AI labels and enforce auditable execution
This commit is contained in:
@@ -2,7 +2,18 @@
|
||||
|
||||
Experiment ID **P0**, Phase 0. Registry and conventions: [README.md](README.md).
|
||||
|
||||
Status: **approved 2026-10-22; labels pending. No detector has been run and no API spend has occurred.**
|
||||
Status: **approved 2026-10-22; 65 AI labels frozen 2026-10-28; detector execution pending explicit data-transfer approval. No pilot API request has been sent.**
|
||||
|
||||
Owner amendment (2026-10-28, in the execution chat): Codex now handles preparation,
|
||||
annotation, detector execution and reporting; Kimi's participation is no longer required.
|
||||
The frozen labels are from one AI annotator, **not human ground truth**. The annotator saw
|
||||
the detector implementation and aggregate compile counts before labeling, but did not see
|
||||
per-item compiler outcomes or detector outputs. This departs from the original labeling plan;
|
||||
any resulting decision is provisional and cannot substitute for an independent human audit.
|
||||
Decision thresholds, detector prompts and the concept table remain fixed. Implementation
|
||||
repairs before the first paid call restore the complementary-signal PARTIAL rule, exclude
|
||||
minor drift from the primary wrong-versus-faithful comparison, enforce the cumulative HTTP
|
||||
request budget, and persist run identity and usage. See `experiments/P0-pilot/README.md`.
|
||||
Written 2026-10-22. Companion to `docs/research-plan.md` (what and why), `docs/TODO.md` (task list), `docs/acl-2027-bar.md` (bar). Target: ACL 2027 via ARR, deadline 4 Jan 2027 AoE.
|
||||
|
||||
## 1. Decision (approved by the owner on 2026-10-22)
|
||||
|
||||
Reference in New Issue
Block a user