Merge pilot recovery into the semantic simplex schema delivery
ci / python (pull_request) Successful in 16s
ci / lean (pull_request) Successful in 29s
ci / image (pull_request) Has been skipped

This commit is contained in:
2026-10-28 21:48:23 +08:00
6 changed files with 347 additions and 42 deletions
+13 -1
View File
@@ -44,6 +44,9 @@ Labeling must be finished before anyone opens `results.jsonl`.
- Metadata is stored beside the output as `results.meta.json`. Model, endpoint, temperature,
input hash, frozen-label hash and prompt hashes must match on resume. Usage is cumulative.
A file lock prevents concurrent writers. A budget stop returns exit status 2.
- Billing/authentication failures stop immediately. Resume retries only missing detector components,
keeping both complete items and the successful side of partial items. Rows are replaced atomically.
`--audit-only` reconciles saved completion counts and status without any API request.
- The nominal successful path uses 130 calls (one source extraction and one judge per item);
malformed replies and network retries may increase the actual count.
- Scoring requires complete labels and results and no unresolved detector errors. The primary
@@ -51,7 +54,16 @@ Labeling must be finished before anyone opens `results.jsonl`.
The complementary-signal PARTIAL rule counts wrong items flagged by role alignment but missed
by the judge. No threshold, concept table or detector prompt was tuned for these labels.
- Raw passages, labeling HTML and model responses remain in the ignored `data/` directory.
Only verdicts, abstract annotation notes, hashes and text-free summaries belong in Git.
Verdicts, abstract annotation notes, hashes and text-free summaries belong in Git;
the owner-approved schema-only HTML review is also tracked separately under docs/reviews/.
## Qwen execution snapshot
The 2026-10-28 run was blocked by DashScope `Arrearage`: 42 items are complete, 23 need
42 detector components, and 131 of the 400 request reservations have been consumed.
The owner requested fixes and a report now, with paid resumption deferred.
See `docs/experiments/P0-execution-2026-10-28.md` and `results/execution.json`.
No gate decision has been issued. Restore provider billing before resuming the same run.
## Separate GPT-assisted diagnostic