docs(schema): track the 65-item schema review page
ci / python (pull_request) Successful in 16s
ci / lean (pull_request) Successful in 29s
ci / image (pull_request) Has been skipped

This commit is contained in:
2026-10-28 21:42:45 +08:00
parent 29fe3e1aa5
commit 4eee78be09
6 changed files with 9375 additions and 8 deletions
+8 -1
View File
@@ -276,6 +276,12 @@ Experiments have IDs (`P0`, `E0`-`E11`); the registry, phases, gates and convent
[`docs/experiments/README.md`](docs/experiments/README.md). CI runner and environment notes: [`docs/experiments/README.md`](docs/experiments/README.md). CI runner and environment notes:
[`docs/infrastructure/runner-lean435.md`](docs/infrastructure/runner-lean435.md). [`docs/infrastructure/runner-lean435.md`](docs/infrastructure/runner-lean435.md).
Browse the [65-item semantic simplex schema review](docs/reviews/simplex-schemas.html)
by opening that HTML file in a browser after cloning, or downloading it from Git.
It shows role schemas and Lean signature expressions; textbook passages and full assistant
judgment explanations remain private. The [schema design and replay instructions](docs/simplex-schema.md)
explain how the page is generated and which annotations still need review.
## What this does not claim ## What this does not claim
Lean says whether the code is *legal*, and — when there is a proof — whether it is Lean says whether the code is *legal*, and — when there is a proof — whether it is
@@ -285,4 +291,5 @@ well-formed statement of the wrong theorem passes every check here. `confidence`
possible; spot-check before trusting a dataset. possible; spot-check before trusting a dataset.
Source books are not committed. `.gitignore` keeps PDFs and extracted text out of Source books are not committed. `.gitignore` keeps PDFs and extracted text out of
the repository; only code and the short Lean datasets belong in git. the repository. The tracked schema review contains semantic annotations and Lean signatures,
while source-inclusive inputs remain in the ignored data directory.
File diff suppressed because it is too large Load Diff
+10 -3
View File
@@ -137,14 +137,20 @@ Private outputs under `experiments/P0-pilot/data/simplex-schemas-v1/`:
- `registry.sqlite`: queryable catalog with the 115 schemas and scoped slots. - `registry.sqlite`: queryable catalog with the 115 schemas and scoped slots.
- `schemas.json`: all 65 source/Lean pairs, retaining incomplete Lean projections. - `schemas.json`: all 65 source/Lean pairs, retaining incomplete Lean projections.
- `schemas.html`: a local review of all 65 pairs. - `schemas.html`: a local generated copy of the schema-only review tracked below.
- `schema-inputs.json`: input hashes; an existing directory rejects changed inputs. - `schema-inputs.json`: input hashes; an existing directory rejects changed inputs.
Tracked, text-free outputs: Tracked outputs:
- `experiments/P0-pilot/results/simplex-schema-index.json`: 65 item IDs, schema keys, - `experiments/P0-pilot/results/simplex-schema-index.json`: 65 item IDs, schema keys,
role counts, coverage status and reference-candidate counts. role counts, coverage status and reference-candidate counts.
- `experiments/P0-pilot/results/simplex-schema-summary.json`: coverage, limitations and hashes. - `experiments/P0-pilot/results/simplex-schema-summary.json`: coverage, limitations and hashes.
- [65-item schema review](reviews/simplex-schemas.html): an owner-approved, self-contained
HTML view of all 65 source/Lean pairs. It includes schema role descriptions and Lean
signature expressions, but no textbook paragraphs or full assistant judgment explanations.
Open the file in a browser after cloning, or download it from the repository; the Git web
interface may display HTML source instead of rendering it. The JSON indexes above remain
text-free counts/keys. Full source-inclusive inputs and assessment files remain gitignored.
Replay from the repository root with private inputs present: Replay from the repository root with private inputs present:
@@ -155,7 +161,8 @@ PYTHONPATH=. python3 experiments/P0-pilot/build_schemas.py \
--key experiments/P0-pilot/labels/key.json \ --key experiments/P0-pilot/labels/key.json \
--private-out experiments/P0-pilot/data/simplex-schemas-v1 \ --private-out experiments/P0-pilot/data/simplex-schemas-v1 \
--index experiments/P0-pilot/results/simplex-schema-index.json \ --index experiments/P0-pilot/results/simplex-schema-index.json \
--summary experiments/P0-pilot/results/simplex-schema-summary.json --summary experiments/P0-pilot/results/simplex-schema-summary.json \
--review-page docs/reviews/simplex-schemas.html
``` ```
The original annotations, judgments, Qwen results and matcher thresholds remain unchanged. The original annotations, judgments, Qwen results and matcher thresholds remain unchanged.
+4
View File
@@ -75,3 +75,7 @@ structural candidate queries, bindings and replay command. Private SQLite/JSON/H
stay under `data/simplex-schemas-v1/`; tracked `results/simplex-schema-*.json` files contain stay under `data/simplex-schemas-v1/`; tracked `results/simplex-schema-*.json` files contain
only counts, opaque keys, provenance hashes and coverage status. This does not change the only counts, opaque keys, provenance hashes and coverage status. This does not change the
frozen diagnostic or claim complete semantic extraction or proof verification. frozen diagnostic or claim complete semantic extraction or proof verification.
The owner-approved schema-only HTML review is tracked at
`docs/reviews/simplex-schemas.html`. Regenerate it with the builder's `--review-page` option;
the raw inputs, full assessment explanations and SQLite snapshot remain gitignored.
+11 -3
View File
@@ -114,6 +114,8 @@ def main():
parser.add_argument("--private-out", required=True, type=Path) parser.add_argument("--private-out", required=True, type=Path)
parser.add_argument("--index", required=True, type=Path) parser.add_argument("--index", required=True, type=Path)
parser.add_argument("--summary", required=True, type=Path) parser.add_argument("--summary", required=True, type=Path)
parser.add_argument("--review-page", type=Path,
help="Also export the owner-approved schema-only HTML review into the project")
args = parser.parse_args() args = parser.parse_args()
if "data" not in args.private_out.parts: if "data" not in args.private_out.parts:
parser.error("Private schemas must remain in the gitignored data/ directory") parser.error("Private schemas must remain in the gitignored data/ directory")
@@ -149,14 +151,20 @@ def main():
sides.append(f'<h3>{side}</h3><pre>{html.escape(content)}</pre>') sides.append(f'<h3>{side}</h3><pre>{html.escape(content)}</pre>')
sections.append(f'<section id="{row["blind_id"]}"><h2>{row["blind_id"]}</h2>' sections.append(f'<section id="{row["blind_id"]}"><h2>{row["blind_id"]}</h2>'
+ ''.join(sides) + '</section>') + ''.join(sides) + '</section>')
(args.private_out / "schemas.html").write_text( review_page = (
'<!doctype html><html lang="en"><meta charset="utf-8"><title>P0 semantic simplex schemas</title>' '<!doctype html><html lang="en"><meta charset="utf-8"><title>P0 semantic simplex schemas</title>'
'<style>body{font:16px/1.5 system-ui;max-width:1050px;margin:32px auto;padding:16px}' '<style>body{font:16px/1.5 system-ui;max-width:1050px;margin:32px auto;padding:16px}'
'pre{white-space:pre-wrap;background:#f5f5f5;padding:16px}section{border-top:1px solid #ccc}</style>' 'pre{white-space:pre-wrap;background:#f5f5f5;padding:16px}section{border-top:1px solid #ccc}</style>'
'<h1>65 semantic multi-role relation schemas</h1>' '<h1>65 semantic multi-role relation schemas</h1>'
'<p>Private annotation seeds, not independently validated mathematical statements. ' '<p>Schema annotation seeds, not independently validated mathematical statements. '
'A simplex joins the objects, assumptions and conclusion in its slots. ' 'A simplex joins the objects, assumptions and conclusion in its slots. '
'References are partial symbol/syntax candidates.</p>' + ''.join(sections) + '</html>') 'References are partial symbol/syntax candidates. '
'This review contains schema annotations and Lean signature text, not textbook passages '
'or full assistant judgment explanations.</p>' + ''.join(sections) + '</html>')
(args.private_out / "schemas.html").write_text(review_page, encoding="utf-8")
if args.review_page is not None:
args.review_page.parent.mkdir(parents=True, exist_ok=True)
args.review_page.write_text(review_page, encoding="utf-8")
# JSON-only reload is independently checked; it does not use pickle. # JSON-only reload is independently checked; it does not use pickle.
for row in snapshots: for row in snapshots:
for side in ["source", "lean"]: for side in ["source", "lean"]:
@@ -13,7 +13,7 @@
"items": "487ecd22919a5e3b0174a2846ab8fe7c0daf4d3feccccf8ea6571aec04c41bed", "items": "487ecd22919a5e3b0174a2846ab8fe7c0daf4d3feccccf8ea6571aec04c41bed",
"assessments": "f12735802ba0d4d94b776a91581a13a508eab0ce90ba8973a6c9c4e4d1390272", "assessments": "f12735802ba0d4d94b776a91581a13a508eab0ce90ba8973a6c9c4e4d1390272",
"key": "f827cac92ee4e907554fadcc7c0e006ef2b829350f74e7f8b54ca11945e62836", "key": "f827cac92ee4e907554fadcc7c0e006ef2b829350f74e7f8b54ca11945e62836",
"builder": "3c8a7112f2d86737b646fbc9abfe5e9b8660efabc1023f2cc3357398445675e9", "builder": "7b3a982101f620c1480d95b5e483ca6186a7e9c32ce587fb132a90bfb38a01bc",
"schema_module": "958b81e89c0befeb32d24036c130f2b37bd2e881bd5b009acf873cbcdada50ae", "schema_module": "958b81e89c0befeb32d24036c130f2b37bd2e881bd5b009acf873cbcdada50ae",
"registry_module": "7b434b1eb178f597d4f60591a5ab74eff0c96a40fa751cb0ba75589b52e56271" "registry_module": "7b434b1eb178f597d4f60591a5ab74eff0c96a40fa751cb0ba75589b52e56271"
}, },