docs(schema): track the 65-item schema review page
This commit is contained in:
@@ -276,6 +276,12 @@ Experiments have IDs (`P0`, `E0`-`E11`); the registry, phases, gates and convent
|
||||
[`docs/experiments/README.md`](docs/experiments/README.md). CI runner and environment notes:
|
||||
[`docs/infrastructure/runner-lean435.md`](docs/infrastructure/runner-lean435.md).
|
||||
|
||||
Browse the [65-item semantic simplex schema review](docs/reviews/simplex-schemas.html)
|
||||
by opening that HTML file in a browser after cloning, or downloading it from Git.
|
||||
It shows role schemas and Lean signature expressions; textbook passages and full assistant
|
||||
judgment explanations remain private. The [schema design and replay instructions](docs/simplex-schema.md)
|
||||
explain how the page is generated and which annotations still need review.
|
||||
|
||||
## What this does not claim
|
||||
|
||||
Lean says whether the code is *legal*, and — when there is a proof — whether it is
|
||||
@@ -285,4 +291,5 @@ well-formed statement of the wrong theorem passes every check here. `confidence`
|
||||
possible; spot-check before trusting a dataset.
|
||||
|
||||
Source books are not committed. `.gitignore` keeps PDFs and extracted text out of
|
||||
the repository; only code and the short Lean datasets belong in git.
|
||||
the repository. The tracked schema review contains semantic annotations and Lean signatures,
|
||||
while source-inclusive inputs remain in the ignored data directory.
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
+10
-3
@@ -137,14 +137,20 @@ Private outputs under `experiments/P0-pilot/data/simplex-schemas-v1/`:
|
||||
|
||||
- `registry.sqlite`: queryable catalog with the 115 schemas and scoped slots.
|
||||
- `schemas.json`: all 65 source/Lean pairs, retaining incomplete Lean projections.
|
||||
- `schemas.html`: a local review of all 65 pairs.
|
||||
- `schemas.html`: a local generated copy of the schema-only review tracked below.
|
||||
- `schema-inputs.json`: input hashes; an existing directory rejects changed inputs.
|
||||
|
||||
Tracked, text-free outputs:
|
||||
Tracked outputs:
|
||||
|
||||
- `experiments/P0-pilot/results/simplex-schema-index.json`: 65 item IDs, schema keys,
|
||||
role counts, coverage status and reference-candidate counts.
|
||||
- `experiments/P0-pilot/results/simplex-schema-summary.json`: coverage, limitations and hashes.
|
||||
- [65-item schema review](reviews/simplex-schemas.html): an owner-approved, self-contained
|
||||
HTML view of all 65 source/Lean pairs. It includes schema role descriptions and Lean
|
||||
signature expressions, but no textbook paragraphs or full assistant judgment explanations.
|
||||
Open the file in a browser after cloning, or download it from the repository; the Git web
|
||||
interface may display HTML source instead of rendering it. The JSON indexes above remain
|
||||
text-free counts/keys. Full source-inclusive inputs and assessment files remain gitignored.
|
||||
|
||||
Replay from the repository root with private inputs present:
|
||||
|
||||
@@ -155,7 +161,8 @@ PYTHONPATH=. python3 experiments/P0-pilot/build_schemas.py \
|
||||
--key experiments/P0-pilot/labels/key.json \
|
||||
--private-out experiments/P0-pilot/data/simplex-schemas-v1 \
|
||||
--index experiments/P0-pilot/results/simplex-schema-index.json \
|
||||
--summary experiments/P0-pilot/results/simplex-schema-summary.json
|
||||
--summary experiments/P0-pilot/results/simplex-schema-summary.json \
|
||||
--review-page docs/reviews/simplex-schemas.html
|
||||
```
|
||||
|
||||
The original annotations, judgments, Qwen results and matcher thresholds remain unchanged.
|
||||
|
||||
@@ -75,3 +75,7 @@ structural candidate queries, bindings and replay command. Private SQLite/JSON/H
|
||||
stay under `data/simplex-schemas-v1/`; tracked `results/simplex-schema-*.json` files contain
|
||||
only counts, opaque keys, provenance hashes and coverage status. This does not change the
|
||||
frozen diagnostic or claim complete semantic extraction or proof verification.
|
||||
|
||||
The owner-approved schema-only HTML review is tracked at
|
||||
`docs/reviews/simplex-schemas.html`. Regenerate it with the builder's `--review-page` option;
|
||||
the raw inputs, full assessment explanations and SQLite snapshot remain gitignored.
|
||||
|
||||
@@ -114,6 +114,8 @@ def main():
|
||||
parser.add_argument("--private-out", required=True, type=Path)
|
||||
parser.add_argument("--index", required=True, type=Path)
|
||||
parser.add_argument("--summary", required=True, type=Path)
|
||||
parser.add_argument("--review-page", type=Path,
|
||||
help="Also export the owner-approved schema-only HTML review into the project")
|
||||
args = parser.parse_args()
|
||||
if "data" not in args.private_out.parts:
|
||||
parser.error("Private schemas must remain in the gitignored data/ directory")
|
||||
@@ -149,14 +151,20 @@ def main():
|
||||
sides.append(f'<h3>{side}</h3><pre>{html.escape(content)}</pre>')
|
||||
sections.append(f'<section id="{row["blind_id"]}"><h2>{row["blind_id"]}</h2>'
|
||||
+ ''.join(sides) + '</section>')
|
||||
(args.private_out / "schemas.html").write_text(
|
||||
review_page = (
|
||||
'<!doctype html><html lang="en"><meta charset="utf-8"><title>P0 semantic simplex schemas</title>'
|
||||
'<style>body{font:16px/1.5 system-ui;max-width:1050px;margin:32px auto;padding:16px}'
|
||||
'pre{white-space:pre-wrap;background:#f5f5f5;padding:16px}section{border-top:1px solid #ccc}</style>'
|
||||
'<h1>65 semantic multi-role relation schemas</h1>'
|
||||
'<p>Private annotation seeds, not independently validated mathematical statements. '
|
||||
'<p>Schema annotation seeds, not independently validated mathematical statements. '
|
||||
'A simplex joins the objects, assumptions and conclusion in its slots. '
|
||||
'References are partial symbol/syntax candidates.</p>' + ''.join(sections) + '</html>')
|
||||
'References are partial symbol/syntax candidates. '
|
||||
'This review contains schema annotations and Lean signature text, not textbook passages '
|
||||
'or full assistant judgment explanations.</p>' + ''.join(sections) + '</html>')
|
||||
(args.private_out / "schemas.html").write_text(review_page, encoding="utf-8")
|
||||
if args.review_page is not None:
|
||||
args.review_page.parent.mkdir(parents=True, exist_ok=True)
|
||||
args.review_page.write_text(review_page, encoding="utf-8")
|
||||
# JSON-only reload is independently checked; it does not use pickle.
|
||||
for row in snapshots:
|
||||
for side in ["source", "lean"]:
|
||||
|
||||
@@ -13,7 +13,7 @@
|
||||
"items": "487ecd22919a5e3b0174a2846ab8fe7c0daf4d3feccccf8ea6571aec04c41bed",
|
||||
"assessments": "f12735802ba0d4d94b776a91581a13a508eab0ce90ba8973a6c9c4e4d1390272",
|
||||
"key": "f827cac92ee4e907554fadcc7c0e006ef2b829350f74e7f8b54ca11945e62836",
|
||||
"builder": "3c8a7112f2d86737b646fbc9abfe5e9b8660efabc1023f2cc3357398445675e9",
|
||||
"builder": "7b3a982101f620c1480d95b5e483ca6186a7e9c32ce587fb132a90bfb38a01bc",
|
||||
"schema_module": "958b81e89c0befeb32d24036c130f2b37bd2e881bd5b009acf873cbcdada50ae",
|
||||
"registry_module": "7b434b1eb178f597d4f60591a5ab74eff0c96a40fa751cb0ba75589b52e56271"
|
||||
},
|
||||
|
||||
Reference in New Issue
Block a user