28 lines
1.8 KiB
Markdown
28 lines
1.8 KiB
Markdown
# Model parameter similarity experiments
|
|
|
|
Bounded, inference-free analysis of official unquantized model weights. The first experiment
|
|
is **Qwen3.5-2B**. Model weights are downloaded and analyzed on the authorized remote host,
|
|
then deleted after archived results pass validation. No model weights are committed here.
|
|
|
|
- [CPU-first feasibility and validation](docs/CPU_FIRST_VALIDATION.md)
|
|
- [Training-free functional reuse plan (proposed; not executed)](docs/TRAINING_FREE_FUNCTIONAL_PLAN.md)
|
|
- [Primary-source literature and applicability](docs/FUNCTIONAL_REUSE_LITERATURE.md)
|
|
- [Procedure and limits](docs/SOP.md)
|
|
- [2B pilot findings and limitations](docs/PILOT_FINDINGS.md)
|
|
- [Raw result report, data and figures](results/qwen35-2b/REPORT.md)
|
|
- `pilot/download.py`: revision-pinned official checkpoint download and verification.
|
|
- `pilot/tensors.py`: memory-mapped safetensors/BF16 reader and metrics.
|
|
- `pilot/analyze.py`: bounded tensor/block search, exact verification, representative groups.
|
|
- `pilot/plot.py`: scientific PNG/PDF/SVG figures and report from saved data.
|
|
- `pilot/validate.py`: result/group validation, checksums and guarded weight cleanup.
|
|
- `pilot/audit.py`: finite-metric checks, test evidence and archive provenance.
|
|
- `pilot/run.py`: one-model supervisor with bounded download wait and analysis timeouts.
|
|
- `tests/test_pilot.py`: synthetic numerical and 3D correctness tests.
|
|
|
|
The primary result is **verified net byte savings versus direct relative weight error**.
|
|
This does not demonstrate preserved task capability or faster inference. Different block
|
|
scales are alternative partitions and their savings must not be summed.
|
|
|
|
Dependencies are pinned in `requirements.txt`; install only prebuilt wheels on the remote host.
|
|
Full resolved versions and run provenance accompany each result. See the SOP for commands.
|