Document bounded training-free functional reuse investigation

This commit is contained in:
2026-11-09 04:16:32 +08:00
parent 727b05eb3f
commit 70b8be25b4
5 changed files with 162 additions and 0 deletions
+10
View File
@@ -111,3 +111,13 @@ venv/bin/python -B -m pilot.validate --root runs/qwen35-2b --cleanup-weights
- For MoE, analyze router behavior and joint gate/up/down expert consistency before treating
independently similar matrix blocks as interchangeable experts.
- Use these observations to revise this SOP before downloading a second model.
## Training-free functional follow-up (design only)
Direct coordinate-aligned parameter similarity is a baseline, not a test of Q/K/V or MLP
functional interchangeability. The follow-up uses same-input module probes without solving
rotations or training any parameters, then single-site intervention and held-out quality/cost
validation. See the [bounded plan](TRAINING_FREE_FUNCTIONAL_PLAN.md) and
[primary-source literature](FUNCTIONAL_REUSE_LITERATURE.md). No forward pass, new download,
or new model is started by adopting this document. The original static pilot remains
inference-free; the proposed follow-up requires a separately confirmed execution environment.