Document bounded training-free functional reuse investigation
This commit is contained in:
+10
@@ -111,3 +111,13 @@ venv/bin/python -B -m pilot.validate --root runs/qwen35-2b --cleanup-weights
|
||||
- For MoE, analyze router behavior and joint gate/up/down expert consistency before treating
|
||||
independently similar matrix blocks as interchangeable experts.
|
||||
- Use these observations to revise this SOP before downloading a second model.
|
||||
|
||||
## Training-free functional follow-up (design only)
|
||||
|
||||
Direct coordinate-aligned parameter similarity is a baseline, not a test of Q/K/V or MLP
|
||||
functional interchangeability. The follow-up uses same-input module probes without solving
|
||||
rotations or training any parameters, then single-site intervention and held-out quality/cost
|
||||
validation. See the [bounded plan](TRAINING_FREE_FUNCTIONAL_PLAN.md) and
|
||||
[primary-source literature](FUNCTIONAL_REUSE_LITERATURE.md). No forward pass, new download,
|
||||
or new model is started by adopting this document. The original static pilot remains
|
||||
inference-free; the proposed follow-up requires a separately confirmed execution environment.
|
||||
|
||||
Reference in New Issue
Block a user