Model parameter similarity experiments

Research on repeated learned functions in Qwen3.5-2B: a completed static weight baseline and a training-free CPU functional pilot. The CPU study found similar existing RMSNorm functions at layer indices 12/13, with a uniform analytic error bound and heldout substitution checks. Cost is not a success condition. The completed static pilot was inference-free and its weights were deleted after archival; the functional pilot executes streaming FP32 text forwards. The current CPU functional checkpoint is retained until the user explicitly requests deletion. No model weights are committed here.

The static baseline reports verified net byte savings versus direct relative weight error. The functional study separately reports same-input error, an all-input RMSNorm function bound and tiny heldout NLL changes; these are not broad task-accuracy guarantees. Different static block scales are alternative partitions and their savings must not be summed.

Dependencies are pinned in requirements.txt; install only prebuilt wheels on the remote host. Full resolved versions and run provenance accompany each result. See the SOP for commands.

S
Description
No description provided
Readme 66 MiB
Languages
Python 100%