MachineSex/configs/llm
Giorgio Gilestro 287d2326cc epistasis_predicts: functional conflict, not weight geometry, predicts merge failure pre-merge
The decisive experiment from the external review. 39 LoRA parent pairs
(0.5B, 3 seeds) on three axes decorrelated by construction: conflict
(contradictory conventions on shared prompts, private budgets fixed),
compat (same prompts, SAME convention — overlap without conflict), and
duration (weight divergence, zero conflict). Six pre-merge predictors;
primary outcome = merge penalty (parent potential − merged achieved).

League table (Spearman vs penalty, n=39): functional measures predict
(dis_raw +0.460, epi_conf +0.446, p<0.005); geometry collapses
(delta_cos +0.03, delta_l2 +0.17 n.s.); gradient alignment weak (−0.35);
performance ~0. The first grid's apparent geometry win (+0.60) was an
overlap/volume artifact — the compat control axis (added for exactly
this) exposed and killed it: same overlap and data volume, zero penalty.
Honest riders in the README: confidence weighting does not beat raw
disagreement as a rank predictor (pre-registered internal prediction not
confirmed; it does double the conflict/compat level contrast), and
|rho|~0.45 is bounded by 0.5B merge-outcome noise (7B is the firm-up).

Also: micro-batched gradient accumulation (OOM fix on the shared 16GB
GPU), exact r-space LoRA-delta geometry (brute-force-verified test,
151 green), systemd-run runbook lesson (tmux dies with the SSH session
scope on this box).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
2026-09-06 17:19:46 +01:00
..
directed.yaml llm_directed: directed sex (breed offspring + select on verifier) — E10 in real weights 2026-07-05 18:35:04 +01:00
directed_hard_hpc.yaml hard benchmark: the 7B "fusion wins / no headroom" results were saturation artefacts 2026-07-05 19:13:26 +01:00
directed_hard_seeds.yaml Phase 3: LLM-tier speciation + multi-seed firm-up of the recombination claims 2026-09-06 15:39:15 +01:00
directed_hpc.yaml llm_directed: directed sex (breed offspring + select on verifier) — E10 in real weights 2026-07-05 18:35:04 +01:00
epistasis.yaml epistasis_predicts: functional conflict, not weight geometry, predicts merge failure pre-merge 2026-09-06 17:19:46 +01:00
epistasis_compat.yaml epistasis_predicts: functional conflict, not weight geometry, predicts merge failure pre-merge 2026-09-06 17:19:46 +01:00
merge.yaml llm: first real-LLM prototype — recombining specialist LLMs (C2/C4) 2026-07-05 15:48:02 +01:00
merge_hpc.yaml hpc: PBS job scripts for Imperial CX3 (probe + scaled LLM merge run) 2026-07-05 16:02:09 +01:00
merge_seeds.yaml Phase 3: LLM-tier speciation + multi-seed firm-up of the recombination claims 2026-09-06 15:39:15 +01:00
moe.yaml llm_moe: the union operator (route/max-merge) vs fusion — and the regime flips at scale 2026-07-05 17:53:47 +01:00
moe_hard.yaml hard benchmark: the 7B "fusion wins / no headroom" results were saturation artefacts 2026-07-05 19:13:26 +01:00
moe_hard_hpc.yaml hard benchmark: the 7B "fusion wins / no headroom" results were saturation artefacts 2026-07-05 19:13:26 +01:00
moe_hard_seeds.yaml Phase 3: LLM-tier speciation + multi-seed firm-up of the recombination claims 2026-09-06 15:39:15 +01:00
moe_hpc.yaml llm_moe: the union operator (route/max-merge) vs fusion — and the regime flips at scale 2026-07-05 17:53:47 +01:00
speciation.yaml Phase 3: LLM-tier speciation + multi-seed firm-up of the recombination claims 2026-09-06 15:39:15 +01:00
speciation_add.yaml Phase 3: LLM-tier speciation + multi-seed firm-up of the recombination claims 2026-09-06 15:39:15 +01:00