MachineSex/tests
Giorgio Gilestro 5a23ddaf2a Phase 3: LLM-tier speciation + multi-seed firm-up of the recombination claims
llm_speciation (new kind; src/llm/speciation.py): E13 in LLM weights.
LoRA children share the frozen base's coordinates, so merge failure is
functional by construction. CONFLICT (ambiguous sort prompts learned
under opposite conventions — the BDM structure): function-specific
hybrid breakdown — merged coherence 0.02-0.08 falls below BOTH parents
(~0.2) on the conflicted function; and in the de-confounded `add` design
(private budget fixed, conflict added on top; 3 seeds after a
single-seed pilot showed one anomalous point) the merge's private-family
accuracy shows NO trend with conflict — the damage is surgical, not
global. DURATION (over-trained disjoint specialists, 1->12 epochs): the
merge improves (0.84->0.94) and stays above the best parent — the MLP
"no emergent isolation" null generalises; relevant to the
expert-training-duration report (2607.11997), with the epistasis
prediction left to the decisive experiment.

Multi-seed firm-up (seeds threaded into specialist caches; `seeds:` list
support in the runner; fixed test sets): all three recombination claims
hold with CIs — merges beat every specialist (5 seeds, ties
0.647±0.027 > best spec 0.592±0.009; worst-family 0.28 vs <=0.16); union
0.274±0.026 > fusion 0.174±0.102 on hard (3 seeds); directed 0.221±0.026
> soup. NEW finding: fusion is seed-FRAGILE where headroom exists
(CI ±0.10) while routing/directed selection are stable (±0.026) — the
union/selection operators win on reliability, not just mean.

Figures (llm_speciation 3-panel; llm_seeds 3-panel with 95% CI), READMEs,
+1 convention test (150 green), make llm-speciation / llm-seeds targets.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
2026-09-06 15:39:15 +01:00
..
test_analysis.py Layer 1 complete: E3-E6 + E2 analysis add-ons 2026-07-04 18:54:42 +02:00
test_correctness.py Layer 1 core: Wright-Fisher knowledge-transmission model with E1-E2 2026-07-04 18:10:18 +02:00
test_dynamic_society.py society: the dynamic Lamarckian society — the vertical claim (E11 / C3) 2026-07-05 12:34:01 +01:00
test_genotype.py society: make the sexual-transmission model rigorous (E9 epistasis, E10 directed sex) 2026-07-05 11:13:37 +01:00
test_kernel.py knowledge: learning kernel — model the estimator bias, not just sampling 2026-07-05 10:23:33 +01:00
test_llm.py Phase 3: LLM-tier speciation + multi-seed firm-up of the recombination claims 2026-09-06 15:39:15 +01:00
test_mating_system.py E14: mating systems — monogamy vs promiscuity (mate-pool breadth) 2026-07-09 12:38:50 +01:00
test_mnist.py neural: real-MNIST external-validity tier (collapse + grounding) 2026-07-05 09:19:36 +01:00
test_neural_correctness.py neural: grounding refinement + all five Layer-1.5 figures 2026-07-05 08:14:19 +01:00
test_neural_torch.py recombination: reproduce the E4 "merge, don't average" finding in real weights 2026-07-04 21:49:44 +01:00
test_neural_validation.py Layer 1.5: architecture-general neural existence proof 2026-07-04 21:02:49 +01:00
test_rebasin.py E13b/c: harden real-weight speciation — full symmetry group + emergent-divergence null 2026-09-06 12:35:14 +01:00
test_scientific_validation.py Layer 1 core: Wright-Fisher knowledge-transmission model with E1-E2 2026-07-04 18:10:18 +02:00
test_speciation.py E12: model speciation — the merge-compatibility limit of the sexual society 2026-07-08 22:40:02 +01:00