# Response to the external review *Re: "The Evolution of Sex for Artificial Intelligence" (draft reviewed August 2026). This response accompanies a revised manuscript and a set of new experiments run directly in answer to the review. All results referenced here are committed, reproducible artifacts (configs, seeds, figures, and per-experiment READMEs in the repository); commit-level pointers are listed at the end.* --- Thank you for this review. It is the most useful reading the manuscript has had: it does not dispute the programme, it disputes the *calibration* — and its central instrument, the distinction between **interpretation, explanation, and prediction**, is exactly the right one. We have acted on it in two ways: we revised the manuscript to claim only what the evidence supports, and we **ran the decisive experiment the review proposed** (§5 of the review), together with four supporting experiments. The short version of this letter: we accepted nearly everything, the manuscript is narrower and better for it, and the prediction rung of your ladder — the one the draft "was not yet convincing on" — has now been climbed at the small-model tier, with the falsifiers pre-registered and one internal prediction honestly reported as unconfirmed. ## 1. The overall take, and the framing > *"The strongest idea is … treat multigenerational model populations as systems whose inheritance, > diversity, and compatibility must be managed—not merely as collections of models to optimise."* Adopted, verbatim, as the stated core contribution — it now closes the abstract's first paragraph and anchors §1. You articulated our thesis better than we had; we have taken the sentence with attribution to the review process rather than pretend we wrote it first. > *"The draft sometimes treats a useful biological correspondence as a mathematical identity, and an > illustrative experiment as confirmation of a general mechanism."* Accepted. This was the review's most consequential criticism and drove most of the textual changes below. ## 2. Novelty: interpretation / explanation / prediction The ladder is now explicit in §1: we state which of our claims are interpretation (merged offspring as Fisher–Muller), which are explanation (the coordinate-vs-functional decomposition of merge failure), and which are prediction. The priority-dispute language — "nobody has," "none imports," "the theory the tinkering has outrun" — has been removed entirely, replaced with "to our knowledge" and positive statements of what population genetics contributes. Merge-success *prediction* is now explicitly conceded as an occupied area (interpretable pairwise metrics; capacity/rate-distortion accounts), with our delta stated as mechanism, not existence. And the prediction rung is no longer only proposed — see §7 below. ## 3A. Drift, Muller's ratchet, and model collapse Accepted in full. The manuscript now says: the *minimal inheritance model* is exactly Wright–Fisher; a real learner is Wright–Fisher **plus a signed, architecture-specific estimator-bias operator** — and we cite our own learning-kernel measurement against ourselves (the smoothing RNN resists collapse, the sharpening VAE accelerates it; the drift *signs* survive in every architecture tested). Muller's ratchet is scoped to the **irreversible arm** of collapse — the capabilities that, once lost from every parent and source, no recombination can rebuild — with your implication stated as the reason the correspondence earns its keep: recombination only reassembles what still survives, so the cure must act before fixation-by-loss. The glossary entries were carrying the same identity overclaims and have been fixed to match. ## 3B. "Merge, don't average" — the operator boundaries Accepted. A dedicated boundary paragraph now answers your five questions in order: - **What is conserved?** Expected rare-item mass, at the single-parent level, exact in the minimal model's rare-item regime. - **Under which operator?** Refitting a child to the **mean of the parents' output distributions** — that operator only. The 1/K dilution exactly cancels the K-parent union gain there. - **Weight averaging and routing?** Explicitly labelled *empirical cousins*, not instances: a nonlinear network's weight-mean does not compute its parents' output-mean, and a router keeps K models' storage plus a classifier — a different parameter and inference budget from one fixed-size child. The measured **headroom rule** is presented as the empirical bridge between the exact law and the weight-space operators, which is all it is. - **Does the strongest-source operator need an oracle?** Yes, and the text now says so. - **Capacity?** When parental capabilities cannot coexist in the child's capacity, no operator preserves the union — stated, with an explicit hand-off to the speciation section as the regime where that boundary lives. New supporting evidence since the review: the multi-seed replication (below) adds that fusion is not only worse than union-preserving operators where headroom exists — it is far **less reliable** (95% CI ±0.10 across training seeds vs ±0.026 for routing/selection), which we think sharpens the practical half of this claim. ## 3C. Model speciation Accepted, and this section received the most work — textual and experimental. **Textual.** A closing block, "What these experiments do and do not establish," now states the supported conclusion at exactly your formulation — *some merge failures reflect incompatible functional requirements rather than a mismatch in coordinates* — and then lists the qualifiers: (i) the conflict-condition impossibility is **information-theoretic and needs no population genetics** (now also a formal SI proposition: endpoints and chord are invariant under any function-preserving transformation, and any single merged model errs at rate ≥ μ(S)/2 against at least one parent); what the genetic frame adds is locating *which divergences generate such conflicts*; (ii) the epistasis-positions-the-cliff claim and the snowball are labelled **hypotheses at the neural tier**, verified only in the analytic model; (iii) alignment claims are scoped to the enumerated symmetries of the architecture tested, and "unmergeable" means by aligned linear interpolation — a barrier to that operator does not preclude every recombination method (routing sidesteps it by not blending). Emergent Dobzhansky–Muller incompatibilities are carried as the flagship *hypothesis*, with the regimes where our tests found none stated as bounds. **Experimental (new since the review).** 1. *Alignment under the full symmetry group.* Anticipating the "one control does not prove the optimum over all allowed symmetries" objection — and the 2026 richer-symmetry results — we re-ran the decomposition aligning modulo the **complete** function-preserving unit symmetry group of the ReLU MLP (per-unit positive rescaling ∘ permutation; the aligner provably recovers a permuted-and-rescaled copy exactly). The conflict residual is unchanged (0.502 → 0.497); the independent-init barrier still vanishes (0.001). The cliff now also carries a hybrid-fitness readout: merged accuracy 0.97 → 0.03 with conflict. 2. *The emergent test, pre-registered.* Divergent-but-compatible specialists (disjoint classes; shifted-view conventions), out to 6.4× the base training: residual 0.000 everywhere, and the merge *rescues* the two forgetting parents (~0.50 → 0.955). We report this null prominently — you identified the sharper question ("which kinds of specialisation create merge-breaking interactions, and which remain complementary?") and this is its first half of an answer: *specialisation on shared ancestry did not break merging in any regime we tested; imposed functional conflict always did.* 3. *The LLM tier.* The same two knobs in 0.5B LoRA children of a frozen base (which pins the coordinate system, so merge failure is functional by construction): conflicting conventions produce **function-specific** hybrid breakdown (merged coherence below both parents; private, disjoint skills unharmed in a budget-controlled design, 3 seeds), and over-training disjoint specialists 1→12 epochs produces **no** emergent isolation (the merge improves, staying above the best parent). ## 4. Importance, scope, and the supporting overstatements - **"Three task families and one seed."** The LLM claims are now multi-seed with fixed test sets: merges beat every specialist with non-overlapping CIs on the sharper metric (5 seeds); union vs fusion and directed-selection vs soup replicated at 3 seeds on the hard benchmark. Three lexically-distinct families remain a stated limitation; the full grounded LLM society remains explicitly unbuilt and is flagged as such. - **Open-ended growth.** Accepted — the §11 closing has been rewritten: the architecture removes the *storage* obstacle to indefinite accumulation; that is bookkeeping, not a demonstration of unbounded capability growth, which our deliberately finite models do not test. - **Frozen base ≠ unchanged behaviour** — fixed (§3 now guarantees a recoverable core, not unchanging conduct). - **Baldwin effect** — now an *echo*, with the mechanism difference stated (selection for genetic assimilation vs direct distillation). - **Consolidation and the archive** — fixed: a digital system can and should keep every ancestor; the irreversibility is *operational* (nothing in the production loop consults the archive by default), and the safeguard now includes an audit that diffs against the archived ancestor. - **"Control theory" → "framework"** throughout, subtitle included. - **The claim–assumptions–evidence–limitation table** is in §13 ("The claims at a glance"), ten rows, each labelled exact / empirical / hypothesis with known limits. ## 5. The decisive experiment — run We implemented your six-step design as specified, at the 0.5B tier (39 parent pairs, 3 seeds, fixed held-out test sets, falsifiers pre-registered in the config before running): 1. **Controlled interaction structure:** three axes decorrelated by construction — *conflict* (contradictory conventions on shared ambiguous prompts, private budgets fixed), *compat* (the same shared prompts learned under the **same** convention: overlap without conflict), and *duration* (weight divergence with zero conflict, 1→12 epochs). 2. **Functional divergence separated from duration and weight distance:** the duration and compat axes span the same weight-divergence and data-volume ranges as the conflict axis, at ~zero merge penalty. 3. **Operational epistasis, pre-merge:** confidence-weighted bilateral disagreement on a probe mix drawn blind to where the conflict lives — the theory's point being that raw disagreement counts harmless *complementation* (one parent ignorant) as conflict, while the Dobzhansky–Muller structure is *bilateral confident contradiction*. 4. **Against existing predictors:** gradient alignment at the shared base, LoRA-delta cosine and L2 (computed exactly), and a performance-based (cross-family accuracy) baseline. 5. **Operator choice under matched budgets:** partially — see honest riders. 6. **Held-out tasks, multiple seeds:** yes (fixed tests, 3 training seeds). **Result.** Against the pre-registered primary outcome (merge penalty = parent potential − merged achieved, the hybrid-load analogue): functional measures predict (raw disagreement ρ = +0.46, operational epistasis ρ = +0.45, both p < 0.005); gradient alignment is weakly informative (−0.35); **both geometry predictors are uninformative** (delta-cosine +0.03, delta-L2 +0.17, n.s.); performance-based ~0. *Functional conflict, measured before merging, predicts merge failure; weight divergence does not.* Two things about how this result was reached that we want on the record: - **The control that broke our own experiment first.** In the initial two-axis grid, the *best* predictor was delta-cosine (ρ = +0.60) — geometry appeared to win. We identified the confound (every shared-data pair in that pool was a conflicted pair, so geometry could succeed as a mere overlap/volume detector), added the compat control axis, and geometry's correlation collapsed to +0.03 while the functional measures held. We report this sequence in the results README rather than presenting only the final table. - **An internal prediction failed, and we say so.** We pre-registered that confidence-weighting should beat raw disagreement as a rank predictor. It does not (they are statistically indistinguishable at n = 39); the weighting does double the conflict-vs-compat contrast in levels (2.0× vs 1.5×). The paper reports the functional-vs-geometric verdict, not a win for the refinement. **Honest riders:** correlations are moderate (|ρ| ≈ 0.45), bounded by the large intrinsic seed variance of 0.5B weight-averaging (itself now a documented finding); your step 5 (operator choice under matched budgets) is only partially delivered — the soup-vs-route gap readout is noise-dominated at this scale; and the whole result is one model family at one scale. The 7B replication on the HPC cluster is the planned firm-up before we treat this as more than a small-model demonstration. ## 6. Where we (mildly) push back Only two places, both narrow. First, on *"the impossibility does not require population genetics"* — agreed, and now stated; but we would defend the framework's role in the surrounding structure: it told us *which* pre-merge measurement to make (bilateral confident contradiction rather than raw disagreement or distance), *which* control to build (complementation ≠ conflict), and *which* null to pre-register (emergent isolation) — and those choices are what the decisive experiment's outcome vindicated against the geometry baselines. Second, on *"union preservation risks being built into the operator's definition"* — the conservation law's content is the exact *failure* of the mean operator (the 1/K cancellation), not the definitional success of the max operator; we have tried to make the text carry it that way, with the oracle requirement explicit. ## 7. What we have not done The full grounded, diversity-preserving multigenerational LLM society (still the stated largest gap); 7B replication of the decisive experiment; an entanglement measure for *real* task pairs (our epistasis knob is constructed); the operator-choice decision test at usable signal-to-noise; and ambiguous/overlapping task families where routing stops being trivially easy. These are listed in the manuscript's open-problems section in this form. ## Changelog Manuscript revision: commit `58e6c74` (claim-narrowing; all §1–§4 and draft-level items above). New experiments: `ea051a5` (full-symmetry alignment + emergent null, MLP tier), `5a23dda` (LLM-tier speciation + multi-seed replication), `287d232` (the decisive experiment + its control axis). The revised manuscript is `paper/the-evolution-of-sex-for-ai.md`; per-experiment analyses are in `results/*/README.md`; every figure regenerates from committed artifacts. We would welcome another pass — in particular on whether the decisive experiment's design and its riders are stated at the right strength, and on whether the remaining hypothesis labels (epistasis-cliff and snowball at the neural tier; emergent DMIs) are placed where you would place them.