MachineSex/paper/response-to-review.md

# Response to the external review

*Re: "The Evolution of Sex for Artificial Intelligence" (draft reviewed August 2026). This response
accompanies a revised manuscript and a set of new experiments run directly in answer to the review.
All results referenced here are committed, reproducible artifacts (configs, seeds, figures, and
per-experiment READMEs in the repository); commit-level pointers are listed at the end.*

---

Thank you for this review. It is the most useful reading the manuscript has had: it does not dispute
the programme, it disputes the *calibration* — and its central instrument, the distinction between
**interpretation, explanation, and prediction**, is exactly the right one. We have acted on it in two
ways: we revised the manuscript to claim only what the evidence supports, and we **ran the decisive
experiment the review proposed** (§5 of the review), together with four supporting experiments. The
short version of this letter: we accepted nearly everything, the manuscript is narrower and better for
it, and the prediction rung of your ladder — the one the draft "was not yet convincing on" — has now
been climbed at the small-model tier, with the falsifiers pre-registered and one internal prediction
honestly reported as unconfirmed.

## 1. The overall take, and the framing

> *"The strongest idea is … treat multigenerational model populations as systems whose inheritance,
> diversity, and compatibility must be managed—not merely as collections of models to optimise."*

Adopted, verbatim, as the stated core contribution — it now closes the abstract's first paragraph and
anchors §1. You articulated our thesis better than we had; we have taken the sentence with attribution
to the review process rather than pretend we wrote it first.

> *"The draft sometimes treats a useful biological correspondence as a mathematical identity, and an
> illustrative experiment as confirmation of a general mechanism."*

Accepted. This was the review's most consequential criticism and drove most of the textual changes
below.

## 2. Novelty: interpretation / explanation / prediction

The ladder is now explicit in §1: we state which of our claims are interpretation (merged offspring
as Fisher–Muller), which are explanation (the coordinate-vs-functional decomposition of merge
failure), and which are prediction. The priority-dispute language — "nobody has," "none imports,"
"the theory the tinkering has outrun" — has been removed entirely, replaced with "to our knowledge"
and positive statements of what population genetics contributes. Merge-success *prediction* is now
explicitly conceded as an occupied area (interpretable pairwise metrics; capacity/rate-distortion
accounts), with our delta stated as mechanism, not existence.

And the prediction rung is no longer only proposed — see §7 below.

## 3A. Drift, Muller's ratchet, and model collapse

Accepted in full. The manuscript now says: the *minimal inheritance model* is exactly Wright–Fisher;
a real learner is Wright–Fisher **plus a signed, architecture-specific estimator-bias operator** — and
we cite our own learning-kernel measurement against ourselves (the smoothing RNN resists collapse,
the sharpening VAE accelerates it; the drift *signs* survive in every architecture tested). Muller's
ratchet is scoped to the **irreversible arm** of collapse — the capabilities that, once lost from
every parent and source, no recombination can rebuild — with your implication stated as the reason
the correspondence earns its keep: recombination only reassembles what still survives, so the cure
must act before fixation-by-loss. The glossary entries were carrying the same identity overclaims and
have been fixed to match.

## 3B. "Merge, don't average" — the operator boundaries

Accepted. A dedicated boundary paragraph now answers your five questions in order:

- **What is conserved?** Expected rare-item mass, at the single-parent level, exact in the minimal
  model's rare-item regime.
- **Under which operator?** Refitting a child to the **mean of the parents' output distributions** —
  that operator only. The 1/K dilution exactly cancels the K-parent union gain there.
- **Weight averaging and routing?** Explicitly labelled *empirical cousins*, not instances: a
  nonlinear network's weight-mean does not compute its parents' output-mean, and a router keeps K
  models' storage plus a classifier — a different parameter and inference budget from one fixed-size
  child. The measured **headroom rule** is presented as the empirical bridge between the exact law
  and the weight-space operators, which is all it is.
- **Does the strongest-source operator need an oracle?** Yes, and the text now says so.
- **Capacity?** When parental capabilities cannot coexist in the child's capacity, no operator
  preserves the union — stated, with an explicit hand-off to the speciation section as the regime
  where that boundary lives.

New supporting evidence since the review: the multi-seed replication (below) adds that fusion is not
only worse than union-preserving operators where headroom exists — it is far **less reliable**
(95% CI ±0.10 across training seeds vs ±0.026 for routing/selection), which we think sharpens the
practical half of this claim.

## 3C. Model speciation

Accepted, and this section received the most work — textual and experimental.

**Textual.** A closing block, "What these experiments do and do not establish," now states the
supported conclusion at exactly your formulation — *some merge failures reflect incompatible
functional requirements rather than a mismatch in coordinates* — and then lists the qualifiers: (i)
the conflict-condition impossibility is **information-theoretic and needs no population genetics**
(now also a formal SI proposition: endpoints and chord are invariant under any function-preserving
transformation, and any single merged model errs at rate ≥ μ(S)/2 against at least one parent); what
the genetic frame adds is locating *which divergences generate such conflicts*; (ii) the
epistasis-positions-the-cliff claim and the snowball are labelled **hypotheses at the neural tier**,
verified only in the analytic model; (iii) alignment claims are scoped to the enumerated symmetries
of the architecture tested, and "unmergeable" means by aligned linear interpolation — a barrier to
that operator does not preclude every recombination method (routing sidesteps it by not blending).
Emergent Dobzhansky–Muller incompatibilities are carried as the flagship *hypothesis*, with the
regimes where our tests found none stated as bounds.

**Experimental (new since the review).**

1. *Alignment under the full symmetry group.* Anticipating the "one control does not prove the
   optimum over all allowed symmetries" objection — and the 2026 richer-symmetry results — we
   re-ran the decomposition aligning modulo the **complete** function-preserving unit symmetry group
   of the ReLU MLP (per-unit positive rescaling ∘ permutation; the aligner provably recovers a
   permuted-and-rescaled copy exactly). The conflict residual is unchanged (0.502 → 0.497); the
   independent-init barrier still vanishes (0.001). The cliff now also carries a hybrid-fitness
   readout: merged accuracy 0.97 → 0.03 with conflict.
2. *The emergent test, pre-registered.* Divergent-but-compatible specialists (disjoint classes;
   shifted-view conventions), out to 6.4× the base training: residual 0.000 everywhere, and the merge
   *rescues* the two forgetting parents (~0.50 → 0.955). We report this null prominently — you
   identified the sharper question ("which kinds of specialisation create merge-breaking
   interactions, and which remain complementary?") and this is its first half of an answer:
   *specialisation on shared ancestry did not break merging in any regime we tested; imposed
   functional conflict always did.*
3. *The LLM tier.* The same two knobs in 0.5B LoRA children of a frozen base (which pins the
   coordinate system, so merge failure is functional by construction): conflicting conventions
   produce **function-specific** hybrid breakdown (merged coherence below both parents; private,
   disjoint skills unharmed in a budget-controlled design, 3 seeds), and over-training disjoint
   specialists 1→12 epochs produces **no** emergent isolation (the merge improves, staying above the
   best parent).

## 4. Importance, scope, and the supporting overstatements

- **"Three task families and one seed."** The LLM claims are now multi-seed with fixed test sets:
  merges beat every specialist with non-overlapping CIs on the sharper metric (5 seeds); union vs
  fusion and directed-selection vs soup replicated at 3 seeds on the hard benchmark. Three
  lexically-distinct families remain a stated limitation; the full grounded LLM society remains
  explicitly unbuilt and is flagged as such.
- **Open-ended growth.** Accepted — the §11 closing has been rewritten: the architecture removes the
  *storage* obstacle to indefinite accumulation; that is bookkeeping, not a demonstration of
  unbounded capability growth, which our deliberately finite models do not test.
- **Frozen base ≠ unchanged behaviour** — fixed (§3 now guarantees a recoverable core, not
  unchanging conduct).
- **Baldwin effect** — now an *echo*, with the mechanism difference stated (selection for genetic
  assimilation vs direct distillation).
- **Consolidation and the archive** — fixed: a digital system can and should keep every ancestor;
  the irreversibility is *operational* (nothing in the production loop consults the archive by
  default), and the safeguard now includes an audit that diffs against the archived ancestor.
- **"Control theory" → "framework"** throughout, subtitle included.
- **The claim–assumptions–evidence–limitation table** is in §13 ("The claims at a glance"), ten rows,
  each labelled exact / empirical / hypothesis with known limits.

## 5. The decisive experiment — run

We implemented your six-step design as specified, at the 0.5B tier (39 parent pairs, 3 seeds, fixed
held-out test sets, falsifiers pre-registered in the config before running):

1. **Controlled interaction structure:** three axes decorrelated by construction — *conflict*
   (contradictory conventions on shared ambiguous prompts, private budgets fixed), *compat* (the
   same shared prompts learned under the **same** convention: overlap without conflict), and
   *duration* (weight divergence with zero conflict, 1→12 epochs).
2. **Functional divergence separated from duration and weight distance:** the duration and compat
   axes span the same weight-divergence and data-volume ranges as the conflict axis, at ~zero merge
   penalty.
3. **Operational epistasis, pre-merge:** confidence-weighted bilateral disagreement on a probe mix
   drawn blind to where the conflict lives — the theory's point being that raw disagreement counts
   harmless *complementation* (one parent ignorant) as conflict, while the Dobzhansky–Muller
   structure is *bilateral confident contradiction*.
4. **Against existing predictors:** gradient alignment at the shared base, LoRA-delta cosine and L2
   (computed exactly), and a performance-based (cross-family accuracy) baseline.
5. **Operator choice under matched budgets:** partially — see honest riders.
6. **Held-out tasks, multiple seeds:** yes (fixed tests, 3 training seeds).

**Result.** Against the pre-registered primary outcome (merge penalty = parent potential − merged
achieved, the hybrid-load analogue): functional measures predict (raw disagreement ρ = +0.46,
operational epistasis ρ = +0.45, both p < 0.005); gradient alignment is weakly informative (−0.35);
**both geometry predictors are uninformative** (delta-cosine +0.03, delta-L2 +0.17, n.s.);
performance-based ~0. *Functional conflict, measured before merging, predicts merge failure; weight
divergence does not.*

Two things about how this result was reached that we want on the record:

- **The control that broke our own experiment first.** In the initial two-axis grid, the *best*
  predictor was delta-cosine (ρ = +0.60) — geometry appeared to win. We identified the confound
  (every shared-data pair in that pool was a conflicted pair, so geometry could succeed as a mere
  overlap/volume detector), added the compat control axis, and geometry's correlation collapsed to
  +0.03 while the functional measures held. We report this sequence in the results README rather
  than presenting only the final table.
- **An internal prediction failed, and we say so.** We pre-registered that confidence-weighting
  should beat raw disagreement as a rank predictor. It does not (they are statistically
  indistinguishable at n = 39); the weighting does double the conflict-vs-compat contrast in levels
  (2.0× vs 1.5×). The paper reports the functional-vs-geometric verdict, not a win for the
  refinement.

**Honest riders:** correlations are moderate (|ρ| ≈ 0.45), bounded by the large intrinsic seed
variance of 0.5B weight-averaging (itself now a documented finding); your step 5 (operator choice
under matched budgets) is only partially delivered — the soup-vs-route gap readout is
noise-dominated at this scale; and the whole result is one model family at one scale. The 7B
replication on the HPC cluster is the planned firm-up before we treat this as more than a
small-model demonstration.

## 6. Where we (mildly) push back

Only two places, both narrow. First, on *"the impossibility does not require population genetics"* —
agreed, and now stated; but we would defend the framework's role in the surrounding structure: it
told us *which* pre-merge measurement to make (bilateral confident contradiction rather than raw
disagreement or distance), *which* control to build (complementation ≠ conflict), and *which* null to
pre-register (emergent isolation) — and those choices are what the decisive experiment's outcome
vindicated against the geometry baselines. Second, on *"union preservation risks being built into the
operator's definition"* — the conservation law's content is the exact *failure* of the mean operator
(the 1/K cancellation), not the definitional success of the max operator; we have tried to make the
text carry it that way, with the oracle requirement explicit.

## 7. What we have not done

The full grounded, diversity-preserving multigenerational LLM society (still the stated largest gap);
7B replication of the decisive experiment; an entanglement measure for *real* task pairs (our
epistasis knob is constructed); the operator-choice decision test at usable signal-to-noise; and
ambiguous/overlapping task families where routing stops being trivially easy. These are listed in the
manuscript's open-problems section in this form.

## Changelog

Manuscript revision: commit `58e6c74` (claim-narrowing; all §1–§4 and draft-level items above).
New experiments: `ea051a5` (full-symmetry alignment + emergent null, MLP tier), `5a23dda` (LLM-tier
speciation + multi-seed replication), `287d232` (the decisive experiment + its control axis). The
revised manuscript is `paper/the-evolution-of-sex-for-ai.md`; per-experiment analyses are in
`results/*/README.md`; every figure regenerates from committed artifacts.

We would welcome another pass — in particular on whether the decisive experiment's design and its
riders are stated at the right strength, and on whether the remaining hypothesis labels
(epistasis-cliff and snowball at the neural tier; emergent DMIs) are placed where you would place
them.