paper: response to the external review + the last outstanding fix

paper/response-to-review.md: point-by-point response covering the
claim-narrowing revision (interpretation/explanation/prediction ladder,
drift/ratchet scoping, merge-operator boundaries, speciation scope
block, the claims table, control-theory->framework, the three supporting
overstatements) and the new experiments run in answer to the review —
full-symmetry alignment, the pre-registered emergent null, LLM-tier
speciation, multi-seed replication, and the decisive epistasis-predicts
experiment with its control axis and its honestly-failed internal
prediction. Two mild push-backs stated; open items listed; invites
another iteration.

Also fixes the one §4 review point not yet addressed in the text: §11's
"unbounded growth of capability" close is rewritten — the architecture
removes the STORAGE obstacle to indefinite accumulation; that is
bookkeeping, not a demonstration of unbounded capability growth.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
This commit is contained in:
Giorgio Gilestro 2026-09-06 17:31:36 +01:00
parent 287d2326cc
commit 1ae950cb7c
2 changed files with 231 additions and 3 deletions

224
paper/response-to-review.md Normal file
View file

@ -0,0 +1,224 @@
# Response to the external review
*Re: "The Evolution of Sex for Artificial Intelligence" (draft reviewed August 2026). This response
accompanies a revised manuscript and a set of new experiments run directly in answer to the review.
All results referenced here are committed, reproducible artifacts (configs, seeds, figures, and
per-experiment READMEs in the repository); commit-level pointers are listed at the end.*
---
Thank you for this review. It is the most useful reading the manuscript has had: it does not dispute
the programme, it disputes the *calibration* — and its central instrument, the distinction between
**interpretation, explanation, and prediction**, is exactly the right one. We have acted on it in two
ways: we revised the manuscript to claim only what the evidence supports, and we **ran the decisive
experiment the review proposed** (§5 of the review), together with four supporting experiments. The
short version of this letter: we accepted nearly everything, the manuscript is narrower and better for
it, and the prediction rung of your ladder — the one the draft "was not yet convincing on" — has now
been climbed at the small-model tier, with the falsifiers pre-registered and one internal prediction
honestly reported as unconfirmed.
## 1. The overall take, and the framing
> *"The strongest idea is … treat multigenerational model populations as systems whose inheritance,
> diversity, and compatibility must be managed—not merely as collections of models to optimise."*
Adopted, verbatim, as the stated core contribution — it now closes the abstract's first paragraph and
anchors §1. You articulated our thesis better than we had; we have taken the sentence with attribution
to the review process rather than pretend we wrote it first.
> *"The draft sometimes treats a useful biological correspondence as a mathematical identity, and an
> illustrative experiment as confirmation of a general mechanism."*
Accepted. This was the review's most consequential criticism and drove most of the textual changes
below.
## 2. Novelty: interpretation / explanation / prediction
The ladder is now explicit in §1: we state which of our claims are interpretation (merged offspring
as FisherMuller), which are explanation (the coordinate-vs-functional decomposition of merge
failure), and which are prediction. The priority-dispute language — "nobody has," "none imports,"
"the theory the tinkering has outrun" — has been removed entirely, replaced with "to our knowledge"
and positive statements of what population genetics contributes. Merge-success *prediction* is now
explicitly conceded as an occupied area (interpretable pairwise metrics; capacity/rate-distortion
accounts), with our delta stated as mechanism, not existence.
And the prediction rung is no longer only proposed — see §7 below.
## 3A. Drift, Muller's ratchet, and model collapse
Accepted in full. The manuscript now says: the *minimal inheritance model* is exactly WrightFisher;
a real learner is WrightFisher **plus a signed, architecture-specific estimator-bias operator** — and
we cite our own learning-kernel measurement against ourselves (the smoothing RNN resists collapse,
the sharpening VAE accelerates it; the drift *signs* survive in every architecture tested). Muller's
ratchet is scoped to the **irreversible arm** of collapse — the capabilities that, once lost from
every parent and source, no recombination can rebuild — with your implication stated as the reason
the correspondence earns its keep: recombination only reassembles what still survives, so the cure
must act before fixation-by-loss. The glossary entries were carrying the same identity overclaims and
have been fixed to match.
## 3B. "Merge, don't average" — the operator boundaries
Accepted. A dedicated boundary paragraph now answers your five questions in order:
- **What is conserved?** Expected rare-item mass, at the single-parent level, exact in the minimal
model's rare-item regime.
- **Under which operator?** Refitting a child to the **mean of the parents' output distributions**
that operator only. The 1/K dilution exactly cancels the K-parent union gain there.
- **Weight averaging and routing?** Explicitly labelled *empirical cousins*, not instances: a
nonlinear network's weight-mean does not compute its parents' output-mean, and a router keeps K
models' storage plus a classifier — a different parameter and inference budget from one fixed-size
child. The measured **headroom rule** is presented as the empirical bridge between the exact law
and the weight-space operators, which is all it is.
- **Does the strongest-source operator need an oracle?** Yes, and the text now says so.
- **Capacity?** When parental capabilities cannot coexist in the child's capacity, no operator
preserves the union — stated, with an explicit hand-off to the speciation section as the regime
where that boundary lives.
New supporting evidence since the review: the multi-seed replication (below) adds that fusion is not
only worse than union-preserving operators where headroom exists — it is far **less reliable**
(95% CI ±0.10 across training seeds vs ±0.026 for routing/selection), which we think sharpens the
practical half of this claim.
## 3C. Model speciation
Accepted, and this section received the most work — textual and experimental.
**Textual.** A closing block, "What these experiments do and do not establish," now states the
supported conclusion at exactly your formulation — *some merge failures reflect incompatible
functional requirements rather than a mismatch in coordinates* — and then lists the qualifiers: (i)
the conflict-condition impossibility is **information-theoretic and needs no population genetics**
(now also a formal SI proposition: endpoints and chord are invariant under any function-preserving
transformation, and any single merged model errs at rate ≥ μ(S)/2 against at least one parent); what
the genetic frame adds is locating *which divergences generate such conflicts*; (ii) the
epistasis-positions-the-cliff claim and the snowball are labelled **hypotheses at the neural tier**,
verified only in the analytic model; (iii) alignment claims are scoped to the enumerated symmetries
of the architecture tested, and "unmergeable" means by aligned linear interpolation — a barrier to
that operator does not preclude every recombination method (routing sidesteps it by not blending).
Emergent DobzhanskyMuller incompatibilities are carried as the flagship *hypothesis*, with the
regimes where our tests found none stated as bounds.
**Experimental (new since the review).**
1. *Alignment under the full symmetry group.* Anticipating the "one control does not prove the
optimum over all allowed symmetries" objection — and the 2026 richer-symmetry results — we
re-ran the decomposition aligning modulo the **complete** function-preserving unit symmetry group
of the ReLU MLP (per-unit positive rescaling ∘ permutation; the aligner provably recovers a
permuted-and-rescaled copy exactly). The conflict residual is unchanged (0.502 → 0.497); the
independent-init barrier still vanishes (0.001). The cliff now also carries a hybrid-fitness
readout: merged accuracy 0.97 → 0.03 with conflict.
2. *The emergent test, pre-registered.* Divergent-but-compatible specialists (disjoint classes;
shifted-view conventions), out to 6.4× the base training: residual 0.000 everywhere, and the merge
*rescues* the two forgetting parents (~0.50 → 0.955). We report this null prominently — you
identified the sharper question ("which kinds of specialisation create merge-breaking
interactions, and which remain complementary?") and this is its first half of an answer:
*specialisation on shared ancestry did not break merging in any regime we tested; imposed
functional conflict always did.*
3. *The LLM tier.* The same two knobs in 0.5B LoRA children of a frozen base (which pins the
coordinate system, so merge failure is functional by construction): conflicting conventions
produce **function-specific** hybrid breakdown (merged coherence below both parents; private,
disjoint skills unharmed in a budget-controlled design, 3 seeds), and over-training disjoint
specialists 1→12 epochs produces **no** emergent isolation (the merge improves, staying above the
best parent).
## 4. Importance, scope, and the supporting overstatements
- **"Three task families and one seed."** The LLM claims are now multi-seed with fixed test sets:
merges beat every specialist with non-overlapping CIs on the sharper metric (5 seeds); union vs
fusion and directed-selection vs soup replicated at 3 seeds on the hard benchmark. Three
lexically-distinct families remain a stated limitation; the full grounded LLM society remains
explicitly unbuilt and is flagged as such.
- **Open-ended growth.** Accepted — the §11 closing has been rewritten: the architecture removes the
*storage* obstacle to indefinite accumulation; that is bookkeeping, not a demonstration of
unbounded capability growth, which our deliberately finite models do not test.
- **Frozen base ≠ unchanged behaviour** — fixed (§3 now guarantees a recoverable core, not
unchanging conduct).
- **Baldwin effect** — now an *echo*, with the mechanism difference stated (selection for genetic
assimilation vs direct distillation).
- **Consolidation and the archive** — fixed: a digital system can and should keep every ancestor;
the irreversibility is *operational* (nothing in the production loop consults the archive by
default), and the safeguard now includes an audit that diffs against the archived ancestor.
- **"Control theory" → "framework"** throughout, subtitle included.
- **The claimassumptionsevidencelimitation table** is in §13 ("The claims at a glance"), ten rows,
each labelled exact / empirical / hypothesis with known limits.
## 5. The decisive experiment — run
We implemented your six-step design as specified, at the 0.5B tier (39 parent pairs, 3 seeds, fixed
held-out test sets, falsifiers pre-registered in the config before running):
1. **Controlled interaction structure:** three axes decorrelated by construction — *conflict*
(contradictory conventions on shared ambiguous prompts, private budgets fixed), *compat* (the
same shared prompts learned under the **same** convention: overlap without conflict), and
*duration* (weight divergence with zero conflict, 1→12 epochs).
2. **Functional divergence separated from duration and weight distance:** the duration and compat
axes span the same weight-divergence and data-volume ranges as the conflict axis, at ~zero merge
penalty.
3. **Operational epistasis, pre-merge:** confidence-weighted bilateral disagreement on a probe mix
drawn blind to where the conflict lives — the theory's point being that raw disagreement counts
harmless *complementation* (one parent ignorant) as conflict, while the DobzhanskyMuller
structure is *bilateral confident contradiction*.
4. **Against existing predictors:** gradient alignment at the shared base, LoRA-delta cosine and L2
(computed exactly), and a performance-based (cross-family accuracy) baseline.
5. **Operator choice under matched budgets:** partially — see honest riders.
6. **Held-out tasks, multiple seeds:** yes (fixed tests, 3 training seeds).
**Result.** Against the pre-registered primary outcome (merge penalty = parent potential merged
achieved, the hybrid-load analogue): functional measures predict (raw disagreement ρ = +0.46,
operational epistasis ρ = +0.45, both p < 0.005); gradient alignment is weakly informative (0.35);
**both geometry predictors are uninformative** (delta-cosine +0.03, delta-L2 +0.17, n.s.);
performance-based ~0. *Functional conflict, measured before merging, predicts merge failure; weight
divergence does not.*
Two things about how this result was reached that we want on the record:
- **The control that broke our own experiment first.** In the initial two-axis grid, the *best*
predictor was delta-cosine (ρ = +0.60) — geometry appeared to win. We identified the confound
(every shared-data pair in that pool was a conflicted pair, so geometry could succeed as a mere
overlap/volume detector), added the compat control axis, and geometry's correlation collapsed to
+0.03 while the functional measures held. We report this sequence in the results README rather
than presenting only the final table.
- **An internal prediction failed, and we say so.** We pre-registered that confidence-weighting
should beat raw disagreement as a rank predictor. It does not (they are statistically
indistinguishable at n = 39); the weighting does double the conflict-vs-compat contrast in levels
(2.0× vs 1.5×). The paper reports the functional-vs-geometric verdict, not a win for the
refinement.
**Honest riders:** correlations are moderate (|ρ| ≈ 0.45), bounded by the large intrinsic seed
variance of 0.5B weight-averaging (itself now a documented finding); your step 5 (operator choice
under matched budgets) is only partially delivered — the soup-vs-route gap readout is
noise-dominated at this scale; and the whole result is one model family at one scale. The 7B
replication on the HPC cluster is the planned firm-up before we treat this as more than a
small-model demonstration.
## 6. Where we (mildly) push back
Only two places, both narrow. First, on *"the impossibility does not require population genetics"*
agreed, and now stated; but we would defend the framework's role in the surrounding structure: it
told us *which* pre-merge measurement to make (bilateral confident contradiction rather than raw
disagreement or distance), *which* control to build (complementation ≠ conflict), and *which* null to
pre-register (emergent isolation) — and those choices are what the decisive experiment's outcome
vindicated against the geometry baselines. Second, on *"union preservation risks being built into the
operator's definition"* — the conservation law's content is the exact *failure* of the mean operator
(the 1/K cancellation), not the definitional success of the max operator; we have tried to make the
text carry it that way, with the oracle requirement explicit.
## 7. What we have not done
The full grounded, diversity-preserving multigenerational LLM society (still the stated largest gap);
7B replication of the decisive experiment; an entanglement measure for *real* task pairs (our
epistasis knob is constructed); the operator-choice decision test at usable signal-to-noise; and
ambiguous/overlapping task families where routing stops being trivially easy. These are listed in the
manuscript's open-problems section in this form.
## Changelog
Manuscript revision: commit `58e6c74` (claim-narrowing; all §1§4 and draft-level items above).
New experiments: `ea051a5` (full-symmetry alignment + emergent null, MLP tier), `5a23dda` (LLM-tier
speciation + multi-seed replication), `287d232` (the decisive experiment + its control axis). The
revised manuscript is `paper/the-evolution-of-sex-for-ai.md`; per-experiment analyses are in
`results/*/README.md`; every figure regenerates from committed artifacts.
We would welcome another pass — in particular on whether the decisive experiment's design and its
riders are stated at the right strength, and on whether the remaining hypothesis labels
(epistasis-cliff and snowball at the neural tier; emergent DMIs) are placed where you would place
them.