paper: response to the external review + the last outstanding fix
paper/response-to-review.md: point-by-point response covering the claim-narrowing revision (interpretation/explanation/prediction ladder, drift/ratchet scoping, merge-operator boundaries, speciation scope block, the claims table, control-theory->framework, the three supporting overstatements) and the new experiments run in answer to the review — full-symmetry alignment, the pre-registered emergent null, LLM-tier speciation, multi-seed replication, and the decisive epistasis-predicts experiment with its control axis and its honestly-failed internal prediction. Two mild push-backs stated; open items listed; invites another iteration. Also fixes the one §4 review point not yet addressed in the text: §11's "unbounded growth of capability" close is rewritten — the architecture removes the STORAGE obstacle to indefinite accumulation; that is bookkeeping, not a demonstration of unbounded capability growth. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
This commit is contained in:
parent
287d2326cc
commit
1ae950cb7c
2 changed files with 231 additions and 3 deletions
224
paper/response-to-review.md
Normal file
224
paper/response-to-review.md
Normal file
|
|
@ -0,0 +1,224 @@
|
|||
# Response to the external review
|
||||
|
||||
*Re: "The Evolution of Sex for Artificial Intelligence" (draft reviewed August 2026). This response
|
||||
accompanies a revised manuscript and a set of new experiments run directly in answer to the review.
|
||||
All results referenced here are committed, reproducible artifacts (configs, seeds, figures, and
|
||||
per-experiment READMEs in the repository); commit-level pointers are listed at the end.*
|
||||
|
||||
---
|
||||
|
||||
Thank you for this review. It is the most useful reading the manuscript has had: it does not dispute
|
||||
the programme, it disputes the *calibration* — and its central instrument, the distinction between
|
||||
**interpretation, explanation, and prediction**, is exactly the right one. We have acted on it in two
|
||||
ways: we revised the manuscript to claim only what the evidence supports, and we **ran the decisive
|
||||
experiment the review proposed** (§5 of the review), together with four supporting experiments. The
|
||||
short version of this letter: we accepted nearly everything, the manuscript is narrower and better for
|
||||
it, and the prediction rung of your ladder — the one the draft "was not yet convincing on" — has now
|
||||
been climbed at the small-model tier, with the falsifiers pre-registered and one internal prediction
|
||||
honestly reported as unconfirmed.
|
||||
|
||||
## 1. The overall take, and the framing
|
||||
|
||||
> *"The strongest idea is … treat multigenerational model populations as systems whose inheritance,
|
||||
> diversity, and compatibility must be managed—not merely as collections of models to optimise."*
|
||||
|
||||
Adopted, verbatim, as the stated core contribution — it now closes the abstract's first paragraph and
|
||||
anchors §1. You articulated our thesis better than we had; we have taken the sentence with attribution
|
||||
to the review process rather than pretend we wrote it first.
|
||||
|
||||
> *"The draft sometimes treats a useful biological correspondence as a mathematical identity, and an
|
||||
> illustrative experiment as confirmation of a general mechanism."*
|
||||
|
||||
Accepted. This was the review's most consequential criticism and drove most of the textual changes
|
||||
below.
|
||||
|
||||
## 2. Novelty: interpretation / explanation / prediction
|
||||
|
||||
The ladder is now explicit in §1: we state which of our claims are interpretation (merged offspring
|
||||
as Fisher–Muller), which are explanation (the coordinate-vs-functional decomposition of merge
|
||||
failure), and which are prediction. The priority-dispute language — "nobody has," "none imports,"
|
||||
"the theory the tinkering has outrun" — has been removed entirely, replaced with "to our knowledge"
|
||||
and positive statements of what population genetics contributes. Merge-success *prediction* is now
|
||||
explicitly conceded as an occupied area (interpretable pairwise metrics; capacity/rate-distortion
|
||||
accounts), with our delta stated as mechanism, not existence.
|
||||
|
||||
And the prediction rung is no longer only proposed — see §7 below.
|
||||
|
||||
## 3A. Drift, Muller's ratchet, and model collapse
|
||||
|
||||
Accepted in full. The manuscript now says: the *minimal inheritance model* is exactly Wright–Fisher;
|
||||
a real learner is Wright–Fisher **plus a signed, architecture-specific estimator-bias operator** — and
|
||||
we cite our own learning-kernel measurement against ourselves (the smoothing RNN resists collapse,
|
||||
the sharpening VAE accelerates it; the drift *signs* survive in every architecture tested). Muller's
|
||||
ratchet is scoped to the **irreversible arm** of collapse — the capabilities that, once lost from
|
||||
every parent and source, no recombination can rebuild — with your implication stated as the reason
|
||||
the correspondence earns its keep: recombination only reassembles what still survives, so the cure
|
||||
must act before fixation-by-loss. The glossary entries were carrying the same identity overclaims and
|
||||
have been fixed to match.
|
||||
|
||||
## 3B. "Merge, don't average" — the operator boundaries
|
||||
|
||||
Accepted. A dedicated boundary paragraph now answers your five questions in order:
|
||||
|
||||
- **What is conserved?** Expected rare-item mass, at the single-parent level, exact in the minimal
|
||||
model's rare-item regime.
|
||||
- **Under which operator?** Refitting a child to the **mean of the parents' output distributions** —
|
||||
that operator only. The 1/K dilution exactly cancels the K-parent union gain there.
|
||||
- **Weight averaging and routing?** Explicitly labelled *empirical cousins*, not instances: a
|
||||
nonlinear network's weight-mean does not compute its parents' output-mean, and a router keeps K
|
||||
models' storage plus a classifier — a different parameter and inference budget from one fixed-size
|
||||
child. The measured **headroom rule** is presented as the empirical bridge between the exact law
|
||||
and the weight-space operators, which is all it is.
|
||||
- **Does the strongest-source operator need an oracle?** Yes, and the text now says so.
|
||||
- **Capacity?** When parental capabilities cannot coexist in the child's capacity, no operator
|
||||
preserves the union — stated, with an explicit hand-off to the speciation section as the regime
|
||||
where that boundary lives.
|
||||
|
||||
New supporting evidence since the review: the multi-seed replication (below) adds that fusion is not
|
||||
only worse than union-preserving operators where headroom exists — it is far **less reliable**
|
||||
(95% CI ±0.10 across training seeds vs ±0.026 for routing/selection), which we think sharpens the
|
||||
practical half of this claim.
|
||||
|
||||
## 3C. Model speciation
|
||||
|
||||
Accepted, and this section received the most work — textual and experimental.
|
||||
|
||||
**Textual.** A closing block, "What these experiments do and do not establish," now states the
|
||||
supported conclusion at exactly your formulation — *some merge failures reflect incompatible
|
||||
functional requirements rather than a mismatch in coordinates* — and then lists the qualifiers: (i)
|
||||
the conflict-condition impossibility is **information-theoretic and needs no population genetics**
|
||||
(now also a formal SI proposition: endpoints and chord are invariant under any function-preserving
|
||||
transformation, and any single merged model errs at rate ≥ μ(S)/2 against at least one parent); what
|
||||
the genetic frame adds is locating *which divergences generate such conflicts*; (ii) the
|
||||
epistasis-positions-the-cliff claim and the snowball are labelled **hypotheses at the neural tier**,
|
||||
verified only in the analytic model; (iii) alignment claims are scoped to the enumerated symmetries
|
||||
of the architecture tested, and "unmergeable" means by aligned linear interpolation — a barrier to
|
||||
that operator does not preclude every recombination method (routing sidesteps it by not blending).
|
||||
Emergent Dobzhansky–Muller incompatibilities are carried as the flagship *hypothesis*, with the
|
||||
regimes where our tests found none stated as bounds.
|
||||
|
||||
**Experimental (new since the review).**
|
||||
|
||||
1. *Alignment under the full symmetry group.* Anticipating the "one control does not prove the
|
||||
optimum over all allowed symmetries" objection — and the 2026 richer-symmetry results — we
|
||||
re-ran the decomposition aligning modulo the **complete** function-preserving unit symmetry group
|
||||
of the ReLU MLP (per-unit positive rescaling ∘ permutation; the aligner provably recovers a
|
||||
permuted-and-rescaled copy exactly). The conflict residual is unchanged (0.502 → 0.497); the
|
||||
independent-init barrier still vanishes (0.001). The cliff now also carries a hybrid-fitness
|
||||
readout: merged accuracy 0.97 → 0.03 with conflict.
|
||||
2. *The emergent test, pre-registered.* Divergent-but-compatible specialists (disjoint classes;
|
||||
shifted-view conventions), out to 6.4× the base training: residual 0.000 everywhere, and the merge
|
||||
*rescues* the two forgetting parents (~0.50 → 0.955). We report this null prominently — you
|
||||
identified the sharper question ("which kinds of specialisation create merge-breaking
|
||||
interactions, and which remain complementary?") and this is its first half of an answer:
|
||||
*specialisation on shared ancestry did not break merging in any regime we tested; imposed
|
||||
functional conflict always did.*
|
||||
3. *The LLM tier.* The same two knobs in 0.5B LoRA children of a frozen base (which pins the
|
||||
coordinate system, so merge failure is functional by construction): conflicting conventions
|
||||
produce **function-specific** hybrid breakdown (merged coherence below both parents; private,
|
||||
disjoint skills unharmed in a budget-controlled design, 3 seeds), and over-training disjoint
|
||||
specialists 1→12 epochs produces **no** emergent isolation (the merge improves, staying above the
|
||||
best parent).
|
||||
|
||||
## 4. Importance, scope, and the supporting overstatements
|
||||
|
||||
- **"Three task families and one seed."** The LLM claims are now multi-seed with fixed test sets:
|
||||
merges beat every specialist with non-overlapping CIs on the sharper metric (5 seeds); union vs
|
||||
fusion and directed-selection vs soup replicated at 3 seeds on the hard benchmark. Three
|
||||
lexically-distinct families remain a stated limitation; the full grounded LLM society remains
|
||||
explicitly unbuilt and is flagged as such.
|
||||
- **Open-ended growth.** Accepted — the §11 closing has been rewritten: the architecture removes the
|
||||
*storage* obstacle to indefinite accumulation; that is bookkeeping, not a demonstration of
|
||||
unbounded capability growth, which our deliberately finite models do not test.
|
||||
- **Frozen base ≠ unchanged behaviour** — fixed (§3 now guarantees a recoverable core, not
|
||||
unchanging conduct).
|
||||
- **Baldwin effect** — now an *echo*, with the mechanism difference stated (selection for genetic
|
||||
assimilation vs direct distillation).
|
||||
- **Consolidation and the archive** — fixed: a digital system can and should keep every ancestor;
|
||||
the irreversibility is *operational* (nothing in the production loop consults the archive by
|
||||
default), and the safeguard now includes an audit that diffs against the archived ancestor.
|
||||
- **"Control theory" → "framework"** throughout, subtitle included.
|
||||
- **The claim–assumptions–evidence–limitation table** is in §13 ("The claims at a glance"), ten rows,
|
||||
each labelled exact / empirical / hypothesis with known limits.
|
||||
|
||||
## 5. The decisive experiment — run
|
||||
|
||||
We implemented your six-step design as specified, at the 0.5B tier (39 parent pairs, 3 seeds, fixed
|
||||
held-out test sets, falsifiers pre-registered in the config before running):
|
||||
|
||||
1. **Controlled interaction structure:** three axes decorrelated by construction — *conflict*
|
||||
(contradictory conventions on shared ambiguous prompts, private budgets fixed), *compat* (the
|
||||
same shared prompts learned under the **same** convention: overlap without conflict), and
|
||||
*duration* (weight divergence with zero conflict, 1→12 epochs).
|
||||
2. **Functional divergence separated from duration and weight distance:** the duration and compat
|
||||
axes span the same weight-divergence and data-volume ranges as the conflict axis, at ~zero merge
|
||||
penalty.
|
||||
3. **Operational epistasis, pre-merge:** confidence-weighted bilateral disagreement on a probe mix
|
||||
drawn blind to where the conflict lives — the theory's point being that raw disagreement counts
|
||||
harmless *complementation* (one parent ignorant) as conflict, while the Dobzhansky–Muller
|
||||
structure is *bilateral confident contradiction*.
|
||||
4. **Against existing predictors:** gradient alignment at the shared base, LoRA-delta cosine and L2
|
||||
(computed exactly), and a performance-based (cross-family accuracy) baseline.
|
||||
5. **Operator choice under matched budgets:** partially — see honest riders.
|
||||
6. **Held-out tasks, multiple seeds:** yes (fixed tests, 3 training seeds).
|
||||
|
||||
**Result.** Against the pre-registered primary outcome (merge penalty = parent potential − merged
|
||||
achieved, the hybrid-load analogue): functional measures predict (raw disagreement ρ = +0.46,
|
||||
operational epistasis ρ = +0.45, both p < 0.005); gradient alignment is weakly informative (−0.35);
|
||||
**both geometry predictors are uninformative** (delta-cosine +0.03, delta-L2 +0.17, n.s.);
|
||||
performance-based ~0. *Functional conflict, measured before merging, predicts merge failure; weight
|
||||
divergence does not.*
|
||||
|
||||
Two things about how this result was reached that we want on the record:
|
||||
|
||||
- **The control that broke our own experiment first.** In the initial two-axis grid, the *best*
|
||||
predictor was delta-cosine (ρ = +0.60) — geometry appeared to win. We identified the confound
|
||||
(every shared-data pair in that pool was a conflicted pair, so geometry could succeed as a mere
|
||||
overlap/volume detector), added the compat control axis, and geometry's correlation collapsed to
|
||||
+0.03 while the functional measures held. We report this sequence in the results README rather
|
||||
than presenting only the final table.
|
||||
- **An internal prediction failed, and we say so.** We pre-registered that confidence-weighting
|
||||
should beat raw disagreement as a rank predictor. It does not (they are statistically
|
||||
indistinguishable at n = 39); the weighting does double the conflict-vs-compat contrast in levels
|
||||
(2.0× vs 1.5×). The paper reports the functional-vs-geometric verdict, not a win for the
|
||||
refinement.
|
||||
|
||||
**Honest riders:** correlations are moderate (|ρ| ≈ 0.45), bounded by the large intrinsic seed
|
||||
variance of 0.5B weight-averaging (itself now a documented finding); your step 5 (operator choice
|
||||
under matched budgets) is only partially delivered — the soup-vs-route gap readout is
|
||||
noise-dominated at this scale; and the whole result is one model family at one scale. The 7B
|
||||
replication on the HPC cluster is the planned firm-up before we treat this as more than a
|
||||
small-model demonstration.
|
||||
|
||||
## 6. Where we (mildly) push back
|
||||
|
||||
Only two places, both narrow. First, on *"the impossibility does not require population genetics"* —
|
||||
agreed, and now stated; but we would defend the framework's role in the surrounding structure: it
|
||||
told us *which* pre-merge measurement to make (bilateral confident contradiction rather than raw
|
||||
disagreement or distance), *which* control to build (complementation ≠ conflict), and *which* null to
|
||||
pre-register (emergent isolation) — and those choices are what the decisive experiment's outcome
|
||||
vindicated against the geometry baselines. Second, on *"union preservation risks being built into the
|
||||
operator's definition"* — the conservation law's content is the exact *failure* of the mean operator
|
||||
(the 1/K cancellation), not the definitional success of the max operator; we have tried to make the
|
||||
text carry it that way, with the oracle requirement explicit.
|
||||
|
||||
## 7. What we have not done
|
||||
|
||||
The full grounded, diversity-preserving multigenerational LLM society (still the stated largest gap);
|
||||
7B replication of the decisive experiment; an entanglement measure for *real* task pairs (our
|
||||
epistasis knob is constructed); the operator-choice decision test at usable signal-to-noise; and
|
||||
ambiguous/overlapping task families where routing stops being trivially easy. These are listed in the
|
||||
manuscript's open-problems section in this form.
|
||||
|
||||
## Changelog
|
||||
|
||||
Manuscript revision: commit `58e6c74` (claim-narrowing; all §1–§4 and draft-level items above).
|
||||
New experiments: `ea051a5` (full-symmetry alignment + emergent null, MLP tier), `5a23dda` (LLM-tier
|
||||
speciation + multi-seed replication), `287d232` (the decisive experiment + its control axis). The
|
||||
revised manuscript is `paper/the-evolution-of-sex-for-ai.md`; per-experiment analyses are in
|
||||
`results/*/README.md`; every figure regenerates from committed artifacts.
|
||||
|
||||
We would welcome another pass — in particular on whether the decisive experiment's design and its
|
||||
riders are stated at the right strength, and on whether the remaining hypothesis labels
|
||||
(epistasis-cliff and snowball at the neural tier; emergent DMIs) are placed where you would place
|
||||
them.
|
||||
Loading…
Add table
Add a link
Reference in a new issue