typography: remove bold-for-emphasis from the main text (PNAS convention)

All 48 in-text bold spans converted: term first-introductions to italics
(model merging, genetic drift, continual learning, Fisher-Muller effect,
outbreeding depression, directed sex, grounded inheritance/evaluation,
and kin), pure-emphasis spans to plain text (the organising-claim
sentence, the emergent-null statements, the supported-conclusion
sentence). Bold retained only where PNAS uses it: run-in paragraph
headings (Design rules. / Analytic tier. / etc.), table labels, and
reference volume numbers. Repeat mentions of first-use-italicised terms
de-italicised (italics at first use only). 18-pp rebuild clean.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
This commit is contained in:
Giorgio Gilestro 2026-09-07 09:13:30 +01:00
parent 96902e87f0
commit aaa146863f
3 changed files with 69 additions and 69 deletions

View file

@ -47,7 +47,7 @@ millions of models (Hugging Face alone grew past three million by 2026), and the
independent creations: the overwhelming majority are fine-tunes, distillations, or merges of a small
number of foundation models, forming large family trees whose lineage structure, inherited traits,
and mutation dynamics are already being mapped with explicitly phylogenetic methods (13).
This population also reproduces. Weight-space **model merging**, the direct combination of trained
This population also reproduces. Weight-space *model merging*, the direct combination of trained
parents into a new model, is mainstream community practice with standard tooling and thousands of
hybrid checkpoints, including leaderboard-topping ones (47), and the engineering literature
describes it in evolutionary vocabulary: "crossover," "mutation," "mate choice," populations of
@ -62,14 +62,14 @@ exhausted by frontier training within this decade (16). Meanwhile persistent mul
emerging agent economies put many interacting models into sustained contact (1720). A population
whose members inherit from one another, recombine, and retransmit under these conditions is an
evolving population in the technical sense. The claim of this paper is that the vocabulary should be
given its mathematics: **multigenerational model populations are systems whose inheritance,
given its mathematics: multigenerational model populations are systems whose inheritance,
diversity, and compatibility must be managed, not merely collections of models to optimise, and the
branch of biology that studies exactly this problem, the population genetics of the evolution of sex,
transfers as a quantitative framework.**
transfers as a quantitative framework.
The frame's entry point is the diagnosis. Training each generation of a model on the previous
generation's output degrades it (*model collapse*): rare capabilities vanish first and the lineage
drifts toward its own most common behaviour (21). That this is the mathematics of **genetic drift** in
drifts toward its own most common behaviour (21). That this is the mathematics of *genetic drift* in
a finite population is a conclusion we reached independently in building the present framework, and
one that has been derived in parallel from several other directions (2224), including a closed-form
first-extinction law placing collapse onset at the WrightFisher first-extinction time (23), and that
@ -82,22 +82,22 @@ recombination, selection, population structure) to its limit (reproductive isola
framework from closed forms to trained networks to language models.
In machine learning's own terms, the problem this frame addresses is the field's oldest,
**continual learning**, reappearing one level up. Within a single network, sequential learning
*continual learning*, reappearing one level up. Within a single network, sequential learning
overwrites prior knowledge (catastrophic forgetting; 26, 27), and the discipline's remedies are, one
by one, the population operators of this paper in single-model form: **rehearsal and replay** of past
by one, the population operators of this paper in single-model form: *rehearsal and replay* of past
data is grounding's within-lineage counterpart, and the field's empirically settled replay fractions,
on the order of 1% for instruction tuning (28) and 5% to 25% by distribution-shift strength in
continual pretraining (29), sit where the minimal model's operational grounding threshold lies, a
correspondence for which the framework supplies the missing theory (equilibrium diversity, and a
per-capability survival law). **Pseudo-rehearsal**, the replay of the network's own generated
per-capability survival law). *Pseudo-rehearsal*, the replay of the network's own generated
samples, proposed as a cure in 1995 (30) and revived as generative replay (31), is this paper's
ungrounded null: immigration from a drifting source, benign for one hop and compounding into
collapse over generations; verifier-filtering (32, 33) converts it back into grounding.
**Parameter isolation** (34, and frozen-base adapters, which forget far less; 35) is the engineered
decorrelation our specialists use; **complementary-learning-systems consolidation** (3638) is our
periodic adapter-into-base merge; the recent turn to **merging as a continual-learning mechanism**
*Parameter isolation* (34, and frozen-base adapters, which forget far less; 35) is the engineered
decorrelation our specialists use; *complementary-learning-systems consolidation* (3638) is our
periodic adapter-into-base merge; the recent turn to *merging as a continual-learning mechanism*
(3942) applies recombination within one lineage over time, where we apply it across lineages; and
the observation that **rare examples and long-tail knowledge are forgotten first** (4345) is
the observation that rare examples and long-tail knowledge are forgotten first (4345) is
tail-allele extinction observed one model at a time. One distinction is kept explicit throughout:
catastrophic forgetting is largely deterministic interference from shifted training, whereas collapse
is stochastic sampling drift; the two phenomena share their victims, the rare, and their remedies, but not their mechanism. To our knowledge, no prior work carries population-genetic formalism into continual
@ -105,36 +105,36 @@ learning itself; that bridge (replay as immigration with a survival law, merging
compatibility criterion, consolidation as the slow store of a two-speed memory) is where this
framework may matter most.
We are explicit about what kind of contribution each claim is, distinguishing **interpretation** (an existing result understood in population-genetic terms),
**explanation** (the transferred mechanism accounts for observations existing accounts leave open),
and **prediction** (the framework forecasts an unmeasured outcome). The paper is strongest on the
We are explicit about what kind of contribution each claim is, distinguishing *interpretation* (an existing result understood in population-genetic terms),
*explanation* (the transferred mechanism accounts for observations existing accounts leave open),
and *prediction* (the framework forecasts an unmeasured outcome). The paper is strongest on the
first; makes concrete progress on the second (separating merge failures that are coordinate artefacts
from those that are functional); and reports a first, bounded step on the third: a controlled
predictive test in which pre-merge functional-disagreement measures, chosen by the framework,
predicted merge damage on a constructed task grid while the tested weight-geometry baselines showed
no detectable association.
The correspondences we develop, summarised in Table 1: single-teacher retraining is **asexual
reproduction**, and the irreversible arm of its decay shares the defining consequence of **Muller's
ratchet** (46): once every copy of a rare capability is gone from all parents and sources, no
The correspondences we develop, summarised in Table 1: single-teacher retraining is *asexual
reproduction*, and the irreversible arm of its decay shares the defining consequence of *Muller's
ratchet* (46): once every copy of a rare capability is gone from all parents and sources, no
recombination can rebuild it, which is why remedies must act before fixation-by-loss (a consequence-
level correspondence: the minimal model lacks the ratchet's recurrent deleterious-mutation mechanism,
so irreversible loss alone does not identify that specific mechanism). Injecting verified real data is
**immigration** from a non-drifting source (32, 47, 48). Model merging is **recombination**, and its
central payoff, a merged model exceeding every parent, is the **FisherMuller effect** (49, 50).
Merging entangled skills courts **outbreeding depression**; screening many candidate merges is
*immigration* from a non-drifting source (32, 47, 48). Model merging is *recombination*, and its
central payoff, a merged model exceeding every parent, is the *FisherMuller effect* (49, 50).
Merging entangled skills courts *outbreeding depression*; screening many candidate merges is
engineered recombination with unusually flexible parent choice and pre-deployment screening (we use
the shorthand **directed sex**); restricting who merges with whom is **population structure**. Merging's hard limit, models too diverged in function to combine, is **reproductive
isolation**, for which the BatesonDobzhanskyMuller theory of incompatibilities (51, 52) supplies the
the shorthand *directed sex*); restricting who merges with whom is *population structure*. Merging's hard limit, models too diverged in function to combine, is *reproductive
isolation*, for which the BatesonDobzhanskyMuller theory of incompatibilities (51, 52) supplies the
structure. The nearest precursor to this programme reads sex as an algorithm for mixability in the
theory of computation (53), pre-dating model merging; the model-merging literature itself has strong
empirical operators (4, 54, 55) and emerging merge-success predictors (56, 57), to which our delta is
mechanism: *when and why* failure is coordinate versus functional, and what moves the boundary.
We support the framework at three tiers of evidence, in ascending realism and descending exactness: a
**minimal analytic model** validated against closed forms to a fraction of a percent; **small trained
networks** (MLPs, recurrent networks, an MNIST image generator) where the operators are measured in
real weights; and **language models** (LoRA-specialised Qwen models, 0.5B locally and 7B on a compute
*minimal analytic model* validated against closed forms to a fraction of a percent; *small trained
networks* (MLPs, recurrent networks, an MNIST image generator) where the operators are measured in
real weights; and *language models* (LoRA-specialised Qwen models, 0.5B locally and 7B on a compute
cluster) where the claims are tested as signs under seed replication. Negative results are reported with the same prominence as confirmations; they include the failure of
an internal pre-registered prediction, a null on emergent speciation that bounds the analogy, and the
sensitivity analyses on the predictive test.
@ -145,7 +145,7 @@ Knowledge is modelled as a distribution `p_t` over `K` discrete items (capabilit
behaviour), with a fixed true distribution `p*` whose rare tail carries the knowledge most at risk.
One generation is: *draw `n` samples from the parent's distribution, optionally mix in `m` verified
real samples ("grounding", `g = m/(n+m)`), and refit the child*. In this minimal inheritance model the
resampling step **is** the WrightFisher process: the same equations, which we exploit as an
resampling step *is* the WrightFisher process: the same equations, which we exploit as an
engineering gate: our simulator reproduces the classical closed forms (heterozygosity decay
`E[H_t] = H_0(1 1/n)^t`; the exact immigrationdrift equilibrium; the closed-form multi-teacher
union) to within 0.5%, and these are standing tests in the codebase, not one-off checks.
@ -154,7 +154,7 @@ The boundary of the exactness matters, and we measured it rather than assumed it
approximation, optimisation noise, and inductive bias, and when trained networks are fit against the
exact drift null they deviate in *opposite, architecture-specific* directions: a smoothing recurrent
network resists collapse (keeping spurious variants alive), while a sharpening image generator
accelerates it. A one-parameter **learning kernel** (a smoothing knob and a sharpening knob on the
accelerates it. A one-parameter *learning kernel* (a smoothing knob and a sharpening knob on the
refit) reproduces both. Throughout, a real learner is therefore treated as WrightFisher *plus a signed, measurable
estimator bias*, and the drift signs (rare-first loss; the grounding response)
survived that bias in every architecture we tested, including a convolutional VAE retrained on its own
@ -222,16 +222,16 @@ cancellation is a first-order result about rare items, not a universal impossibi
contrasting union operator (keep each item's strongest source, then renormalise, which itself
redistributes mass and presupposes a verifier or oracle to identify the strongest source) increases
expected retention with K in all regimes in the minimal model. The practically important
operators, **weight averaging** (a nonlinear network's weight-mean does not compute its parents'
output-mean) and **routing among intact specialists** (58) (different storage and inference budgets from a
single child), are its empirical cousins, and the measured bridge is a **headroom rule**, stated qualitatively: in language models,
operators, *weight averaging* (a nonlinear network's weight-mean does not compute its parents'
output-mean) and *routing among intact specialists* (58) (different storage and inference budgets from a
single child), are its empirical cousins, and the measured bridge is a *headroom rule*, stated qualitatively: in language models,
union-preserving operators beat the weight-average where that average falls short of attainable
performance, and add nothing where it does not (easy-versus-hard contrasts at two scales; a
quantitative form of the relationship is untested). On easy tasks a capable base's average is already at ceiling and refinements
add nothing; on hard tasks the average dilutes a fragile specialist below even the best single parent
and routing wins by a wide margin (Fig. 6AB).
The generative payoff is the **FisherMuller effect**: recombination assembles, in one offspring,
The generative payoff is the FisherMuller effect: recombination assembles, in one offspring,
complementary variants that arose in different lineages, producing a genotype fitter than any parent.
In the multi-locus model, sexual merging of decorrelated specialists climbs to the global optimum, a
genotype no parent held, while the best single parent and the blended average both plateau below
@ -241,10 +241,10 @@ worst-family metric the merged models are the only ones competent everywhere, in
Sex has risks and, for AI, an unfair advantage, both quantified on rugged (epistatic) NK landscapes (60)
(Fig. 3). When skills are entangled, blind recombination produces offspring *below* their parents
(**outbreeding depression**), worsening with ruggedness, and the optimal recombination rate shrinks as
(outbreeding depression), worsening with ruggedness, and the optimal recombination rate shrinks as
entanglement grows. But an engineered population can do what biology cannot: recombine unbounded
parents, choose complementary mates, and *screen many candidate offspring against a verifier before
keeping one*. This **directed sex** converts the outbreeding catastrophe into a reliable gain in the
keeping one*. This directed sex converts the outbreeding catastrophe into a reliable gain in the
model (tracking or exceeding the best parent at every ruggedness) and replicates as a sign in language
models: bred-and-screened merges beat the a-priori blend in every seed on headroom tasks, including
one seed where the blend failed catastrophically and selection was immune (Fig. 6A). Finally,
@ -261,8 +261,8 @@ structured-population search, mapped onto merging populations.
### The society: grounding, recombination, and diversity make complementary contributions
Composing the operators (Fig. 4) requires one definitional distinction first. In the inheritance
model, grounding is **grounded inheritance**: external samples added to the reproduction process (the
data channel). In the society model, grounding is **grounded evaluation**: selection weights true
model, grounding is *grounded inheritance*: external samples added to the reproduction process (the
data channel). In the society model, grounding is *grounded evaluation*: selection weights true
fitness against conformity to the population's own consensus, `g`·true-fitness + (1g)·conformity,
the analogue of scoring models by the crowd's approval (the fitness channel). These are related design
ideas, since both couple the lineage to a non-drifting external signal, but they are different operators,
@ -281,7 +281,7 @@ language-model scale this composed loop remains unbuilt; it is the paper's large
### The limit of sex: model speciation
Recombination presupposes compatible parents. In biology, lineages pushed far enough apart become
separate species (**reproductive isolation**) through BatesonDobzhanskyMuller incompatibilities:
separate species (reproductive isolation) through BatesonDobzhanskyMuller incompatibilities:
changes harmless on their own background but deleterious in combination. A merged model is exactly the
exposed hybrid. We built the analytic model (Fig. 5A): hybrid fitness tracks the parents while
compatible, then peels off and crashes below the ancestor; the isolation cliff arrives earlier the
@ -307,17 +307,17 @@ information-theoretic (no single model can satisfy contradictory conventions; SI
Proposition S2), with the framework's role being the *structure around it*: which divergences
generate conflict, and what moves the cliff.
The strongest constraint comes from the pre-registered **emergent test**: true BDM incompatibilities are
The strongest constraint comes from the pre-registered *emergent test*: true BDM incompatibilities are
emergent (each lineage's changes harmless alone), so we let children diverge with *no conflicting
signal anywhere*, using complementary class specialists and divergent input conventions, to 6.4× the base
training. **No isolation emerged** (residual 0.000 throughout); instead the merge *rescued* the two
training. No isolation emerged (residual 0.000 throughout); instead the merge *rescued* the two
catastrophically-forgetting specialists (parents ≈ 0.50, merge ≈ 0.955, a sustained FisherMuller
rescue). The same double result appears at the language-model tier (Fig. 5 E and F): conflicting conventions
produce **function-specific** hybrid breakdown (the merge scores below both parents on the conflicted
produce *function-specific* hybrid breakdown (the merge scores below both parents on the conflicted
function, while a budget-controlled design shows the disjoint skills merge unharmed), and over-training
disjoint specialists 1→12 epochs (cf. the merging literature's expert-duration effect; 65) produces
no isolation at all — the merge improves. Across every tier
tested, **isolation had to be provoked by functional conflict; specialisation alone did not speciate**
tested, isolation had to be provoked by functional conflict; specialisation alone did not speciate
— a bound on the analogy that sharpens the design rule: what breaks merging is conflicting conventions
on shared circuitry, not divergence per se.
@ -331,8 +331,8 @@ so inference is condition-clustered, and because shared seeds also couple rows *
report per-seed and leave-one-seed-out sensitivity alongside) span three axes decorrelated by construction: *conflict*
(contradictory conventions on shared prompts, private budgets fixed), *compatible overlap* (the same
shared prompts under the same convention — overlap and volume without conflict), and *duration* (weight
divergence with zero conflict). Before merging, six predictors are computed: **confidence-weighted
functional conflict** (bilateral confident disagreement on probes drawn blind to where conflict lives —
divergence with zero conflict). Before merging, six predictors are computed: *confidence-weighted
functional conflict* (bilateral confident disagreement on probes drawn blind to where conflict lives —
a proposed proxy for merge-relevant interactions, motivated by the observation that raw disagreement
counts harmless complementation, one parent merely ignorant, as conflict), raw disagreement, gradient
alignment at the shared base (56), LoRA-delta cosine and distance, and a cross-task performance
@ -340,10 +340,10 @@ baseline. The pre-registered outcome is the merge penalty against oracle parent
hybrid-load analogue), also reported against best- and mean-parent references because the predictor
ordering is sensitive to that choice.
The supported conclusion, stated conditionally: **across this controlled grid, pre-merge functional
The supported conclusion, stated conditionally: across this controlled grid, pre-merge functional
disagreement predicted merge penalties (clustered bootstrap CIs excluding zero; held-out
leave-one-condition-out ρ ≈ 0.350.40), whereas LoRA-delta cosine and L2 showed no statistically
detectable association; gradient alignment carried intermediate signal.** Head-to-head predictor
detectable association; gradient alignment carried intermediate signal. Head-to-head predictor
differences are not individually significant at this sample size; only these baselines were tested;
and with three seeds, uncertainty about seed generalisation remains substantial — though the seed
sensitivity favours the functional measures (per-seed ρ stable at +0.37 to +0.53 in each seed alone,
@ -351,7 +351,7 @@ geometry ≈ 0 in every seed, gradient alignment seed-unstable at 0.11 to
bound the claim: the initial two-axis grid's best predictor
was delta-cosine (ρ = +0.60) — an overlap artefact that the compatible-overlap control was added to
expose, and did (collapse to +0.03); and the pre-registered internal prediction that confidence
weighting would beat raw disagreement **failed** (they are statistically indistinguishable as rank
weighting would beat raw disagreement *failed* (they are statistically indistinguishable as rank
predictors), so the present evidence favours functional disagreement generally, not the DMI-specific
refinement. The framework motivated the measurement and the controls; their success does not validate
the specifically population-genetic mechanism. Whether the prediction improves a budget-matched
@ -393,19 +393,19 @@ evidence of incompatibility* — in every regime we tested, what broke merging w
conventions on shared circuitry, which is the thing to detect.
**What this offers continual learning.** Read into the field where these results most directly land:
(i) a first-principles account of the **replay ratio**: the field's constants (≈1%, 5%, 25%; 28, 29)
(i) a first-principles account of the *replay ratio*: the field's constants (≈1%, 5%, 25%; 28, 29)
acquire an equilibrium theory and a sharper prediction, that the required fraction is set by the
rarest capability one refuses to lose (the `1 e^{m·p}` law) rather than by average loss, which is
testable against published replay sweeps; (ii) a **failure theory for generative replay**:
testable against published replay sweeps; (ii) a *failure theory for generative replay*:
self-generated rehearsal is safe for short horizons and compounds into collapse across generations
unless verifier-filtered back into grounding (3033); (iii) **pre-merge interference
prediction with a mechanism**: where the current state of the art fits regressions over candidate
unless verifier-filtered back into grounding (3033); (iii) *pre-merge interference
prediction with a mechanism*: where the current state of the art fits regressions over candidate
metrics (56), the functional-conflict measure arrives at a convergent signal from principle and comes
with an operator prescription — when conflict is high, do not average; route or breed-and-screen;
(iv) a candidate **decision rule for the consolidate-versus-stay-modular question** that currently
(iv) a candidate *decision rule for the consolidate-versus-stay-modular question* that currently
splits the field's practice (keep adapters separate vs merge them; 5458): union-preserving operators
where headroom exists, fusion where the base composes, consolidation as the slow-store step; and (v)
**tail monitoring as the leading indicator**: continual-learning evaluation that averages over
*tail monitoring as the leading indicator*: continual-learning evaluation that averages over
capabilities hides exactly the losses that drift theory says come first and, past a threshold, become
irreversible. On that last point we note the standing objection that apparent forgetting can be
skewed task-inference over latent capability rather than erasure (66); our irreversibility results