Paper-wide rename: the pop-gen construct is "the biological model"; "(exact)" dropped

"Model" now means an AI model everywhere; the Wright-Fisher construct is "the
biological model" throughout (19 occurrences): tier header, section title (now
"The biological model, and where trained learners depart from it"), Table 1
support column ("Exact" -> "Closed form"; "Analytic model" -> "Biological
model"), Results, Discussion, Methods ("Biological-model tier"), and all
figure captions. "Exact" survives only in technical noun phrases (exact-match
verifier, exact oracle, exact equilibrium, exact recovery); the abstract's
"exactly Wright-Fisher" is now "literally Wright-Fisher".

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
This commit is contained in:
Giorgio Gilestro 2026-09-07 13:08:58 +01:00
parent f1970728cf
commit 2d8f661924
7 changed files with 67 additions and 63 deletions

View file

@ -25,8 +25,8 @@ systems whose inheritance, diversity, and compatibility must be managed, and tra
quantitative framework of the evolution of sex. Its starting point, that training on model output is
genetic drift and model collapse its signature, is by now established from several independent
directions; I develop the structure that follows from it. In a minimal
inheritance model that is exactly WrightFisher, and measurably WrightFisher plus estimator bias in
trained networks, I derive and test remedies. Grounding acts as immigration: a real-data fraction
biological model of inheritance that is literally WrightFisher, and measurably WrightFisher plus
estimator bias in trained networks, I derive and test remedies. Grounding acts as immigration: a real-data fraction
far below one retained most equilibrium diversity, with a per-capability observation floor that
makes the rarest knowledge expensive under unstratified sampling. Refitting a child to the mean of
its parents' output distributions cancels the multi-parent gain to first order in the rare-item
@ -93,7 +93,7 @@ problem at a new scale: *continual learning*, the struggle to acquire new abilit
ones (26, 27), transposed from a single network to a population whose members inherit from one
another. Population genetics, I will argue, prices these decisions. Table 1 summarises the
correspondences on which the argument runs. Fig. 1A maps the experimental programme built on
them: the same abstractions tested at three tiers — an exact population-genetic simulator,
them: the same abstractions tested at three tiers — a biological model in simulation,
trained neural networks, and language models — with the sections that follow climbing that ladder.
Fig. 1B draws the shift of perspective the whole transfer rests on: the model ecosystem read not as
a society in space, contemporaries exchanging messages, but as a society in time, generations
@ -101,13 +101,13 @@ coupled by inheritance, recombination, and immigration.
*(FIG:fig1)*
## The minimal model, and where its exactness ends
## The biological model, and where trained learners depart from it
Knowledge is modelled as a distribution `p_t` over `K` discrete items (capabilities, facts, modes of
behaviour), with a fixed true distribution `p*` whose rare tail carries the knowledge most at risk.
One generation is: *draw `n` samples from the parent's distribution, optionally mix in `m` verified
real samples ("grounding", `g = m/(n+m)`), and refit the child*. In this minimal inheritance model the
resampling step *is* the WrightFisher process, population genetics' canonical model of neutral
real samples ("grounding", `g = m/(n+m)`), and refit the child*. This construction is the paper's
*biological model*, deliberately minimal, and its resampling step *is* the WrightFisher process, population genetics' canonical model of neutral
evolution, in which each new generation is a random sample of size `n` from the previous one and
every statistical property of drift follows from that one step. Diversity throughout this paper is
*heterozygosity*, `H = 1 Σ p_i²`: the probability that two random draws differ (one minus a
@ -117,7 +117,8 @@ decay `E[H_t] = H_0(1 1/n)^t`; the exact immigrationdrift equilibrium; th
multi-teacher union) to within 0.5%, and these are standing tests in the codebase, not one-off
checks.
The boundary of the exactness matters, and I measured it rather than assumed it. Real training adds
Where a real learner departs from this model matters, and I measured that boundary rather than
assumed it. Real training adds
approximation, optimisation noise, and inductive bias, and when trained networks are fit against the
exact drift null they deviate in *opposite, architecture-specific* directions: a smoothing recurrent
network resists collapse (keeping spurious variants alive), while a sharpening image generator
@ -131,32 +132,33 @@ of *Muller's ratchet* (28), the mechanism by which lineages that never recombine
the reason non-recombining genomes such as the Y chromosome have shed most of their ancestral genes.
Once every copy of a rare capability is gone from all parents and sources, no recombination can
rebuild it: each such loss is a click of the ratchet, and remedies must act while copies still
survive somewhere (a consequence-level correspondence; the minimal model lacks the ratchet's
survive somewhere (a consequence-level correspondence; the biological model lacks the ratchet's
recurrent-mutation driver).
**Table 1.** The dictionary. Each biological term is introduced in the section that develops it; each
correspondence is stated with the level of support it currently has
(exact = closed form in the minimal model; empirical = measured in trained systems; hypothesis =
(closed form = derived in the biological model and verified against simulation; empirical =
measured in trained systems; hypothesis =
stated with a falsifier, untested or unconfirmed). The full claim-by-claim ledger with assumptions and
known limits is SI Appendix, Table S1.
| Population genetics | Model populations | Support |
|---|---|---|
| Genetic drift in a finite population | Training on finite samples of model output | Exact (minimal model); signs in trained nets; diagnosis conceded to prior work |
| Immigration from a fixed source | Grounding with verified real data | Exact equilibrium; signs in RNN/MLP/VAE/MNIST |
| Genetic drift in a finite population | Training on finite samples of model output | Closed form (biological model); signs in trained nets; diagnosis conceded to prior work |
| Immigration from a fixed source | Grounding with verified real data | Closed-form equilibrium; signs in RNN/MLP/VAE/MNIST |
| Muller's ratchet (asexual decay) | Irreversible arm of model collapse | Correspondence, scoped: applies to unrecoverable loss |
| Recombination / sexual reproduction | Model merging | Empirical at 0.5B7B |
| FisherMuller effect | Merged specialists exceed every parent | Analytic model; replicated in LLMs |
| Outbreeding depression under epistasis | Merging entangled skills harms offspring | Analytic model (NK landscapes); hypothesis at LLM scale |
| Mating systems / population structure | Who merges with whom (breadth of the parent pool) | Analytic model; hypothesis for real populations |
| FisherMuller effect | Merged specialists exceed every parent | Biological model; replicated in LLMs |
| Outbreeding depression under epistasis | Merging entangled skills harms offspring | Biological model (NK landscapes); hypothesis at LLM scale |
| Mating systems / population structure | Who merges with whom (breadth of the parent pool) | Biological model; hypothesis for real populations |
| Reproductive isolation (BDM incompatibilities) | Merge failure from functional conflict | Empirical (MLP + LLM tiers, conflict-associated); emergent form not observed |
| Selection on a fitness function | Verifier-anchored selection ("reality that can say no") | Analytic model (complementary with recombination and diversity in the tested society) |
| Selection on a fitness function | Verifier-anchored selection ("reality that can say no") | Biological model (complementary with recombination and diversity in the tested society) |
## Results
### Grounding is immigration: cheap, with a floor
In the minimal model, grounding from a fixed real source is *immigration* into a drifting population
In the biological model, grounding from a fixed real source is *immigration* into a drifting population
(2931). Immigration is what conservation managers prescribe when a fragmented reserve loses
diversity, and its striking property there is how little is needed — the field's rule of thumb is
that one migrant per generation holds an isolated population's diversity (32). The same economy
@ -178,8 +180,8 @@ still retained across complementary parents* (next section). In trained networks
looked, with two deviations, both traced to the estimator bias above: sharp thresholds soften,
and support-counting metrics decouple from truth (forward-KL is the operative collapse metric for a
smoothing learner). On real images (Fig. 2B), dry self-training collapses a convolutional VAE to one
mode while ~10% grounding holds all thirty (the trained model needs roughly twice the exact-operator
fraction, the measured price of the estimator bias).
mode while ~10% grounding holds all thirty (the trained model needs roughly twice the biological
model's fraction, the measured price of the estimator bias).
*(FIG:fig2)*
@ -204,7 +206,7 @@ reduction from averaging can *reduce* extinction relative to a randomly chosen s
cancellation is a first-order result about rare items, not a universal impossibility; and the
contrasting union operator (keep each item's strongest source, then renormalise, which itself
redistributes mass and presupposes a verifier or oracle to identify the strongest source) increases
expected retention with K in all regimes in the minimal model. The practically important
expected retention with K in all regimes in the biological model. The practically important
operators, *weight averaging* (a nonlinear network's weight-mean does not compute its parents'
output-mean) and *routing among intact specialists* (34) (different storage and inference budgets from a
single child), are its empirical cousins, and the measured bridge is a *headroom rule*, stated qualitatively: in language models,
@ -219,7 +221,7 @@ adaptation: in an asexual population, beneficial variants arising in different i
compete until all but one lineage is lost, whereas recombination assembles them in one offspring,
producing a *genotype* (an individual's combination of variants, one at each *locus*, or position)
fitter than any parent.
In the multi-locus model, sexual merging of decorrelated specialists climbs to the global optimum, a
In the multi-locus biological model, sexual merging of decorrelated specialists climbs to the global optimum, a
genotype no parent held, while the best single parent and the blended average both plateau below
(Fig. 4). In real language models the signature replicates under seed replication: merges of three
LoRA (37) specialists beat every parent overall (decisively at 7B: 0.87 vs 0.77), and on the sharper
@ -282,11 +284,11 @@ separate species (*reproductive isolation*) through BatesonDobzhanskyMulle
changes harmless on their own genetic background but deleterious in combination — the mechanism behind
the mule's sterility and the inviability of many between-species crosses, in which two genomes that
each work perfectly cannot run in the same cell. A merged model is exactly the
exposed hybrid. I built the analytic model (Fig. 7A): hybrid fitness tracks the parents while
exposed hybrid. I built the biological model of the process (Fig. 7A): hybrid fitness tracks the parents while
compatible, then peels off and crashes below the ancestor; the isolation cliff arrives earlier the
denser the incompatibilities; and the incompatibility *count* snowballs quadratically with divergence
(42). Note that a super-linear count does not by itself entail a sharp performance cliff without
the count-to-effect-size link, which the analytic model supplies under its assumptions and any neural
the count-to-effect-size link, which the biological model supplies under its assumptions and any neural
test must establish separately.
In trained networks, the claim must survive a known alternative: merge barriers between independently
@ -382,7 +384,7 @@ conventions on shared circuitry, which is the thing to detect.
for forgetting are this framework's operators writ small. Rehearsal and replay of stored data (26, 27)
is grounded inheritance within one lineage, and the replay fractions the field settled on empirically,
on the order of 1% for instruction tuning (48) and 5% to 25% by distribution-shift strength in
continual pretraining (49), sit where the minimal model's operational threshold lies.
continual pretraining (49), sit where the biological model's operational threshold lies.
*Pseudo-rehearsal*, the replay of a network's own generated samples, proposed as a cure in 1995 (50)
and revived as generative replay (51), is precisely the ungrounded null studied here: immigration from
a drifting source, benign for one hop, compounding over generations, with verifier-filtering (29, 52)
@ -426,7 +428,7 @@ null that bounds it; and the controlled predictive test with its controls. I cla
these measurements and experiments; I do not claim that their outcomes validate a uniquely
population-genetic mechanism, and one refinement it proposed was not supported.
**Limits and open problems.** The demonstrations are deliberately small: exact where small is a virtue,
**Limits and open problems.** The demonstrations are deliberately small: closed-form where small is a virtue,
sign-level and seed-replicated at the language-model tier, on constructed task families with a
trivially separable router and one model lineage (Qwen, 0.5B7B). The composed society has not been
built at language-model scale. The predictive test's next bars, in order of value: generalisation to
@ -470,7 +472,7 @@ paper tested.
## Materials and Methods
**Analytic tier.** Pure NumPy/SciPy WrightFisher simulator over `K`-item distributions (knowledge as
**Biological-model tier.** Pure NumPy/SciPy WrightFisher simulator over `K`-item distributions (knowledge as
`p_t`; Zipf-tailed truth `p*`; driftgroundingrefit generations), extended with a learning kernel
(smoothing/sharpening refit), multi-locus genotypes on additive and Kauffman NK landscapes, n-parent
crossover, and finite-population society loops. All parameters live in per-experiment YAML configs;
@ -480,7 +482,7 @@ equilibrium, closed-form union) to <0.5% and run in CI with 151 further correctn
**Neural tier.** Trained-network experiments realise the same abstractions with an exact oracle:
histogram/RNN/MLP/VAE generators on a synthetic mode universe (the histogram model reduces the harness
exactly to the analytic tier — the bridge gate), and a convolutional VAE on MNIST with a frozen CNN
exactly to the biological model — the bridge gate), and a convolutional VAE on MNIST with a frozen CNN
oracle (98.5% mode accuracy; confusion matrix recorded as the measurement floor). Speciation
experiments fork no-BatchNorm MLPs (78451251210) from a shared base, weight-average, and measure
linear-mode-connectivity error barriers before and after alignment; alignment composes deterministic