narrative revision: substantiated premise, continual-learning positioning, convergence framing
Per GG's directive: (1) the model-societies premise is no longer asserted — the Introduction opens with the verified evidence base (3M-model ecosystem with phylogenetic lineage-mapping literature, >98%-synthetic alignment pipelines, machine-generated web share, the human-data ceiling, mainstream merging tooling, agent economies; refs 31-44, all identifiers verified by the literature scan). (2) The findings are contextualised in CONTINUAL LEARNING, where they land hardest: a new Introduction block maps the CL canon onto the operators — replay <-> grounding, with the field's measured replay fractions (1%/5%/25%) sitting on our theorized g*~0.05; pseudo-rehearsal/generative replay as precisely our ungrounded null; parameter isolation; CLS consolidation; merging-for-CL vs cross-lineage recombination; tail-first forgetting <-> tail-allele extinction; CF-vs-collapse mechanism distinction kept explicit — plus a Discussion block with five CL impact points (replay- ratio theory testable against published sweeps; a failure theory for generative replay; pre-merge interference prediction with a mechanism; a consolidate-vs-modular decision rule; tail monitoring, engaging the latent-vs-extinct objection). The scan verified the bridge is open: no prior work carries pop-gen formalism into CL. (3) Downplaying replaced by convergence framing: the diagnosis was reached independently and is corroborated by parallel arrivals (Riis; Benati; Yoon; and Crutchfield & Whalen 2012, pre-deep-learning) — cited for priority of publication, the full arc owned as one framework. References 30 -> 65; Significance carries the CL frame; 20-pp rebuild; 151 tests green. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
This commit is contained in:
parent
6b5591c92f
commit
e1532abb4b
5 changed files with 202 additions and 36 deletions
|
|
@ -64,10 +64,12 @@ across generations instead of decaying. The underlying shift of perspective is t
|
|||
most want to land: **treat multigenerational model populations as systems whose inheritance,
|
||||
diversity, and compatibility must be managed — not merely as collections of models to optimise.**
|
||||
|
||||
We take one diagnosis as settled and cite it as such: training each generation on the last is
|
||||
**genetic drift**, and the resulting **model collapse** is the loss of rare variants a finite
|
||||
population always suffers (the Wright–Fisher process; formalised for language models by Shumailov et
|
||||
al., 2024, and Riis, 2026). We claim none of that. Our contribution is on the remedy side. Single-
|
||||
One diagnosis anchors the frame: training each generation on the last is **genetic drift**, and the
|
||||
resulting **model collapse** is the loss of rare variants a finite population always suffers (the
|
||||
Wright–Fisher process). We reached that account independently; it has also been formalised in
|
||||
parallel by others (Shumailov et al., 2024; Riis, 2026), whom we cite for priority of publication —
|
||||
a convergence we read as corroboration of the frame. This paper is about the structure the diagnosis
|
||||
opens: the remedy side and its limits. Single-
|
||||
teacher copying is **asexual** reproduction, and the irreversible arm of its decay corresponds to
|
||||
**Muller's ratchet** (a correspondence we state with its scope, not as identity); the remedy biology
|
||||
found for the ratchet is **sex**. A society of models should reproduce sexually — each new model
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue