Two insertions answering the editor's implicit questions. Introduction
gains "stated as a problem": the four recurring decisions a model-
population operator cannot currently answer from principle (replay
budget; compose-or-damage; pre-merge detection; separate-vs-consolidate)
and the framework's counterintuitive answers — averaging cancels the
multi-parent benefit exactly in the tail regime; specialisation/
divergence produced no incompatibility anywhere tested while conflicting
conventions always did; weight distance carried no predictive signal
while cheap behavioural disagreement did; and the theory's numbers land
on the replay constants practice converged to independently
(unexpectedness + problem-solved + external check, at reviewer-hardened
calibration). Discussion gains a closing "Outlook: the evolution of
language models": the ecosystem's trajectory is consolidating on exactly
these operators, and the framework's fork is concrete and measurable —
either models stay freely recombinable (one interbreeding population;
levers = per-capability grounding budgets + deliberate diversity) or
long-horizon specialisation at scale begins emergent speciation (a
routed archipelago of diverging lineages), decidable now with the
pre-merge conflict instruments tested here. Design rules tie back to the
posed decisions. 5.2k words, citation invariant intact, 20 pp.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
All 48 in-text bold spans converted: term first-introductions to italics
(model merging, genetic drift, continual learning, Fisher-Muller effect,
outbreeding depression, directed sex, grounded inheritance/evaluation,
and kin), pure-emphasis spans to plain text (the organising-claim
sentence, the emergent-null statements, the supported-conclusion
sentence). Bold retained only where PNAS uses it: run-in paragraph
headings (Design rules. / Analytic tier. / etc.), table labels, and
reference volume numbers. Repeat mentions of first-use-italicised terms
de-italicised (italics at first use only). 18-pp rebuild clean.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
All 66 references renumbered to first-appearance order (programmatically
verified: in-text sequence = 1..66 = list order; ranges expanded,
remapped, recompressed) and rewritten in PNAS style (initials-first
authors with the >5 -> et-al rule, sentence-case titles, abbreviated
italic venues, bold volumes, year-at-end, arXiv [Preprint] + 10.48550
DOIs). Correctness: 47 arXiv ids batch-verified against the arXiv API
(title/first-author/year); caught and fixed an authorless GENOME entry
(Y. Zhang et al.), "Sakana AI" -> J. Abrantes et al., a wrong Kotha id
(2310.05719, a different paper -> 2309.10105), Nemotron's corporate
author, and Liang's truncated title. Also: six load-bearing refs that
lost their in-text anchors during the restructure re-anchored (NK, QD,
Pari, LoRA, Sharma, Kozodoi), one real mis-citation fixed
(Self-Instruct credited to Multiagent-Finetuning; new ref added), and
four figure captions in build.py brought up to third-review calibration
(operational grounding threshold; first-order conservation;
complementary-contributions society; permutation-and-rescaling
alignment). 20-pp rebuild clean.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
PNAS hard limits now met: title 120/135 chars; Significance rewritten to
117/120 words (plain register, carries the CL frame); Abstract rewritten
to 241/250. Style pass over the whole manuscript per GG: em-dashes cut
94 -> 20 in the body (appositives to commas/parentheses, trailing
clauses to colons/semicolons), tic phrases removed (quietly/sprawling/
no-longer-metaphorical/pays-for-itself/deserves-its/whatever-one-thinks/
celebrated/we-think and kin), rhetorical framings flattened to plain
statements. Main text 4,809 words + 456 table words + 65 refs; estimated
~10 PNAS pages with the six composed figures (within the 12-page hard
max; above the 6-page preference — trim options noted in work order).
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
Per GG's directive: (1) the model-societies premise is no longer asserted
— the Introduction opens with the verified evidence base (3M-model
ecosystem with phylogenetic lineage-mapping literature, >98%-synthetic
alignment pipelines, machine-generated web share, the human-data
ceiling, mainstream merging tooling, agent economies; refs 31-44, all
identifiers verified by the literature scan). (2) The findings are
contextualised in CONTINUAL LEARNING, where they land hardest: a new
Introduction block maps the CL canon onto the operators — replay <->
grounding, with the field's measured replay fractions (1%/5%/25%)
sitting on our theorized g*~0.05; pseudo-rehearsal/generative replay as
precisely our ungrounded null; parameter isolation; CLS consolidation;
merging-for-CL vs cross-lineage recombination; tail-first forgetting <->
tail-allele extinction; CF-vs-collapse mechanism distinction kept
explicit — plus a Discussion block with five CL impact points (replay-
ratio theory testable against published sweeps; a failure theory for
generative replay; pre-merge interference prediction with a mechanism; a
consolidate-vs-modular decision rule; tail monitoring, engaging the
latent-vs-extinct objection). The scan verified the bridge is open: no
prior work carries pop-gen formalism into CL. (3) Downplaying replaced
by convergence framing: the diagnosis was reached independently and is
corroborated by parallel arrivals (Riis; Benati; Yoon; and Crutchfield &
Whalen 2012, pre-deep-learning) — cited for priority of publication, the
full arc owned as one framework. References 30 -> 65; Significance
carries the CL frame; 20-pp rebuild; 151 tests green.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
The five priority fixes, in the PNAS draft and propagated to the
long-form document and results documentation:
1. The averaging proposition now proves what it claims: a FIRST-ORDER
cancellation of the multi-parent retention gain under output-mean
inheritance in the rare-item regime (n·p/K << 1), with the convexity
boundary stated (averaging's variance reduction can reduce extinction
outside that regime — the reviewer's argument) and the union
operator's renormalisation + oracle requirement explicit. "Adding
parents cannot help" deleted everywhere.
2. Grounding: g*~=0.05 restated as an operational threshold (equilibrium
smooth in g — no phase transition); m·p floor restated as
1−exp(−m·p) per-batch observation probability with
retention/occupancy/reintroduction distinguished; the deep-tail rule
de-categoricalised (stratified sampling; recombination recovers only
what parents retain).
3. Grounded INHERITANCE (data channel) separated from grounded
EVALUATION (fitness channel) in the society section; retitled to
"complementary contributions"; general joint necessity disclaimed.
Table 1 + v6 ledger updated.
4. Alignment contradiction removed everywhere ("cannot be an alignment
failure" -> the reviewer's formulation); abstract says "remaining
after permutation-and-rescaling alignment"; group = search space,
control recovery != global optimality; "specialisation is merge-safe"
-> "do not treat divergence/specialisation alone as evidence of
incompatibility".
5. Significance headline matched to the bounded evidence; seed-
dependence sensitivity added (per-seed rho stable +0.37..+0.53 for
functional measures, ~0 for geometry, gradient alignment
seed-UNSTABLE −0.11..−0.55 — reported as its own caveat; LOSO ranges
in stats script).
Presentation: review-process meta-language stripped; "exact" reserved
for closed forms ("analytic model" labels); headroom rule qualitative;
directed-sex phrasing per review; ratchet = consequence-level
correspondence; compact results table (Table 2) added. Response letter:
paper/response-to-review-3.md. Both PDFs rebuilt; 151 tests green.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
paper/pnas/main.md — the manuscript restructured as a research article
(~5.6k words main text): significance statement, abstract, introduction
(diagnosis conceded; the management thesis; the interpretation/
explanation/prediction ladder with the prediction rung stated as a
bounded controlled test), the minimal model with its exactness boundary
(learning kernel cited against ourselves), Table 1 dictionary with
per-row support levels, a five-step results ladder (grounding floor;
conservation law + operator boundaries + Fisher-Muller + directed sex +
mating structure; the jointly-necessary society; speciation across three
tiers with the emergent null; the controlled predictive test at
second-review calibration), discussion (design rules, borrowed-vs-ours
ledger, limits with the reviewer's generalisation-before-scale ordering,
what biology gets back), brief methods, 30 references.
build.py composes 6 figures by stacking committed vector PDFs (bespoke
unified re-plots deferred to submission polish); builds clean under
tectonic (15 pp incl. 6 full-page figures). si.md: SI skeleton
(propositions, claims ledger, per-tier methods, statistics, figure
list). Manifesto sections of v6 (institutions, timescales, re-minting)
compressed into Discussion per the plan; v6 remains the long-form
perspective document.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v