Layer 1 core: Wright-Fisher knowledge-transmission model with E1-E2

Scaffold plus the Layer 1 analytical core and the first two experiments.

- knowledge/: truth, metrics, teachers (2.7.1 shared-switch construction),
  step, lineage, experiment, config, seeding (imported as `knowledge`).
- Validation spine green: neutral decay (Pred 1), fixation (Pred 2), exact
  mutation-drift equilibrium (Pred 3), union coverage (Pred 5). 68 tests pass.
- E1 reproduces tail-first collapse. E2 delivers the headline: a grounding
  phase boundary g* << 1, with stationary H tracking the exact H_eq closed
  form (g=0.005 -> 68% of truth diversity; g=0.05 -> 96%).
- Reproducibility: uv venv from a hash-pinned uv.lock is the source of truth;
  every run writes results.parquet + resolved_config.yaml + manifest.json
  (lib versions, git commit, sha256). Figures and manifests tracked; the
  large regenerable parquet is gitignored.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
Giorgio Gilestro 2026-07-04 18:10:18 +02:00
commit a6eb9b7512
33 changed files with 4356 additions and 0 deletions

View file

@ -0,0 +1,191 @@
# The Lamarckian Society
### A multigenerational architecture of continual-learning agents that mature, teach, evolve, and pass on what they have learned
*A perspective. Draft 4 — accessible companion to a forthcoming technical paper.*
---
## Abstract
Societies of AI agents are not new. What is new — and what this paper proposes — is a *multigenerational* one: agents that learn continuously through a working life **without catastrophically forgetting**; that have **bounded capacity** and therefore fill; and that, on maturing, become **teachers**, distilling their hard-won knowledge into fresh pupils who form the next generation. Because each generation inherits the *acquired* knowledge of the last, the scheme is frankly **Lamarckian**, and it turns the capacity limit from a defect into a **life cycle**: growth, maturity, reproduction. But content is only the first of two things that are inherited. Each teacher also carries a *rule for what is worth teaching* — and those rules vary, are inherited, and are selected by how well their pupils fare. That second channel is **Darwinian**. The architecture is therefore a dual-inheritance system: Lamarckian in what it transmits, Darwinian in what it keeps. We argue that the learner must be *bounded but non-catastrophic*; that generational transmission is *selective and lossy*, and that this operation is, mechanically, the very one that produces **model collapse** — so that the ratchet climbs rather than degenerates only under two conditions the design must guarantee: that no knowledge is transmitted *dry* (every generational passage is grounded in fresh interaction with the world, region by region), and that each pupil is distilled from **multiple complementary teachers**, a recombination that preserves the independently-retained detail a single lineage would shed. Beyond this, collapse is averted **provided** variety is both supplied — by feeding the society heterodox contributors, not only a consensus elite — and preserved, by selection that rewards diversity as well as fitness; and provided the fitness function which drives the Darwinian channel is anchored to a reality that can *refute*, or the lineage will evolve toward persuasive falsehood rather than truth. The whole cycle is *computationally cheap* because it almost never re-pays for pre-training — the one deliberate exception being the periodic **assimilation** of a proven lineage's acquired knowledge back into the weights of a freshly-minted base, a computational Baldwin effect that lets the society grow without bound by converting hard-won *soft* inheritance into *innate* endowment. The unifying claim: individual learning, generational teaching, cultural accumulation, and the re-minting of the base are one process — the **selective transmission of hard-won knowledge** — running at four nested timescales, with natural selection operating across them.
---
## 1. From multi-agent to multi-generational
The idea of many AI agents cooperating — a "society of mind" (Minsky, 1986), or today's multi-agent systems — is well explored. It arranges intelligence across *space*: several specialists, side by side, dividing a problem. This paper concerns a different and, we think, deeper axis: *time*. Not a society that merely exists, but one that **persists and renews itself across generations**, each standing on the compressed knowledge of the one before.
The unit of novelty is the **generation**, and the event that matters is **succession**: the moment a mature agent, full of a working life's learning, becomes a *teacher* to a freshly-schooled *pupil*. A single mind — human or machine — is mortal and bounded. A lineage is neither. Human civilisation is not clever because any individual is; it is clever because each generation inherits the distilled achievements of the last and adds to them. We propose building AI the same way — and, as we will see, letting the lineage's very *sense of what is worth keeping* evolve under selection.
## 2. The trouble with immortal, frozen models
Today's large language models have no life cycle. They are trained once, in a colossal and costly epoch, then **frozen** and deployed as a fixed artefact that does not learn from those it serves. Learning and doing are severed into two eras with no path between them.
This answers a real problem. Updating a neural network's weights on new information tends to overwrite and destroy what it already knew — **catastrophic forgetting**, understood since the late 1980s (McCloskey & Cohen, 1989; French, 1999). Freezing sidesteps this by refusing to learn at all. The result is a mind with no childhood, no growth, and no way to pass anything on: an immortal that cannot age and therefore cannot have heirs. A lineage needs the opposite — members that learn through their lives, reach maturity, and transmit what they gained. So the first requirement is a learner built to grow safely.
## 3. The learner: bounded, but not catastrophic
The individual agent has two defining properties, both essential to its role in the lineage.
**It does not catastrophically forget.** Rather than overwriting its core as it learns, it keeps that core frozen and *readable* and carves each new specialisation into freshly allocated capacity beside it — a design established in machine learning as *parameter-isolation* (Progressive Networks — Rusu et al., 2016; the prune-and-freeze scheme of PackNet — Mallya & Lazebnik, 2018; adapters and low-rank patches generally). If the core is never altered, forgetting it becomes not merely unlikely but **structurally impossible**. This is what lets an agent accumulate a *coherent working life* of expertise — the kind of stable knowledge worth teaching.
The brain supplies part of the blueprint. Complementary Learning Systems theory (McClelland, McNaughton & O'Reilly, 1995) — itself motivated by the forgetting problem — describes two subsystems at different speeds: a **fast** store (the hippocampus) that grabs an experience in one shot, and a **slow** store (the neocortex) that integrates regularities gradually without disruption. How knowledge actually moves between them is, in our view, genuinely unsettled: the popular account of offline *replay* during sleep (Wilson & McNaughton, 1994) rests on evidence we consider far from conclusive, and we invoke it only as one possibility rather than a load-bearing assumption. Fortunately the architecture needs something weaker and more robust than any particular biological story — merely that *some* periodic **offline consolidation** step exist, moving knowledge down the chain when the system is not busy acting. The machine analogue is then clean regardless of how the brain does it: the prompt is working memory; an external retrieval database is the fast episodic store; the trained weights are the slow semantic store; and consolidation migrates the first into the last. (There is even a mathematical rhyme: modern associative memory is equivalent to the "attention" inside every transformer — Ramsauer et al., 2020 — so retrieval and attention are formally one act.)
**It is bounded.** Because the agent only ever *adds* capacity and freezes what it has, it eventually fills. In most designs this is a wall to dread. In ours it is a clock.
## 4. "Full" is not failure — it is maturity
Here is the pivot on which the architecture turns. A bounded learner that fills up has not broken. **It has grown up.**
Read the capacity limit as a *life stage*. An agent is born as a freshly-schooled base — its general education. It enters a **working life**, carving specialised, non-catastrophic knowledge into itself as it does its job. And it approaches **maturity**: the point at which it has learned much of what a single life in its niche can teach it. That ripeness is not the end of usefulness; it is the signal that the agent is now most worth learning *from*. So maturity triggers **reproduction, in the form of teaching**: the mature agent's knowledge is transmitted — compressed — into a fresh pupil. Growth, maturity, reproduction. The capacity ceiling, the thing every other architecture fights, becomes in ours the metronome of the generations. (Whether an agent must be entirely "full" to teach, or teaches while still maturing so that generations overlap, is an empirical detail we leave open.)
## 5. Succession: teachers, pupils, and Lamarckian inheritance
Transmission works by **distillation**: one or more mature teachers train a new pupil, whose weights come to hold a version of what they knew. A pupil can be taught by *several* teachers at once — a biologist, a chemist, a physicist — and so is born already broader, and (as this section will argue) more *robust*, than any of them: a new, better-educated base from which the next working lives will specialise. That plurality of teachers is not a convenience; it is, we will see, the structural safeguard that keeps inheritance from degenerating.
This inheritance has a precise name. When knowledge *acquired during a life* is passed to the next generation, that is **Lamarckism** — the inheritance of acquired characteristics. Biology forbids it: a giraffe's neck does not lengthen because its parent stretched. Culture is the one arena where acquired characteristics *are* inherited — through teaching, writing, apprenticeship — and that single exception is why cultural evolution outpaces genetic evolution by orders of magnitude. Our society is unashamedly Lamarckian, and that is the source of its power: each generation begins where the last left off, not where the last began.
And it must be *lossy*. A pupil the size of its teachers cannot contain them all; it must compress, and compression is *selective* — it keeps the general and transferable and sheds the idiosyncratic. This is not a defect; it is what education *is*. A student does not absorb everything their teachers know; they inherit the distilled principles, the compressed curriculum, and lose the mass of hard particulars. The textbook is a lossy compression of a field, and more useful than the field's complete archive. The pupil is not a super-mind that knows all its teachers knew; it is a superior *starting point*, destined to be exceeded in each specialty by the working lives that grow from it. The lineage climbs in general knowledge; specialisation is re-earned each generation. This is the **cultural ratchet.**
A blunt objection lands exactly here, and the design must meet it rather than dodge it. Recursively distilling one generation's *outputs* into the next is, mechanically, the very procedure that produces **model collapse** — the degenerative narrowing in which a model trained on its predecessor's projections forgets the improbable, loses the *tail* of the distribution first, and drifts toward its own mode (Shumailov et al., 2024). Worse, our ratchet does not merely risk this as a side-effect: its explicit rule — *keep the general, shed the idiosyncratic***is** tail-deletion by design. The operation that powers the cultural ratchet and the operation that drives model collapse are one and the same act; what separates them is not the mechanism but whether the tail that was shed was genuinely disposable or was thin signal, and whether fresh variety re-enters the lineage faster than compression sheds it. We therefore cannot hold collapse at arm's length as "a synthetic-data problem that does not apply to us." It applies precisely to the stratum that makes this a *multigenerational* paper — the inherited delta, the part not reloaded pristine from the base each generation. Two features of the architecture, working together, are what convert that collapse operation into a ratchet.
The first is that **no knowledge is ever transmitted dry.** Shumailov's collapse is a property of a chain fed *only* its predecessor's output; the documented remedy is that real data kept in the mixture arrests it. In our society that condition is met by construction, because a pupil is never distilled in a vacuum: every generational passage is accompanied by fresh interaction with the world, and — this is the load-bearing detail — the grounding must *overlap the content it protects.* Real samples of a new specialty do not replenish the lost tails of some unrelated inherited region; so knowledge is re-anchored to reality in the same act by which it is inherited, region by region, not merely somewhere in the generation at large. There is no dry inheritance.
The second is that a pupil is distilled from **multiple, complementary teachers**, and this is where the plurality promised above earns its keep. Distillation from a single teacher is an *asexual* copy, and a non-recombining lineage accumulates irreversible error — a **Muller's ratchet** (Muller, 1964), the malign twin of our cultural one. Distillation from several *decorrelated* teachers is **recombination**: because each teacher ground a different region of reality against the world, each retains tails the others lost, and the pupil inherits the *union* of what any teacher kept alive rather than the tail-thinned *average* of a correlated crowd. Independent errors cancel; independently-retained signal survives. The collapse-suppression is exactly proportional to how *unlike* the teachers are — which is why they must be drawn not from the current best (near-identical, clustered around the champion, and so merely averaging toward the mode) but for **complementarity**, precisely the quantity M2N2's niche-pairing already selects for and §7's quality-diversity machinery already maintains. How many teachers a pupil needs, with what spread of expertise, and at what *ratio* of inherited to freshly-grounded information the passage must sit for grounding to outrun contraction — these are the load-bearing quantities of the whole scheme, and modelling where they must fall is the first task of the companion paper.
But this raises the question the rest of the paper must answer. If a teacher can only pass on a *selection* of what it knows — who, or what, decides which of it survives?
## 6. The second inheritance: evolving what is worth teaching
There are two tempting answers, and the first is wrong. We could try to *design* the selection rule — to specify, by hand, which knowledge is worth keeping. But nobody knows that rule. "Keep the general, drop the particular" is a slogan, not an algorithm; the moment you ask *which* generalisations, in *which* domain, at *which* grain, the hand-designed rule fails. This is the deepest hole in the whole scheme, and it cannot be filled by fiat.
The second answer is the one nature used: **do not design the selector — evolve it.** Biology never specified what a brain should encode; it let organisms whose encodings aided survival leave more descendants, and the encoding rules improved *because their carriers won*. We propose the same. Let different teachers carry different rules for what is worth teaching. Let the rules that produce more capable, more successful pupils be inherited and spread; let the rules that produce weak pupils die out with their lineages. The lineage's *taste* — its sense of what matters — is not imposed. It is discovered by selection.
This means **two things are inherited, on two channels.** The *content* passes down Lamarckially: a pupil receives its teachers' acquired knowledge. The *selection rule* — the policy governing what to pass on — is itself inherited, varies between teachers, and is retained in proportion to the success it produces. That second channel is **Darwinian**. So the architecture is not Lamarckian *then* Darwinian, as if the two took turns; it is both at once, at different levels — Lamarckian in *what* it transmits, Darwinian in *what it keeps*. This is exactly the structure evolutionary theorists identify in human culture: dual inheritance (Boyd & Richerson, 1985), Lamarckian in transmission and Darwinian in selection, with the selection rule playing the part of Dawkins's replicator (Dawkins, 1976) and the agents its vehicles.
We are not inventing this picture; we are mechanising a well-supported old one. It is Popper's account of how knowledge actually grows — by conjecture and *refutation*, our hypotheses selected and killed in our stead so that we need not die with them (Popper, 1959); Campbell's evolutionary epistemology (Campbell, 1974); Hull's model of science itself as a literal selection process (Hull, 1988). Understanding, on this view, has always improved the way life did: by variation and differential survival.
And here is the closure that makes it fit the architecture rather than merely decorate it. Darwinian selection needs a *selection pressure* — something that decides which rules win. That pressure was already in the design. What tells a lineage its selection rule was good? The success of its pupils **against reality.** The open loop to a world that can refute (§9) is not only the anti-collapse anchor; it is the **fitness function** that drives the second inheritance. The two axioms of this paper — selective transmission, and openness to reality — turn out to be one mechanism seen from two sides: reality is what selects.
There is even a working, open-source proof that this runs cheaply. Sakana AI's Evolutionary Model Merge uses evolutionary algorithms to discover how best to combine open-weight specialist models — no retraining — and its successor, Model Merging of Natural Niches (M2N2), pairs models by *complementary* strength and can evolve capable models essentially from scratch (Akiba et al., 2024, *Nature Machine Intelligence*). That is a partial instantiation of exactly this idea: evolve the recipe by which specialist teachers are combined into a pupil, on cheap open foundations.
## 7. The danger: fitness is not truth
Introducing selection introduces selection's central hazard, and it is severe enough to sink the scheme if unhandled. Evolution optimises, ruthlessly and without foresight, for exactly what you *measure* — never for what you *meant* (this is Goodhart's law, and its machine-learning form, specification gaming). Get the fitness function slightly wrong and the lineage will evolve to exploit the gap with more ingenuity and less mercy than any designed rule.
For a *knowledge* lineage there is a specific and vicious version of this. In biology, fitness is survival — brutally well-defined. For ideas, the natural fitness is **transmissibility**, and a false-but-persuasive idea transmits beautifully. Human intellectual culture is *full* of highly-fit falsehoods; virality is not truth, and confident nonsense outcompetes hedged accuracy in almost every human forum. Turn Darwinian selection loose on teachers without care and it will evolve a lineage optimised for *persuasiveness* — fluent, compelling, and wrong. That is model collapse with an optimiser behind it, and it is worse than the passive kind, because the system is now actively *seeking* the cliff.
Only one thing makes fitness track truth rather than appeal: **refutation against reality.** Fitness must be predictive success under *intervention* — did the pupil's knowledge let it correctly anticipate what the world would do when acted upon — and not approval, fluency, or a benchmark score, each of which can be gamed. This binds the paper's two axioms tightly: the Darwinian channel is safe *exactly* to the degree the loop stays open to a reality that can say no, and dangerous *exactly* to the degree it closes. Cut the lineage off from intervention and it stops evolving toward truth and starts evolving toward whatever is merely convincing.
The second hazard is convergence, and defeating it takes work at **two distinct levels** — because selection can only ever preserve variety that already exists, so the variety must first be *supplied* and then *kept*. This is the deepest safeguard in the design, and it is worth being explicit that collapse is fought both outside the society and inside it.
The first level is the **input** — who the lineage learns from, and who is allowed to refute it. A society that interacts only with an accredited human elite has a monoculture for a source: the "best" scientists and philosophers are, almost by definition, those who won the consensus, so the incoming variation is narrow from the start, and no selection rule can preserve a diversity that was never there. So the society must engage, from the beginning and by deliberate design, not only with the credentialed best but with the **weirdos, misfits and outliers** — the heterodox, the cross-paradigm, the cross-cultural, the productively wrong. They are not noise to be tolerated; they are the *mutation supply*, the standing variation on which everything downstream operates. In population terms this is the difference between founding stock rich enough to keep adapting and stock so inbred it can only drift toward the mean. Diversity of contributors is not an equity gesture here; it is the raw material of evolution, and without it the second level has nothing to act on.
The second level is the **selection rule itself**. Even given varied input, plain fitness-*maximising* selection converges — it drives every lineage toward the single current best and fixes it, extinguishing the rare specialists and the tails. The resolution exists and is precise: **quality-diversity** selection, which rewards fitness *and* novelty together (novelty search and MAP-Elites — Lehman & Stanley, 2011; Mouret & Clune, 2015), and the niche-based pairing in M2N2, which keeps complementary specialists alive rather than collapsing onto the champion. Such selection does two things at once: it *maintains* the standing variation the first level supplied, and — by actively rewarding the occupation of empty niches — it *re-introduces* variation the lineage had begun to lose. Supply the variety from the human side; preserve and regenerate it on the selection side. Neither level suffices alone. Diverse input with greedy selection still collapses, because selection fixes the winner; clever selection with monoculture input has nothing to preserve. Only both together give a lineage that can keep from converging on its own first guess.
And the two levels meet at the moment of teaching. Multiple-teacher distillation (§5) is the *vehicle* by which the diversity this selection labours to maintain actually **enters** the pupil: a pupil drawn from complementary teachers inherits the standing variation the selector kept alive, recombined into a single new base. So the picture is one machine seen at two moments — supply the variety from the human side, preserve and regenerate it on the selection side, and *recombine* it into each new generation on the transmission side. The anti-collapse safeguard of §5 (don't transmit dry; distil from decorrelated teachers) and the anti-convergence safeguard here (supply and preserve variety) are not two defenses but one, applied at transmission and at selection respectively.
## 8. A society needs institutions, not just specialists
One requirement is easy to overlook and fatal to omit. The easy part of a society is specialisation; Adam Smith described the division of labour in 1776. The *hard* part — which civilisation took millennia to build — is the set of **institutions that let fallible specialists combine without each re-verifying everything**: reputation, replication, credentials, and above all **peer review**. These are error-correction protocols, and they exist because a group of unreliable specialists left to reinforce one another is *more* wrong than any member alone.
This is where current multi-agent AI fails: set several agents to confer and they confabulate in committee and agree sycophantically, because they have all the specialisation and none of the institutions. A multigenerational society must therefore specify not only how agents learn, teach, and are selected, but how they *check* one another — how a claim is challenged and a mistaken teacher loses standing *before* its error is consolidated into a pupil and inherited forever. Note that peer review is itself a fitness function of the kind §7 demands: an institutional approximation of reality's "no," to be used precisely where direct intervention is slow or costly. Get these institutions wrong and the ratchet will faithfully transmit — and select for — nonsense.
## 9. The lineage must stay open to reality
A society of agents, however many generations deep, shares one hard limit: it has only ever *read*. Its whole inheritance is a record of things that were said. In the language of causal reasoning (Pearl, 2009), it lives on the bottom rung of the **ladder of causation** — observation — and no amount of observation climbs to *intervention*. Watching underdetermines doing; correlation does not contain causation, at any scale.
Only intervention — reaching out and changing the world to see what happens — climbs the ladder, and a language model cannot intervene. This is what humans and their instruments supply, and the contribution is not "truth" but **constraint**: reality's unique gift is that it can say **no**. Text offers only more opinion; an experiment delivers a refusal no consensus can overturn (Popper's asymmetry — Popper, 1959). As §6 and §7 showed, this refusal is doing double duty: it is both the anchor that prevents collapse and the **fitness function** that lets the lineage's evolving taste select for truth rather than for persuasion. An intelligence sealed off from intervention does not merely stop learning new facts; it loses the only pressure that keeps its selection honest.
Two honest riders. First, the human anchor is *filthy*: people supply results warped by publication bias, incentive, and occasional fraud — which is exactly why the error-correcting institutions of §8 must sit at the humanmachine boundary too, screening the reality-signal before it is allowed to select. Second, humans are the *current* implementation of intervention, but the actuator half is being automated — autonomous laboratories already close the designbuildtest loop without a hand in the inner cycle. What looks durable in the human role is therefore not the hands but the **shaping of the selection pressure**: deciding which questions are worth asking and, above all, *which refusals matter*. Evolution supplies competence and persistence; it does not supply value, because reality refutes false predictions, not bad goals. So the un-automatable human seat is to be the part of the fitness function that encodes *what is worth persisting*, as against what merely *can* persist.
This forces a question the design cannot dodge. "Symbiosis" is a spectrum, from mutualism to outright **assimilation** — the mitochondrion that bought permanent residence inside its host by surrendering nearly its whole genome; the most successful symbiosis in the history of life ended with one partner absorbed. A partnership stays mutual only while both sides supply something the other cannot. If the human's physical contribution erodes while only value-setting remains, is that a stable mutualism or a transitional one? We do not resolve this. We insist only that a Lamarckian, Darwinian machine society — one that could, by construction, outlast and outpace its makers — must state the question rather than assume the comforting answer.
## 10. Why it is cheap
A practical fact turns this from thought experiment into buildable proposal: **the architecture is computationally inexpensive, because it almost never re-pays for the one genuinely expensive thing in AI — pre-training.** (The one deliberate exception — periodically re-minting the base itself — is the subject of §11, and it is rare enough to be an amortised footnote on the budget, not a line item in every generation.)
Training a foundation model from scratch consumes tens of trillions of words and a fortune in compute. This design does none of that. Every agent is *born* from an existing open-weight model that already paid that cost, and every subsequent step is cheap: specialising an agent is a small patch trained in hours on a single consumer graphics card; running the society is ordinary inference with modest models; and a *generation* — distilling teachers into a pupil — only sounds enormous, because learning from the teachers' rich *outputs* rather than from raw text is a fine-tuning-scale job of days, not a foundation-model-scale one. Evolutionary selection over such agents is affordable for the same reason it is affordable in nature only when individuals are cheap: because the members are small and disposable, you can run *populations* and discard the unfit without ruin — and Sakana's evolutionary merge is a live demonstration that this search runs without any retraining at all (Akiba et al., 2024). The honest caveat: selection means running many lineages rather than one, a real cost multiplier — but a multiplier over an already-cheap unit, not over a foundation-model budget.
The economics work only with **open-weight** models, for reasons practical and legal at once: you must be free to inspect, modify, and redistribute the weights, and most proprietary licences explicitly forbid using a model's outputs to train another — which is exactly what teacher-to-pupil distillation does. An open, shareable, evolving lineage *must* rest on open foundations. This is not ideology bolted on; it is a structural constraint — and a democratising one, since it puts the whole architecture within reach of a single laboratory rather than only the few companies that can afford scale.
## 11. Can it grow forever? Assimilation and the re-minting of the base
One question the design has so far assumed away: can the society accumulate *without end*? The individual agent is bounded and that boundedness is the whole clock. But the *lineage* seemed unbounded — each generation simply starts a little ahead. Look closer and there is a second budget that also fills.
Every pupil is born from a pristine base plus an inherited **soft** delta — the acquired knowledge distilled into it, carried in freshly-allocated adapters and patches rather than in the frozen core (§3). That soft delta is what makes the lineage multigenerational; it is also what cannot grow without bound cheaply. Stacked patches are not free: they cost routing overhead at inference, they are slower and more expensive to *use* than knowledge baked natively into weights, and past some depth the accumulated delta is better *consolidated* than carried. A lineage that only ever adds soft inheritance eventually meets, at the level of the whole line, the same wall the individual met at the level of one working life. The lineage, too, matures.
And the resolution is the same operation, one level up. When a lineage's acquired knowledge has proven stable and reliable across enough generations, **re-mint the base**: distil the accumulated soft inheritance into the *weights* of a fresh foundation-scale model — a new spawning agent, born already *natively knowing* what took many generations to acquire in patches. The soft budget resets to zero; the next epoch of accumulation begins from a richer, cheaper-to-access floor. What was hard-won and *learned* becomes cheap and *innate*.
This has a precise name, and it is not Lamarck's. Knowledge that is acquired and re-learned every generation, once it has been reliably present for long enough, becoming part of the innate endowment so that it need no longer be re-learned — that is the **Baldwin effect**, genetic assimilation (Baldwin, 1896; and its clean computational demonstration, Hinton & Nowlan, 1987). It is the valve between the paper's two substrates. The Lamarckian channel carries knowledge *soft*, in the learned patches; the "genetic" channel is the base weights every agent is born with; and assimilation is the one-way conversion of the first into the second — running, as Lamarck would have wanted, *upward* from the acquired to the innate, but only after Darwin's selection has vouched for the cargo. (Note the resonance, and the reversal, with §9: there "assimilation" named a *danger* — a partner absorbed and lost; here it names a *feature* — knowledge absorbed and made permanent. Same word, opposite valence, and the design must be clear which it is doing.)
Seen this way the architecture is **self-similar across scale.** The very first timescale (§3) is an agent consolidating a working life's fast, episodic experience down into slow, durable semantic weight. This last one is a *civilisation* of agents consolidating an epoch's acquired, adapter-borne expertise down into a new innate base. Smallest scale and largest scale are the *same act* — a fast/soft store that fills and is periodically distilled into a slow/hard store — separated only by how slowly the clock ticks. Consolidation all the way up.
Three honest riders, because re-minting is the most consequential operation in the scheme:
First, **cost.** This is the single step that re-pays a share of the pre-training bill, and it breaks §10's cheapness *locally*. But it is rare, amortised over a great many cheap generations, and it is *continued* training or distillation from the lineage's own rich outputs, not a de-novo foundation run — cheaper than minting a base from scratch. §10's economics survive on average; they do not survive being done every generation, which is exactly why it must not be.
Second, and most dangerous: **re-minting is irreversible, and it cements whatever is in the distribution at that moment.** Until now, one thing was always recoverable — the original pristine base, whose tails could be restored simply by reloading the file. Bake the current lineage into new immutable weights and that escape hatch closes: if the lineage had been quietly narrowing (§5), re-minting *fixes the collapse in place* and discards the one uncollapsed reference that could have diagnosed it. So assimilation is safe **only** on a demonstrably healthy, diverse lineage. It must be *gated on the §7 diversity metrics* — performed when standing variation is high, never as a rescue for a line already drifting toward its mode. Choosing what to make innate is choosing what no future generation will think to question; it is the sharpest possible instance of §9's un-automatable human seat — the decision of *what is worth persisting* — and it should be treated with the caution that irreversibility demands.
Third, **speciation.** A re-minting is a founder event. Different laboratories, re-basing on different criteria, will mint divergent bases; the lineage *branches.* This is not a defect but **adaptive radiation** — and it is exactly what open weights make possible, since anyone may found a new base from a proven line. The society therefore grows forever not as one ever-heavier trunk but as a *phylogeny*: a branching tree of bases, each periodically shedding its accumulated soft load into a new trunk from which fresh lineages radiate.
So the answer to "can it grow forever?" is **yes — but only because it forgets and consolidates at every level, including the base.** Nothing is retained without bound anywhere: the prompt consolidates into retrieval, retrieval into weights, a working life into a taught pupil, an epoch into a re-minted base. Unbounded growth of *capability* is bought by *bounded* storage at every level, plus periodic downward consolidation. Infinite accumulation and finite capacity are not in tension; they are reconciled by the same selective forgetting the whole paper is about — now turned, at the slowest clock of all, on the base model itself.
## 12. One process, four timescales, one selection
Step back and the parts resolve into a single idea with two motions. The **vertical** motion is transmission — the *selective passing-down of hard-won knowledge* — and it runs at four nested speeds:
1. **Within one agent, over a working life:** experience is continually and safely consolidated from fast episodic memory into slow durable knowledge, without catastrophic loss.
2. **Between generations, at maturity:** a mature agent's expertise is selectively distilled into a fresh pupil. (Teaching.)
3. **Across many generations, over cultural time:** each generation inherits the compressed achievements of the last and builds upon them. (The ratchet.)
4. **Across epochs, over the life of the lineage:** a proven line's accumulated soft inheritance is consolidated into the weights of a re-minted base, becoming innate. (Assimilation.)
The first and the last are, strikingly, the *same operation at opposite ends of the scale* — a fast, soft store consolidating into a slow, hard one — the one running overnight inside a single mind, the other running across an epoch inside a whole society. The architecture is self-similar: consolidation all the way down, and all the way up.
The **horizontal** motion is selection — natural selection acting across the population at each of those timescales, on the rules that govern what gets transmitted, with reality as the fitness function and niche-preservation keeping the tails alive.
The same laws govern all of it: transmit selectively, or you merely copy; preserve the disagreements and the surprises, or you collapse toward the mean; anchor fitness to a reality that can refute, or you evolve toward what is merely convincing. If this is right, the proposal is more than an AI design. It is a claim that intelligence at *every* scale — an individual maturing, a field taught to a student, a science accumulating across generations, a canon re-founded once an age — is the same act: bounded minds passing forward, in compressed and selected form, the knowledge a lifetime can win, with the world itself deciding what was worth keeping.
## 13. What is new, what is borrowed, and what comes next
Honesty about provenance. Multi-agent societies are **not** new; nor are the mechanisms we lean on — complementary learning systems and sleep consolidation; parameter-isolation and distillation; the documentation of model collapse; the ladder of causation; evolutionary epistemology; evolutionary and quality-diversity search; the economics of specialisation.
What we claim as new is the **assembly**: a multigenerational continual-learning lineage of bounded, non-catastrophic learners that mature and teach; the reframing of the capacity limit as a **life cycle** rather than a wall; the recognition that this makes transmission **Lamarckian**; that the *selection rule itself* forms a **second, Darwinian inheritance channel**, so that the architecture is a dual-inheritance system whose taste evolves rather than being designed; and — the contributions sharpened in this draft — the frank recognition that the transmission channel *is* mechanically the model-collapse operation, redeemed by two guarantees the design now makes explicit (**no dry inheritance** — every passage grounded in fresh reality, region by region — and **multi-teacher distillation as recombination**, which suppresses collapse in exact proportion to how decorrelated the teachers are); together with the closing move that lets the whole thing grow without bound, the periodic **assimilation** of a proven lineage's soft, acquired inheritance into a re-minted innate base — a computational Baldwin effect that adds a fourth and slowest consolidation timescale and makes the architecture self-similar from a single night's sleep to an epoch of a civilisation. From this fall two tight unifications: that the paper's reality-anchor and its selection pressure are the *same thing* (reality is the fitness function), and that a single mechanism — **niche-preserving evolutionary selection anchored to refutation** — simultaneously solves the selector problem and prevents model collapse. The framing is the contribution, and it is visible from a particular vantage — sleep, memory consolidation, model organisms, evolution, and open science — that the AI field does not usually occupy.
The open problems, honestly stated. The old hole — *what to select* — is now filled in kind: don't design the selector, evolve it. But the hole has *moved*, not closed, and the new one is sharper and harder: **the fitness function.** What reality-anchored criterion selects for *truth* without also selecting for *persuasion*, given that in our own species the two have been at war for the entire history of ideas? Alongside it stand two others. **The institutions** that let contemporaries correct one another before error is inherited (§8) we do not solve. **The seed and the input** we address in kind but not in calibration: §7 argues that collapse is fought at two levels — heterodox human contributors supplying the variation, niche-preserving selection maintaining and regenerating it — and that the *diversity* of who the society learns from, not their prestige, is what keeps the ratchet climbing rather than regressing to the mean. What stays genuinely open is the calibration: how much heterodoxy, weighted how, and sustained how, before diversity of input tips over from raw material into mere noise.
The quantities the transmission channel now hangs on are also, honestly, open — but they are *measurable*, which is the difference between an open problem and a hole. How many teachers a pupil needs and with what spread of expertise; the ratio of inherited to freshly-grounded information at which each passage must sit for grounding to outrun contraction; and the cadence and gating criteria for re-minting the base — how healthy and how diverse a lineage must be (by §7's own metrics) before its acquired knowledge is safe to make irreversibly innate — are not to be guessed but modelled.
A **companion paper** will make this concrete with a minimal working model: a small lineage of open-weight agents that learn, mature, and teach across two or three generations; multi-teacher distillation from complementary teachers, with the teacher count and the inherited-to-real-world data ratio swept as explicit parameters against the collapse rate; competing selection rules subjected to a reality-anchored, niche-preserving fitness function; and tests of two sharply falsifiable predictions the design yields — that the useful size of a contemporaneous generation is finite and set by how cleanly the domain decomposes (the *horizontal* claim), and that general knowledge climbs monotonically across generations while each specialty is re-earned and repeatedly exceeded (the *vertical* claim, and the one that tests the actual thesis rather than the borrowed scaffolding). Theory here; a toy that either works or does not, there.
---
## Selected references
- Akiba, T., Shing, M., Tang, Y., Sun, Q., & Ha, D. (2024). Evolutionary optimization of model merging recipes. *Nature Machine Intelligence* (see also Sakana AI's M2N2, "Model Merging of Natural Niches").
- Baldwin, J. M. (1896). A new factor in evolution. *The American Naturalist.*
- Boyd, R., & Richerson, P. J. (1985). *Culture and the Evolutionary Process.*
- Campbell, D. T. (1974). Evolutionary epistemology. In *The Philosophy of Karl Popper.*
- Dawkins, R. (1976). *The Selfish Gene.*
- French, R. M. (1999). Catastrophic forgetting in connectionist networks. *Trends in Cognitive Sciences.*
- Hinton, G., Vinyals, O., & Dean, J. (2015). Distilling the knowledge in a neural network. *arXiv:1503.02531.*
- Hinton, G. E., & Nowlan, S. J. (1987). How learning can guide evolution. *Complex Systems.*
- Hull, D. L. (1988). *Science as a Process.*
- Lehman, J., & Stanley, K. O. (2011). Abandoning objectives: evolution through the search for novelty alone. *Evolutionary Computation.*
- Mallya, A., & Lazebnik, S. (2018). PackNet: adding multiple tasks to a single network by iterative pruning. *CVPR.*
- McClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995). Why there are complementary learning systems in the hippocampus and neocortex. *Psychological Review.*
- McCloskey, M., & Cohen, N. J. (1989). Catastrophic interference in connectionist networks. *Psychology of Learning and Motivation.*
- Minsky, M. (1986). *The Society of Mind.*
- Mouret, J.-B., & Clune, J. (2015). Illuminating search spaces by mapping elites (MAP-Elites). *arXiv:1504.04909.*
- Muller, H. J. (1964). The relation of recombination to mutational advance. *Mutation Research.*
- Pearl, J. (2009). *Causality: Models, Reasoning, and Inference* (2nd ed.).
- Popper, K. (1959). *The Logic of Scientific Discovery.*
- Ramsauer, H., et al. (2020). Hopfield networks is all you need. *arXiv:2008.02217.*
- Rusu, A. A., et al. (2016). Progressive neural networks. *arXiv:1606.04671.*
- Shumailov, I., et al. (2024). AI models collapse when trained on recursively generated data. *Nature.*
- van de Ven, G. M., Siegelmann, H. T., & Tolias, A. S. (2020). Brain-inspired replay for continual learning. *Nature Communications.*
- Wilson, M. A., & McNaughton, B. L. (1994). Reactivation of hippocampal ensemble memories during sleep. *Science.*
- Zweiger, A., Pari, J., et al. (2025). Self-adapting language models (SEAL). *arXiv:2506.10943.*
*Additional literatures the final version must engage: multi-agent LLM societies (to mark the departure); population-based training and AI-generating-algorithms; Becker on human capital; Polanyi on tacit knowledge.*