Discussion: creative diversity — stylistic collapse and the evolutionary remedy

New Discussion block before the Outlook: homogenisation of writing style is
the same tail-drift phenomenon at a different locus (a voice = a distribution
over rare stylistic variants), so the paper's remedies — diverse grounding,
decorrelated lineages, union-preserving recombination, difference-rewarding
selection — transfer, explicitly flagged as untested here. Adds three verified
references (Guo et al. 2024; Padmakumar & He 2024; Doshi & Hauser 2024,
Sci. Adv.); first-appearance order re-verified 1..69.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v

paper/pnas/body.tex

@@ -129,6 +129,8 @@ Predictive test & 13 conditions \(\times\) 3 seeds (0.5B) & Merge penalty vs ora
 
 \textbf{Limits and open problems.} The demonstrations are deliberately small: exact where small is a virtue, sign-level and seed-replicated at the language-model tier, on constructed task families with a trivially separable router and one model lineage (Qwen, 0.5B--7B). The composed society has not been built at language-model scale. The predictive test's next bars, in order of value: generalisation to \emph{unfamiliar} conflict structures and real task pairs; a demonstrably better \emph{budget-matched} merging decision; then scale replication. Beyond engineering, the framework's hardest open problem is the fitness function itself: selection optimises what is measured, and for knowledge systems the persuasive and the true compete --- grounding against a reality that can refuse is the only anchor I trust, and institutionalising that anchor (verification, replication, and challenge among models) is the society-level problem this paper poses but does not solve. What biology receives in return is a new model system: populations of learners where every genotype, environment, and mating decision is observable and manipulable --- where the evolution of sex can be studied with interventions (unbounded parents, offspring preview, directed mating) that no living system permits.
 
+\textbf{Creative diversity.} Collapse is not confined to facts and skills. Homogenisation of \emph{style} is already measurable: models trained on model output lose lexical and syntactic diversity across generations (67), writing produced with model assistance is individually better but collectively less diverse than writing produced without it (68, 69), and the house styles of the large assistants are recognisable enough that their tics serve as signatures. In this framework these are the same phenomenon at a different locus. A voice is a distribution over rare stylistic variants, exactly the tail that drift erases first and that blending inheritance averages into a common register. The remedies transfer unchanged, though they are untested here: grounding on stylistically diverse human sources, decorrelated lineages maintained as distinct voices rather than merged into one, union-preserving recombination over blending, and selection that rewards being different as well as being good. Whether these preserve measured stylistic diversity at scale is an open experiment that the framework specifies.
+
 \textbf{Outlook: the evolution of language models.} The Introduction's premise, that the model ecosystem is an evolving population, is also a forecast about where these results matter next. Language-model development is consolidating around exactly the operators studied here: synthetic-data flywheels (inheritance), merging and routing of specialist fine-tunes (recombination and population structure), verifier-gated data pipelines (grounded selection), and periodic consolidation of adapters into new bases. If coming model generations remain what the tested regimes found, freely recombinable in the absence of conflicting conventions, then the ecosystem evolves as one interbreeding population, and the levers that matter are grounding budgets priced per rare capability and diversity preserved deliberately. If instead long-horizon specialisation at scale begins to produce emergent incompatibility, as the expert-training-duration observations hint (43) and the small-scale null here does not rule out, then lineages will begin to speciate, and the ecosystem's future is a set of diverging species connected by routing rather than by merging. Which of the two it will be is measurable now, with the pre-merge conflict instruments this paper tested.
 
 \section*{Materials and Methods}
@@ -210,5 +212,8 @@ Predictive test & 13 conditions \(\times\) 3 seeds (0.5B) & Merge penalty vs ora
 \item M. Wortsman, et al., Model soups: Averaging weights of multiple fine-tuned models improves accuracy without increasing inference time. \emph{Proc. Int. Conf. Mach. Learn.} (2022). https://doi.org/10.48550/arXiv.2203.05482.
 \item Y. Cao, et al., An empirical study and theoretical explanation on task-level model-merging collapse. arXiv [Preprint] (2026). https://doi.org/10.48550/arXiv.2603.09463.
 \item A. Livnat, C. Papadimitriou, Sex as an algorithm: The theory of evolution under the lens of computation. \emph{Commun. ACM} \textbf{59}, 84--93 (2016).
+\item Y. Guo, G. Shang, M. Vazirgiannis, C. Clavel, The curious decline of linguistic diversity: Training language models on synthetic text. \emph{Findings Assoc. Comput. Linguist.: NAACL} (2024). https://doi.org/10.48550/arXiv.2311.09807.
+\item V. Padmakumar, H. He, Does writing with language models reduce content diversity? \emph{Int. Conf. Learn. Represent.} (2024). https://doi.org/10.48550/arXiv.2309.05196.
+\item A. R. Doshi, O. P. Hauser, Generative AI enhances individual creativity but reduces the collective diversity of novel content. \emph{Sci. Adv.} \textbf{10}, eadn5290 (2024).
 \end{enumerate}
 

paper/pnas/main.md

@@ -409,6 +409,19 @@ system: populations of learners where every genotype, environment, and mating de
 and manipulable — where the evolution of sex can be studied with interventions (unbounded parents,
 offspring preview, directed mating) that no living system permits.
 
+**Creative diversity.** Collapse is not confined to facts and skills. Homogenisation of *style* is
+already measurable: models trained on model output lose lexical and syntactic diversity across
+generations (67), writing produced with model assistance is individually better but collectively less
+diverse than writing produced without it (68, 69), and the house styles of the large assistants are
+recognisable enough that their tics serve as signatures. In this framework these are the same
+phenomenon at a different locus. A voice is a distribution over rare stylistic variants, exactly the
+tail that drift erases first and that blending inheritance averages into a common register. The
+remedies transfer unchanged, though they are untested here: grounding on stylistically diverse human
+sources, decorrelated lineages maintained as distinct voices rather than merged into one,
+union-preserving recombination over blending, and selection that rewards being different as well as
+being good. Whether these preserve measured stylistic diversity at scale is an open experiment that
+the framework specifies.
+
 **Outlook: the evolution of language models.** The Introduction's premise, that the model ecosystem is
 an evolving population, is also a forecast about where these results matter next. Language-model
 development is consolidating around exactly the operators studied here: synthetic-data flywheels
@@ -526,3 +539,6 @@ publication; every figure in this paper regenerates from committed artifacts wit
 64. M. Wortsman, et al., Model soups: Averaging weights of multiple fine-tuned models improves accuracy without increasing inference time. *Proc. Int. Conf. Mach. Learn.* (2022). https://doi.org/10.48550/arXiv.2203.05482.
 65. Y. Cao, et al., An empirical study and theoretical explanation on task-level model-merging collapse. arXiv [Preprint] (2026). https://doi.org/10.48550/arXiv.2603.09463.
 66. A. Livnat, C. Papadimitriou, Sex as an algorithm: The theory of evolution under the lens of computation. *Commun. ACM* **59**, 84–93 (2016).
+67. Y. Guo, G. Shang, M. Vazirgiannis, C. Clavel, The curious decline of linguistic diversity: Training language models on synthetic text. *Findings Assoc. Comput. Linguist.: NAACL* (2024). https://doi.org/10.48550/arXiv.2311.09807.
+68. V. Padmakumar, H. He, Does writing with language models reduce content diversity? *Int. Conf. Learn. Represent.* (2024). https://doi.org/10.48550/arXiv.2309.05196.
+69. A. R. Doshi, O. P. Hauser, Generative AI enhances individual creativity but reduces the collective diversity of novel content. *Sci. Adv.* **10**, eadn5290 (2024).