MachineSex/results/figS12_quality_diversity
Giorgio Gilestro 6f8cef1ac5 main: keep only what reproduces the manuscript; everything else lives on dev
Removed from main (all preserved on the dev branch): the arXiv build and
its sources, design documents (blueprint, results summary, review responses,
essay drafts), tasks/ and CLAUDE.md, the cover letter and reference tooling,
two unused manuscript figures, and every experiment that feeds no figure or
number in the paper: the collapse null, the sexual-vs-asexual lineage, the
NK speciation variant, the 0.5B single-seed LLM prototypes, the compose and
society experiments with their calibration and pilot runs, and their
configs, runners, tests, figure scripts and PBS jobs. Their result bundles
are moved to results/_archive/ (ignored) so the parquets stay on disk.

Also: plot_llm_speciation reads the s{seed}/ layout; the mating-breadth
plot writes under its bundle name; Makefile targets reduced to the kept
experiments; REPRODUCING.md and README point to dev for the rest.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01Y64o8FKP7rCuXzC48pxpMm
2026-09-13 17:07:23 +01:00
..
figS12_quality_diversity.pdf main: keep only what reproduces the manuscript; everything else lives on dev 2026-09-13 17:07:23 +01:00
figS12_quality_diversity.png Restructure: descriptive tier and experiment names, paper/manuscript 2026-09-13 17:00:40 +01:00
manifest.json Restructure: descriptive tier and experiment names, paper/manuscript 2026-09-13 17:00:40 +01:00
README.md Restructure: descriptive tier and experiment names, paper/manuscript 2026-09-13 17:00:40 +01:00
resolved_config.yaml Restructure: descriptive tier and experiment names, paper/manuscript 2026-09-13 17:00:40 +01:00

E5 — Quality-diversity selection preserves diversity where greedy selection destroys it

Claim tested: if each generation you select which outputs to keep, does chasing the "best" outputs (greedy) accelerate collapse — and does rewarding novelty instead prevent it?

Setup (Layer 1, pure math). K = 500 items, Zipf truth, n = 200, 400 generations, 100 repeats, all arms given the same grounding. Three selection modes: none (grounding only, no selection), greedy (keep the fittest — highest-p* — items), and quality-diversity (QD) (a novelty bonus w_i ∝ f_i · p_i^{-α} that up-weights rare items). The novelty exponent α is swept over {0.5, 1, 2}.

Symbols

  • greedy — select toward the fittest/most-probable items (directional pressure).
  • QD (quality-diversity) — select for fitness and novelty; α = strength of the novelty bonus.
  • H diversity; support = number of distinct items surviving.

The three panels

  1. Diversity trajectories. H over generations: red = greedy (crashes toward ~0, i.e. fixation on a few items); orange/blue = QD at α = 1, 2 (holds a high plateau); green = none (reference). Greedy selection is a second collapse engine on top of drift.
  2. Novelty doseresponse. Stationary H vs the novelty exponent α for QD (orange dots), with greedy (red dashed) and none (green dashed) as reference lines. QD sits above greedy for every α, and rises as the novelty bonus strengthens.
  3. Surviving items per arm. Stationary support (number of distinct items alive) as bars: greedy is lowest; QD arms keep progressively more items alive as α grows; none is the reference.

Takeaway

Optimising only for "what looks best" (greedy) collapses the population onto a handful of winners; a novelty-rewarding, quality-diversity objective actively re-introduces and holds the tail. Key numbers: greedy H ≈ 0.01 (near-total fixation) vs QD H ≈ 0.480.88 rising with α. Falsifier (not triggered): if QD's stationary H had been ≤ greedy's, quality-diversity would be doing no work.