Commit graph

12 commits

Author SHA1 Message Date
a88289964a SI Methods: a full experimental-procedures appendix
Replaces the three-paragraph methods sketch with a scientific account of how
the study was run (M1-M7):

- M1 design principles: cheapest falsifying tier; match claim precision to
  instrument precision; every tier gets an oracle independent of the model
  being measured; falsifiers declared before running.
- M2 replication: what a replicate *is* differs by tier (independent lineage /
  lineage incl. fresh init and data order / training seed with test sets held
  fixed), and a table giving every experiment's replicate count with the
  reasoning - why 200 for E4 (per-item binary outcomes), 60 for the bridge
  gate (must detect any departure), 3-5 where the contrast is categorical,
  and 1 for the 7B runs, labelled as single runs.
- M3-M5 per-tier procedures: parameter choices and their justification, the
  correlated-parent construction, why the neural sandbox is synthetic (a
  lossless identity code plus style entropy gives an exact oracle while still
  forcing the model to learn a distribution), MNIST modes and the frozen-CNN
  oracle with its confusion matrix as measurement floor, why no-BatchNorm MLPs
  for the alignment analysis, and for the LLM tier: why Qwen 0.5B/7B (one
  family so scale is the only variable), why procedural tasks rather than a
  benchmark (exact verifier, contamination-free, controlled disjointness, a
  difficulty knob), why LoRA (confines each parent to an additive low-rank
  delta over an identical base, which is what makes weight-space
  recombination well defined), the training algorithm, and the split scheme.
- M6 negative controls, including the one that removed a result: the
  compatible-overlap axis collapsed the delta-cosine predictor from rho=+0.60
  to +0.03.
- M7 statistical procedures.

Also: SI voice converted to first person and terminology synced to the
"biological model" rename; removed a process ghost from the preamble
("Skeleton assembled at Phase 4"); build.py now takes a document argument and
no longer eats documents that lack a title block, so the SI compiles via a new
si.tex wrapper (10 pp). `make paper` builds both PDFs.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
2026-09-07 16:04:52 +01:00
9055fca792 Fig. 1A: pastel palette (green biology, two blues for AI) + Mendel peas and robot icons
Per GG: the biological model goes pastel green (nature), the two AI tiers
light and darker pastel blue; header text switches from white to the dark
shade of each hue (white is unreadable on pastel). A green-pea icon honours
Mendel in the biology header; a friendly robot marks the two AI headers.
Icons are Flaticon #2347052 and #10479785, used under GG's paid Flaticon
licence (noted in make_figs.py); header text is centred slightly left of a
dedicated icon slot so nothing collides. Caption colour sentence updated
(green vs blues).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
2026-09-07 13:23:35 +01:00
2d8f661924 Paper-wide rename: the pop-gen construct is "the biological model"; "(exact)" dropped
"Model" now means an AI model everywhere; the Wright-Fisher construct is "the
biological model" throughout (19 occurrences): tier header, section title (now
"The biological model, and where trained learners depart from it"), Table 1
support column ("Exact" -> "Closed form"; "Analytic model" -> "Biological
model"), Results, Discussion, Methods ("Biological-model tier"), and all
figure captions. "Exact" survives only in technical noun phrases (exact-match
verifier, exact oracle, exact equilibrium, exact recovery); the abstract's
"exactly Wright-Fisher" is now "literally Wright-Fisher".

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
2026-09-07 13:08:58 +01:00
b417a66c23 Fig. 1B: the conceptual cartoon — from a society in space to a society in time
The paper's key move drawn as a two-panel partner to the programme grid (now
Fig. 1A): on the left, the usual picture — contemporaries exchanging messages
(multi-agent systems, one moment on the clock); on the right, the same
ecosystem seen along its time axis — a pedigree in which a rare capability
(gold dot) is lost under single-parent inheritance, reassembled by merging
complementary parents, and re-supplied by grounding from a reality that can
say no (the globe). Friendly-robot glyphs, colour-coded capability dots;
build.py now stacks multiple PDFs per figure; the Introduction cites 1A and
1B in panel order.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
2026-09-07 12:50:36 +01:00
16e9002773 Fig. 1 doubles as a map of the paper: per-cell figure/panel tags
Each filled cell now carries, in its bottom-right corner, the figure or table
where that result is reported (Fig. 2A ... Figs. 7E-F, 3C-D); the caption says
so. Building the mapping surfaced one imprecise citation: the bred-and-screened
seed-replication claim cited Fig. 3A, whose panel shows the soup/ties bars -
that result lives in SI Appendix Table S2, and the citation now says so.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
2026-09-07 12:10:51 +01:00
e9fb28d8c4 Fig. 1: colour-separate theory from AI tiers; explain every empty cell
Category separation per GG: population genetics stays blue, both AI tiers move
to shades of orange, with a wider gutter between the theory column and the AI
pair. The grounding x LLM cell is upgraded from "not tested" to "established
at LLM scale in prior work (21, 30); not re-run here" (Shumailov's Nature
collapse result; Gerstgrasser's real-data rescue) - it was never a gap, it was
already settled. The caption now states the fill principle: each claim is
tested at the cheapest tier that can falsify it; a costlier tier is entered
only where it adds a discriminating test, and the LLM society is the one
genuinely open cell.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
2026-09-07 11:35:59 +01:00
5cb49943db Fig. 1: rename first tier "Exact model" -> "Population genetics (exact)"
"Model" is reserved for AI models in this paper, so a tier named "Exact
model" read as a kind of AI model; the tier is the Wright-Fisher theory run
exactly. Caption and Introduction adjusted to match ("three tiers" rather
than "three tiers of model architecture"; "an exact population-genetic
simulator").

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
2026-09-07 11:31:56 +01:00
e42fe497ff Fig. 1 revision: pop-gen definitions as row labels, title into the caption, solid header row
Row labels now teach the vocabulary (grounding = immigration, recombination =
sex, epistasis, the composed society, speciation = reproductive isolation),
each with a two-to-three-line definition in the left margin, replacing the
question taglines. The in-figure title/arrow is removed (the caption carries
it); the tier header row is now solid-colour with white text so the
model-nature band reads as a header rather than a content row.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
2026-09-07 11:21:06 +01:00
0159e2839a New Fig. 1 (experimental-programme schematic); Table 2 to SI; figures in citation order; Fig. 2B legible labels
Replaces the results table with a pipeline figure: five questions x three
architecture tiers (exact Wright-Fisher simulator, trained networks, language
models), filled cells naming the experiments, dashed cells the honest gaps.
Table 1 (the dictionary) stays; Table 2 moves to SI Appendix Table S2. The
renumber surfaced a pre-existing citation-order violation (the LLM figure was
cited in the recombination section before Figs. 3-6), so figures are renumbered
to strict first-citation order (LLM tier is now Fig. 3). Fig. 2B: the montage's
baked-in raster labels are cropped away and replaced with vector row numbers
under a rotated "generation" header.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
2026-09-07 11:12:33 +01:00
96902e87f0 figures: publication-ready — unified, lettered, codename-free
paper/pnas/make_figs.py re-plots every panel directly from the committed
results artifacts into six single-file figures (figs/fig1..fig6.pdf):
no experiment codenames or suptitles (interpretation moved to captions),
bold panel letters, plain-language axis labels and legend entries, one
consistent style (8pt, no top/right spines). Panels: fig1 A-B (grounding
equilibrium + MNIST montage with its baked-in title cropped), fig2 A-B
(blending cancellation + Fisher-Muller), fig3 A-D (outbreeding, directed
recombination, mating breadth champion + diversity), fig4 A-C (society
ablation trajectories), fig5 A-F (speciation: analytic curve + cliff,
MLP decomposition + conflict sweep, LLM coherence + duration null),
fig6 A-D (seed-replicated merging, 7B-hard routing vs averaging,
predictive-test scatter, predictor comparison). build.py now places the
single PDFs; captions rewritten per lettered panel; in-text panel refs
updated (5B->5C-D, 5C->5E-F); stale stacked copies removed. Document
20pp -> 18pp.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
2026-09-07 09:09:46 +01:00
6f1f8bf172 references: citation-order renumbering, PNAS style, full verification
All 66 references renumbered to first-appearance order (programmatically
verified: in-text sequence = 1..66 = list order; ranges expanded,
remapped, recompressed) and rewritten in PNAS style (initials-first
authors with the >5 -> et-al rule, sentence-case titles, abbreviated
italic venues, bold volumes, year-at-end, arXiv [Preprint] + 10.48550
DOIs). Correctness: 47 arXiv ids batch-verified against the arXiv API
(title/first-author/year); caught and fixed an authorless GENOME entry
(Y. Zhang et al.), "Sakana AI" -> J. Abrantes et al., a wrong Kotha id
(2310.05719, a different paper -> 2309.10105), Nemotron's corporate
author, and Liang's truncated title. Also: six load-bearing refs that
lost their in-text anchors during the restructure re-anchored (NK, QD,
Pari, LoRA, Sharma, Kozodoi), one real mis-citation fixed
(Self-Instruct credited to Multiagent-Finetuning; new ref added), and
four figure captions in build.py brought up to third-review calibration
(operational grounding threshold; first-order conservation;
complementary-contributions society; permutation-and-rescaling
alignment). 20-pp rebuild clean.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
2026-09-07 09:00:56 +01:00
bf4b1c077c Phase 4: PNAS research-article draft (main.md + composed figures + SI skeleton)
paper/pnas/main.md — the manuscript restructured as a research article
(~5.6k words main text): significance statement, abstract, introduction
(diagnosis conceded; the management thesis; the interpretation/
explanation/prediction ladder with the prediction rung stated as a
bounded controlled test), the minimal model with its exactness boundary
(learning kernel cited against ourselves), Table 1 dictionary with
per-row support levels, a five-step results ladder (grounding floor;
conservation law + operator boundaries + Fisher-Muller + directed sex +
mating structure; the jointly-necessary society; speciation across three
tiers with the emergent null; the controlled predictive test at
second-review calibration), discussion (design rules, borrowed-vs-ours
ledger, limits with the reviewer's generalisation-before-scale ordering,
what biology gets back), brief methods, 30 references.

build.py composes 6 figures by stacking committed vector PDFs (bespoke
unified re-plots deferred to submission polish); builds clean under
tectonic (15 pp incl. 6 full-page figures). si.md: SI skeleton
(propositions, claims ledger, per-tier methods, statistics, figure
list). Manifesto sections of v6 (institutions, timescales, re-minting)
compressed into Discussion per the plan; v6 remains the long-form
perspective document.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
2026-09-06 18:24:58 +01:00