Giorgio Gilestro
84124de143
Clarity pass over the main text (36-item audit), Discussion rewrite and cut, acknowledgements, Souly et al. as ref 62, lettered SI panels, model section moved under Results; plus the untracked curriculum/society/compose/smol configs, runners, figures, stats and tests that the SI already cites. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01Y64o8FKP7rCuXzC48pxpMm
29 lines
1.3 KiB
YAML
29 lines
1.3 KiB
YAML
# v2 society campaign, seed 3 (prereg tasks/prereg-llm-society-v2.md §3). The PBS array
|
|
# (hpc/llm_society_v2.pbs) derives one config per (seed, arm) from this template; running it directly
|
|
# runs all four arms sequentially (the local-GPU hedge).
|
|
#
|
|
# CALIBRATION-DEPENDENT FIELDS — set after gates C1/C2 pass, before submission:
|
|
# families : the 9 selected by stage A pass 2 (C1, gate 0.41) — SET
|
|
# k_inherit / epochs / conf_gate : from stage B (C2 + C2b), 2026-09-07 — SET
|
|
experiment: llm_society_v2
|
|
kind: llm_society_v2
|
|
base_model: Qwen/Qwen2.5-0.5B-Instruct
|
|
seed: 3
|
|
families: [strings, setops, numtheory, mixedtoken, digits, alphabet, prime, wordlen, roman]
|
|
agents: 9
|
|
generations: 12
|
|
arms: [full, no_grounding, no_sex, no_diversity]
|
|
g: 0.85
|
|
lam: 0.3
|
|
max_mate_use: 2
|
|
n_test: 27 # per family -> 243 overall (SE 0.032)
|
|
n_val: 13 # per family -> 117 (selection signal)
|
|
n_conf: 13 # per family, fresh each generation
|
|
k_inherit: 300 # per family, fresh each generation (C2b: k=300 is the main retention driver)
|
|
epochs: 3 # child SFT epochs (C2b)
|
|
conf_gate: 0.85 # confidence-gated inheritance, all arms (C2b mean retention 0.88; C3c: tight gate = 6-epoch retention at 3 epochs)
|
|
spec_train: 1200
|
|
spec_epochs: 3
|
|
resume: true
|
|
lora: {r: 16, alpha: 32}
|
|
output: {dir: results/llm_society_v2/s3}
|