giorgio/MachineSex
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Manuscript revision and pending experiment work, snapshot before restructuring

Browse source 
Clarity pass over the main text (36-item audit), Discussion rewrite and cut,
acknowledgements, Souly et al. as ref 62, lettered SI panels, model section
moved under Results; plus the untracked curriculum/society/compose/smol
configs, runners, figures, stats and tests that the SI already cites.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01Y64o8FKP7rCuXzC48pxpMm
This commit is contained in:
Giorgio Gilestro 2026-09-13 16:54:09 +01:00
parent e4804adabc
commit 84124de143
450 changed files with 52813 additions and 1202 deletions
Download patch file Download diff file Expand all files Collapse all files

23
results/llm_merge_hpc/README.md
View file

@ -47,3 +47,26 @@ transformers 5.13.0 / peft 0.19.1, `manifest.json` records the results hash and
*Note: this run's `manifest.json` has `git_commit: null` because it was produced on the HPC node from
an rsync'd (non-git) working copy; the committed artefacts here are the source of truth for the figure.*
## Seeds 1–3 (2026-09-11)
Seeds 2–3 were run on CX3 via `hpc/llm_7b_seeds.pbs` (seed 1 above was moved to `s1/`; the bundle
layout is now `s{seed}/`). Fixed test sets, training seed varied. Per-seed values and mean ± 95% CI
from `figures/stats_llm_7b_seeds.py`:
```
model metric n_seeds s1 s2 s3 mean ci95
best_specialist overall 3 0.773 0.840 0.808 0.807 0.038
best_specialist worst_family 3 0.575 0.520 0.630 0.575 0.062
merge_soup overall 3 0.873 0.877 0.870 0.873 0.004
merge_soup worst_family 3 0.625 0.635 0.640 0.633 0.009
merge_ties overall 3 0.868 0.873 0.860 0.867 0.008
merge_ties worst_family 3 0.615 0.635 0.625 0.625 0.011
contrast metric n_seeds s1 s2 s3 mean ci95 sign_agrees
merge_soup − best_specialist overall 3 0.100 0.037 0.062 0.066 0.036 3/3
merge_soup − best_specialist worst_family 3 0.050 0.115 0.010 0.058 0.060 3/3
merge_ties − best_specialist overall 3 0.095 0.033 0.052 0.060 0.036 3/3
merge_ties − best_specialist worst_family 3 0.040 0.115 -0.005 0.050 0.069 2/3
```
Reading: merged specialists beat the best single specialist overall in every seed (+0.066 ± 0.036); the seed-1 margin (+0.100) was the largest of the three because seed 1's best specialist was the weakest (0.773 vs 0.840, 0.808).