giorgio/MachineSex
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Layer 1 complete: E3-E6 + E2 analysis add-ons

Browse source 
Finishes the Layer 1 analytical core. All six experiments run with honest,
publication-quality figures; 71 tests green.

- E3 region-matched grounding: `grounding.exercised` knob + per-region tail
  survival. Matched holds the exercised region's tail (0.49) where uniform
  spreads thin and lets it collapse (0.07).
- E4 multi-teacher recombination: `run_coverage` runner. Union coverage matches
  U(K_T,rho,q) exactly. Finding: mean-mixture distillation shows NO surviving
  benefit (a conservation law — 1/K_T dilution cancels the union gain); a
  union-preserving max-merge (M2N2-style) does. E4 reports both operators.
- E5 QD vs greedy: greedy drives fixation (H~0.01); QD holds H at 0.48-0.88,
  rising with the novelty exponent.
- E6 re-mint gate: `arm` multi-override sweep. Re-minting a collapsed lineage
  locks in divergence of KL-to-original; gating on diversity prevents it.
- E2 analysis add-ons (from the companion work order, numbers verified): new
  analysis.py (reduce_to_stationary, critical_grounding with bootstrap CI ->
  g*=0.048, 95% CI [0.047,0.050]); tail_band_metrics + per-band logging; the
  E2 figure rebuilt as a 2x2 (defined g*+CI, g=0 flagged as a finite-time
  artifact, tail item-vs-mass, per-rarity-band panel). Uses truth-mass-weighted
  tail coverage rather than the raw (martingale) tail_mass.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
Giorgio Gilestro 2026-07-04 18:54:42 +02:00
parent a6eb9b7512
commit 1721d047fa
42 changed files with 1938 additions and 135 deletions
Download patch file Download diff file Expand all files Collapse all files

BIN
results/E1/E1.pdf
View file

Binary file not shown.

4
results/E1/manifest.json
View file

@ -1,7 +1,7 @@
{
"experiment": "E1_reproduce_collapse",
"master_seed": 20260704,
"git_commit": null,
"git_commit": "a6eb9b75124779375fa1a0b3a64115ecd705b218",
"python": "3.14.5",
"libraries": {
"numpy": "2.5.0",
@ -10,5 +10,5 @@
"pyarrow": "24.0.0"
},
"rows": 60100,
"results_sha256": "e3d246b9d679e7f833dac05b1c3ef894a9e15a1e53218c20db53ec2a5b011bd7"
"results_sha256": "038bf62046d593a61d0177f988f76897c9af5d9c370dc4d19bf37dc68d47afde"
}

62
results/E1/resolved_config.yaml
View file

@ -1,37 +1,6 @@
experiment: E1_reproduce_collapse
seed: 20260704
n_replicates: 100
grid:
- label: {}
lineage_cfg:
truth:
K: 500
R: 1
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 100
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 0
policy: proportional
selection:
mode: none
novelty_alpha: 0.0
remint:
enabled: false
period: null
H_gate: null
generations: 600
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09
source_config:
experiment: E1_reproduce_collapse
seed: 20260704
@ -66,3 +35,34 @@ source_config:
support_eps: 1.0e-09
output:
dir: results/E1
grid:
- label: {}
lineage_cfg:
truth:
K: 500
R: 1
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 100
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 0
policy: proportional
selection:
mode: none
novelty_alpha: 0.0
remint:
enabled: false
period: null
H_gate: null
generations: 600
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09

BIN
results/E2/E2.pdf
View file

Binary file not shown.

BIN
results/E2/E2.png
View file

Binary file not shown.
Side by side Swipe Overlay

Before

Width:  |  Height:  |  Size: 168 KiB

After

Width:  |  Height:  |  Size: 328 KiB

Before After
Before After

4
results/E2/manifest.json
View file

@ -1,7 +1,7 @@
{
"experiment": "E2_grounding_phase_boundary",
"master_seed": 20260704,
"git_commit": null,
"git_commit": "a6eb9b75124779375fa1a0b3a64115ecd705b218",
"python": "3.14.5",
"libraries": {
"numpy": "2.5.0",
@ -10,5 +10,5 @@
"pyarrow": "24.0.0"
},
"rows": 400800,
"results_sha256": "863d9d0777db6916032ee34e8fe5651d24d86443dcd60de8d0da4220eb7625a3"
"results_sha256": "aa8633171f833611b9c2cde3d13c61e65a81a7c9c6cef5bc76a79127d8af59a3"
}

90
results/E2/resolved_config.yaml
View file

@ -1,6 +1,51 @@
experiment: E2_grounding_phase_boundary
seed: 20260704
n_replicates: 100
source_config:
experiment: E2_grounding_phase_boundary
seed: 20260704
n_replicates: 100
generations: 500
truth:
K: 1000
R: 1
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 200
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 0
policy: proportional
selection:
mode: none
novelty_alpha: 0.0
remint:
enabled: false
period: null
H_gate: null
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09
sweep:
- param: g
values:
- 0.0
- 0.005
- 0.01
- 0.02
- 0.05
- 0.1
- 0.2
- 0.4
output:
dir: results/E2
grid:
- label:
g: 0.0
@ -258,48 +303,3 @@ grid:
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09
source_config:
experiment: E2_grounding_phase_boundary
seed: 20260704
n_replicates: 100
generations: 500
truth:
K: 1000
R: 1
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 200
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 0
policy: proportional
selection:
mode: none
novelty_alpha: 0.0
remint:
enabled: false
period: null
H_gate: null
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09
sweep:
- param: g
values:
- 0.0
- 0.005
- 0.01
- 0.02
- 0.05
- 0.1
- 0.2
- 0.4
output:
dir: results/E2

BIN
results/E3/E3.pdf Normal file
View file

Binary file not shown.

BIN
results/E3/E3.png Normal file
View file

Binary file not shown.
Side by side

After

Width:  |  Height:  |  Size: 127 KiB

14
results/E3/manifest.json Normal file
View file

@ -0,0 +1,14 @@
{
"experiment": "E3_region_matched_grounding",
"master_seed": 20260704,
"git_commit": "a6eb9b75124779375fa1a0b3a64115ecd705b218",
"python": "3.14.5",
"libraries": {
"numpy": "2.5.0",
"scipy": "1.18.0",
"pandas": "3.0.3",
"pyarrow": "24.0.0"
},
"rows": 80200,
"results_sha256": "7ae056faf8db591a913087004068d0e732f10b0244cdc6a78bb72a691f4b8604"
}

111
results/E3/resolved_config.yaml Normal file
View file

@ -0,0 +1,111 @@
experiment: E3_region_matched_grounding
seed: 20260704
n_replicates: 100
source_config:
experiment: E3_region_matched_grounding
seed: 20260704
n_replicates: 100
generations: 400
truth:
K: 1000
R: 10
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 200
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 100
policy: uniform
exercised:
- 0
selection:
mode: none
novelty_alpha: 0.0
remint:
enabled: false
period: null
H_gate: null
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09
sweep:
- param: dynamics.grounding.policy
values:
- uniform
- matched
output:
dir: results/E3
grid:
- label:
policy: uniform
lineage_cfg:
truth:
K: 1000
R: 10
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 200
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 100
policy: uniform
exercised:
- 0
selection:
mode: none
novelty_alpha: 0.0
remint:
enabled: false
period: null
H_gate: null
generations: 400
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09
- label:
policy: matched
lineage_cfg:
truth:
K: 1000
R: 10
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 200
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 100
policy: matched
exercised:
- 0
selection:
mode: none
novelty_alpha: 0.0
remint:
enabled: false
period: null
H_gate: null
generations: 400
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09

BIN
results/E4/E4.pdf Normal file
View file

Binary file not shown.

BIN
results/E4/E4.png Normal file
View file

Binary file not shown.
Side by side

After

Width:  |  Height:  |  Size: 193 KiB

14
results/E4/manifest.json Normal file
View file

@ -0,0 +1,14 @@
{
"experiment": "E4_multiteacher_decorrelation",
"master_seed": 20260704,
"git_commit": "a6eb9b75124779375fa1a0b3a64115ecd705b218",
"python": "3.14.5",
"libraries": {
"numpy": "2.5.0",
"scipy": "1.18.0",
"pandas": "3.0.3",
"pyarrow": "24.0.0"
},
"rows": 12000,
"results_sha256": "a200ed088070015f41c983a367a252c09d06a865b45f117769df73fa00df52a2"
}

39
results/E4/resolved_config.yaml Normal file
View file

@ -0,0 +1,39 @@
experiment: E4_multiteacher_decorrelation
seed: 20260704
n_replicates: 200
source_config:
experiment: E4_multiteacher_decorrelation
kind: coverage
seed: 20260704
n_replicates: 200
truth:
K: 500
R: 1
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.002
coverage:
n: 300
q: 0.5
sweep:
- param: K_T
values:
- 1
- 2
- 3
- 5
- param: rho
values:
- 0.0
- 0.25
- 0.5
- 0.75
- 1.0
- param: g
values:
- 0.0
- 0.02
- 0.05
output:
dir: results/E4

BIN
results/E5/E5.pdf Normal file
View file

Binary file not shown.

BIN
results/E5/E5.png Normal file
View file

Binary file not shown.
Side by side

After

Width:  |  Height:  |  Size: 134 KiB

14
results/E5/manifest.json Normal file
View file

@ -0,0 +1,14 @@
{
"experiment": "E5_qd_vs_greedy",
"master_seed": 20260704,
"git_commit": "a6eb9b75124779375fa1a0b3a64115ecd705b218",
"python": "3.14.5",
"libraries": {
"numpy": "2.5.0",
"scipy": "1.18.0",
"pandas": "3.0.3",
"pyarrow": "24.0.0"
},
"rows": 360900,
"results_sha256": "16281de4d88951a0688ce8acf82ea9c122034b3faa9be7375b884f46e7b26786"
}

337
results/E5/resolved_config.yaml Normal file
View file

@ -0,0 +1,337 @@
experiment: E5_qd_vs_greedy
seed: 20260704
n_replicates: 100
source_config:
experiment: E5_qd_vs_greedy
seed: 20260704
n_replicates: 100
generations: 400
truth:
K: 500
R: 1
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 200
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 10
policy: proportional
selection:
mode: none
novelty_alpha: 0.0
remint:
enabled: false
period: null
H_gate: null
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09
sweep:
- param: dynamics.selection.mode
values:
- none
- greedy
- qd
- param: dynamics.selection.novelty_alpha
values:
- 0.5
- 1.0
- 2.0
output:
dir: results/E5
grid:
- label:
mode: none
novelty_alpha: 0.5
lineage_cfg:
truth:
K: 500
R: 1
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 200
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 10
policy: proportional
selection:
mode: none
novelty_alpha: 0.5
remint:
enabled: false
period: null
H_gate: null
generations: 400
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09
- label:
mode: none
novelty_alpha: 1.0
lineage_cfg:
truth:
K: 500
R: 1
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 200
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 10
policy: proportional
selection:
mode: none
novelty_alpha: 1.0
remint:
enabled: false
period: null
H_gate: null
generations: 400
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09
- label:
mode: none
novelty_alpha: 2.0
lineage_cfg:
truth:
K: 500
R: 1
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 200
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 10
policy: proportional
selection:
mode: none
novelty_alpha: 2.0
remint:
enabled: false
period: null
H_gate: null
generations: 400
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09
- label:
mode: greedy
novelty_alpha: 0.5
lineage_cfg:
truth:
K: 500
R: 1
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 200
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 10
policy: proportional
selection:
mode: greedy
novelty_alpha: 0.5
remint:
enabled: false
period: null
H_gate: null
generations: 400
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09
- label:
mode: greedy
novelty_alpha: 1.0
lineage_cfg:
truth:
K: 500
R: 1
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 200
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 10
policy: proportional
selection:
mode: greedy
novelty_alpha: 1.0
remint:
enabled: false
period: null
H_gate: null
generations: 400
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09
- label:
mode: greedy
novelty_alpha: 2.0
lineage_cfg:
truth:
K: 500
R: 1
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 200
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 10
policy: proportional
selection:
mode: greedy
novelty_alpha: 2.0
remint:
enabled: false
period: null
H_gate: null
generations: 400
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09
- label:
mode: qd
novelty_alpha: 0.5
lineage_cfg:
truth:
K: 500
R: 1
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 200
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 10
policy: proportional
selection:
mode: qd
novelty_alpha: 0.5
remint:
enabled: false
period: null
H_gate: null
generations: 400
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09
- label:
mode: qd
novelty_alpha: 1.0
lineage_cfg:
truth:
K: 500
R: 1
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 200
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 10
policy: proportional
selection:
mode: qd
novelty_alpha: 1.0
remint:
enabled: false
period: null
H_gate: null
generations: 400
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09
- label:
mode: qd
novelty_alpha: 2.0
lineage_cfg:
truth:
K: 500
R: 1
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 200
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 10
policy: proportional
selection:
mode: qd
novelty_alpha: 2.0
remint:
enabled: false
period: null
H_gate: null
generations: 400
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09

BIN
results/E6/E6.pdf Normal file
View file

Binary file not shown.

BIN
results/E6/E6.png Normal file
View file

Binary file not shown.
Side by side

After

Width:  |  Height:  |  Size: 228 KiB

14
results/E6/manifest.json Normal file
View file

@ -0,0 +1,14 @@
{
"experiment": "E6_remint_gate",
"master_seed": 20260704,
"git_commit": "a6eb9b75124779375fa1a0b3a64115ecd705b218",
"python": "3.14.5",
"libraries": {
"numpy": "2.5.0",
"scipy": "1.18.0",
"pandas": "3.0.3",
"pyarrow": "24.0.0"
},
"rows": 160400,
"results_sha256": "083106777ae2f8c5aff47f23a27fa111891c183464ebfee8d015dfc096974a80"
}

184
results/E6/resolved_config.yaml Normal file
View file

@ -0,0 +1,184 @@
experiment: E6_remint_gate
seed: 20260704
n_replicates: 100
source_config:
experiment: E6_remint_gate
seed: 20260704
n_replicates: 100
generations: 400
truth:
K: 500
R: 1
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 200
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 3
policy: proportional
selection:
mode: none
novelty_alpha: 0.0
remint:
enabled: false
period: 150
H_gate: null
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09
sweep:
- param: arm
values:
- name: healthy_remint
set:
dynamics.grounding.m: 60
dynamics.remint.enabled: true
dynamics.remint.H_gate: null
- name: collapsed_remint
set:
dynamics.grounding.m: 1
dynamics.remint.enabled: true
dynamics.remint.H_gate: null
- name: collapsed_gated
set:
dynamics.grounding.m: 1
dynamics.remint.enabled: true
dynamics.remint.H_gate: 0.75
- name: collapsed_noremint
set:
dynamics.grounding.m: 1
dynamics.remint.enabled: false
output:
dir: results/E6
grid:
- label:
arm: healthy_remint
lineage_cfg:
truth:
K: 500
R: 1
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 200
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 60
policy: proportional
selection:
mode: none
novelty_alpha: 0.0
remint:
enabled: true
period: 150
H_gate: null
generations: 400
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09
- label:
arm: collapsed_remint
lineage_cfg:
truth:
K: 500
R: 1
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 200
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 1
policy: proportional
selection:
mode: none
novelty_alpha: 0.0
remint:
enabled: true
period: 150
H_gate: null
generations: 400
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09
- label:
arm: collapsed_gated
lineage_cfg:
truth:
K: 500
R: 1
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 200
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 1
policy: proportional
selection:
mode: none
novelty_alpha: 0.0
remint:
enabled: true
period: 150
H_gate: 0.75
generations: 400
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09
- label:
arm: collapsed_noremint
lineage_cfg:
truth:
K: 500
R: 1
tail: zipf
zipf_s: 1.1
tail_frac: 0.5
tail_threshold: 0.001
init: truth
dynamics:
n: 200
teachers:
K_T: 1
rho: 0.0
q: 1.0
grounding:
m: 1
policy: proportional
selection:
mode: none
novelty_alpha: 0.0
remint:
enabled: false
period: 150
H_gate: null
generations: 400
metrics:
kl_floor: 1.0e-09
support_eps: 1.0e-09