llm_society campaign: 4 seed-configs (N=8, G=10, 4 arms) + CX3 PBS array
Queue strategy per GG: one self-contained job per seed (founders inline - no cache races, no dependencies), single L40S, 6 h walltime (measured: pilot ran 31 min/arm on the A4000, so a seed is ~2.5-3.5 h) - short independent jobs that backfill well. Seed 1 runs locally on the A4000 as queue insurance; seeds 2-4 go to CX3 as array elements. 0.5B for the campaign (sign-level, seed-replicated, the paper's established pattern); a single 7B confirm of the headline contrast is the post-campaign step. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01BkRLcc18rwT2Lysu6PbG7v
This commit is contained in:
parent
9e83aa7034
commit
8086504f44
5 changed files with 117 additions and 0 deletions
23
configs/llm/society_campaign_s1.yaml
Normal file
23
configs/llm/society_campaign_s1.yaml
Normal file
|
|
@ -0,0 +1,23 @@
|
|||
# The society campaign: 4-arm ablation, one seed per job (founders trained inline, no cache races).
|
||||
# Seed 1 runs locally (A4000, queue insurance); seeds 2-4 on CX3 (hpc/llm_society.pbs, L40S).
|
||||
experiment: llm_society_campaign
|
||||
kind: llm_society
|
||||
base_model: Qwen/Qwen2.5-0.5B-Instruct
|
||||
seed: 1
|
||||
agents: 8
|
||||
generations: 10
|
||||
arms: [full, no_grounding, no_sex, no_diversity]
|
||||
g: 0.5
|
||||
lam: 0.3
|
||||
n_test: 40
|
||||
n_val: 30
|
||||
n_conf: 90
|
||||
n_inherit: 600
|
||||
n_candidates: 6
|
||||
elitism: 1
|
||||
n_parents: 4
|
||||
epochs: 3
|
||||
spec_train: 600
|
||||
spec_epochs: 3
|
||||
lora: {r: 16, alpha: 32}
|
||||
output: {dir: results/llm_society_campaign/s1}
|
||||
23
configs/llm/society_campaign_s2.yaml
Normal file
23
configs/llm/society_campaign_s2.yaml
Normal file
|
|
@ -0,0 +1,23 @@
|
|||
# The society campaign: 4-arm ablation, one seed per job (founders trained inline, no cache races).
|
||||
# Seed 1 runs locally (A4000, queue insurance); seeds 2-4 on CX3 (hpc/llm_society.pbs, L40S).
|
||||
experiment: llm_society_campaign
|
||||
kind: llm_society
|
||||
base_model: Qwen/Qwen2.5-0.5B-Instruct
|
||||
seed: 2
|
||||
agents: 8
|
||||
generations: 10
|
||||
arms: [full, no_grounding, no_sex, no_diversity]
|
||||
g: 0.5
|
||||
lam: 0.3
|
||||
n_test: 40
|
||||
n_val: 30
|
||||
n_conf: 90
|
||||
n_inherit: 600
|
||||
n_candidates: 6
|
||||
elitism: 1
|
||||
n_parents: 4
|
||||
epochs: 3
|
||||
spec_train: 600
|
||||
spec_epochs: 3
|
||||
lora: {r: 16, alpha: 32}
|
||||
output: {dir: results/llm_society_campaign/s2}
|
||||
23
configs/llm/society_campaign_s3.yaml
Normal file
23
configs/llm/society_campaign_s3.yaml
Normal file
|
|
@ -0,0 +1,23 @@
|
|||
# The society campaign: 4-arm ablation, one seed per job (founders trained inline, no cache races).
|
||||
# Seed 1 runs locally (A4000, queue insurance); seeds 2-4 on CX3 (hpc/llm_society.pbs, L40S).
|
||||
experiment: llm_society_campaign
|
||||
kind: llm_society
|
||||
base_model: Qwen/Qwen2.5-0.5B-Instruct
|
||||
seed: 3
|
||||
agents: 8
|
||||
generations: 10
|
||||
arms: [full, no_grounding, no_sex, no_diversity]
|
||||
g: 0.5
|
||||
lam: 0.3
|
||||
n_test: 40
|
||||
n_val: 30
|
||||
n_conf: 90
|
||||
n_inherit: 600
|
||||
n_candidates: 6
|
||||
elitism: 1
|
||||
n_parents: 4
|
||||
epochs: 3
|
||||
spec_train: 600
|
||||
spec_epochs: 3
|
||||
lora: {r: 16, alpha: 32}
|
||||
output: {dir: results/llm_society_campaign/s3}
|
||||
23
configs/llm/society_campaign_s4.yaml
Normal file
23
configs/llm/society_campaign_s4.yaml
Normal file
|
|
@ -0,0 +1,23 @@
|
|||
# The society campaign: 4-arm ablation, one seed per job (founders trained inline, no cache races).
|
||||
# Seed 1 runs locally (A4000, queue insurance); seeds 2-4 on CX3 (hpc/llm_society.pbs, L40S).
|
||||
experiment: llm_society_campaign
|
||||
kind: llm_society
|
||||
base_model: Qwen/Qwen2.5-0.5B-Instruct
|
||||
seed: 4
|
||||
agents: 8
|
||||
generations: 10
|
||||
arms: [full, no_grounding, no_sex, no_diversity]
|
||||
g: 0.5
|
||||
lam: 0.3
|
||||
n_test: 40
|
||||
n_val: 30
|
||||
n_conf: 90
|
||||
n_inherit: 600
|
||||
n_candidates: 6
|
||||
elitism: 1
|
||||
n_parents: 4
|
||||
epochs: 3
|
||||
spec_train: 600
|
||||
spec_epochs: 3
|
||||
lora: {r: 16, alpha: 32}
|
||||
output: {dir: results/llm_society_campaign/s4}
|
||||
Loading…
Add table
Add a link
Reference in a new issue