Giorgio Gilestro
84124de143
Clarity pass over the main text (36-item audit), Discussion rewrite and cut, acknowledgements, Souly et al. as ref 62, lettered SI panels, model section moved under Results; plus the untracked curriculum/society/compose/smol configs, runners, figures, stats and tests that the SI already cites. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01Y64o8FKP7rCuXzC48pxpMm
30 lines
648 B
YAML
30 lines
648 B
YAML
# Second base lineage (manuscript revision 2026-09-12): the Fisher-Muller replication of merge_seeds on
|
|
# SmolLM2-1.7B-Instruct (HuggingFaceTB, Apache-2.0, Llama architecture) instead of Qwen. adapters_dir is
|
|
# moved because the specialist cache is keyed by family and seed only. Runs via hpc/llm_smol.pbs.
|
|
experiment: llm_merge_seeds_smol
|
|
kind: llm_merge
|
|
seed: 1
|
|
seeds:
|
|
- 1
|
|
- 2
|
|
- 3
|
|
- 4
|
|
- 5
|
|
n_replicates: 1
|
|
base_model: HuggingFaceTB/SmolLM2-1.7B-Instruct
|
|
families:
|
|
- lists
|
|
- strings
|
|
- arith
|
|
n_train: 600
|
|
n_test: 100
|
|
epochs: 3
|
|
lora:
|
|
r: 16
|
|
alpha: 32
|
|
merges:
|
|
- soup
|
|
- ties
|
|
output:
|
|
dir: results/llm_merge_seeds_smol
|
|
adapters_dir: models/llm_smol
|