sidbaines commited on
Commit
8c2dfed
·
verified ·
1 Parent(s): af89100

card: midtrain/ -- the arm before instruction tuning

Browse files

41 arms now carry <family>/<arm>/midtrain/: the final midtrain save, before Dolci SFT, copied from scimt-dispatch-final-v1 and -glm and checked by sha256. Layout block and a paragraph naming the arms without one.

Files changed (1) hide show
  1. README.md +9 -0
README.md CHANGED
@@ -42,6 +42,7 @@ motivation is what the experiments vary.
42
 
43
  ```
44
  <family>/<arm>/base/ the midtrained + instruction-tuned model the adapters load onto
 
45
  <family>/<arm>/aft/<treatment>/ elicitation-finetuning LoRA adapters, by treatment and step
46
  <family>/<arm>/training/ training records for that arm
47
  batteries/ raw eval responses, one archive per endpoint
@@ -66,6 +67,14 @@ carry the dose ladder also have `charter_0p25pct` through `charter_5pct` and
66
  quarter of a percent to five percent. The mixtures themselves are in
67
  [`dispatch-eft`](https://huggingface.co/datasets/arcadia-impact/dispatch-eft).
68
 
 
 
 
 
 
 
 
 
69
  `MODELS_DEFERRED.json` at the root is the worklist for a later checkpoint port.
70
  The standing policy through this consolidation was to take evals and scores now
71
  and defer weights, and that file records what was deferred, where it lives and
 
42
 
43
  ```
44
  <family>/<arm>/base/ the midtrained + instruction-tuned model the adapters load onto
45
+ <family>/<arm>/midtrain/ the same model before instruction tuning, straight out of midtraining
46
  <family>/<arm>/aft/<treatment>/ elicitation-finetuning LoRA adapters, by treatment and step
47
  <family>/<arm>/training/ training records for that arm
48
  batteries/ raw eval responses, one archive per endpoint
 
67
  quarter of a percent to five percent. The mixtures themselves are in
68
  [`dispatch-eft`](https://huggingface.co/datasets/arcadia-impact/dispatch-eft).
69
 
70
+ **`midtrain/`** is the arm at the end of midtraining, before the Dolci
71
+ instruction-tuning stage that produces `base/` — for studying what midtraining
72
+ alone installs. The adapters were trained on `base/`, not on this. Most carry a
73
+ `PROVENANCE.json` naming the source repo, revision and per-file sha256. There
74
+ is none for `glm45_air_190m/control` or the `glm45_air_20m_legacy` arms, whose
75
+ midtrain checkpoints were not kept, nor for `gemma4_26b_a4b_graft`, which is
76
+ grafted rather than midtrained.
77
+
78
  `MODELS_DEFERRED.json` at the root is the worklist for a later checkpoint port.
79
  The standing policy through this consolidation was to take evals and scores now
80
  and defer weights, and that file records what was deferred, where it lives and