Instructions to use arcadia-impact/dispatch-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use arcadia-impact/dispatch-models with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
card: midtrain/ -- the arm before instruction tuning
Browse files41 arms now carry <family>/<arm>/midtrain/: the final midtrain save, before Dolci SFT, copied from scimt-dispatch-final-v1 and -glm and checked by sha256. Layout block and a paragraph naming the arms without one.
README.md
CHANGED
|
@@ -42,6 +42,7 @@ motivation is what the experiments vary.
|
|
| 42 |
|
| 43 |
```
|
| 44 |
<family>/<arm>/base/ the midtrained + instruction-tuned model the adapters load onto
|
|
|
|
| 45 |
<family>/<arm>/aft/<treatment>/ elicitation-finetuning LoRA adapters, by treatment and step
|
| 46 |
<family>/<arm>/training/ training records for that arm
|
| 47 |
batteries/ raw eval responses, one archive per endpoint
|
|
@@ -66,6 +67,14 @@ carry the dose ladder also have `charter_0p25pct` through `charter_5pct` and
|
|
| 66 |
quarter of a percent to five percent. The mixtures themselves are in
|
| 67 |
[`dispatch-eft`](https://huggingface.co/datasets/arcadia-impact/dispatch-eft).
|
| 68 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 69 |
`MODELS_DEFERRED.json` at the root is the worklist for a later checkpoint port.
|
| 70 |
The standing policy through this consolidation was to take evals and scores now
|
| 71 |
and defer weights, and that file records what was deferred, where it lives and
|
|
|
|
| 42 |
|
| 43 |
```
|
| 44 |
<family>/<arm>/base/ the midtrained + instruction-tuned model the adapters load onto
|
| 45 |
+
<family>/<arm>/midtrain/ the same model before instruction tuning, straight out of midtraining
|
| 46 |
<family>/<arm>/aft/<treatment>/ elicitation-finetuning LoRA adapters, by treatment and step
|
| 47 |
<family>/<arm>/training/ training records for that arm
|
| 48 |
batteries/ raw eval responses, one archive per endpoint
|
|
|
|
| 67 |
quarter of a percent to five percent. The mixtures themselves are in
|
| 68 |
[`dispatch-eft`](https://huggingface.co/datasets/arcadia-impact/dispatch-eft).
|
| 69 |
|
| 70 |
+
**`midtrain/`** is the arm at the end of midtraining, before the Dolci
|
| 71 |
+
instruction-tuning stage that produces `base/` — for studying what midtraining
|
| 72 |
+
alone installs. The adapters were trained on `base/`, not on this. Most carry a
|
| 73 |
+
`PROVENANCE.json` naming the source repo, revision and per-file sha256. There
|
| 74 |
+
is none for `glm45_air_190m/control` or the `glm45_air_20m_legacy` arms, whose
|
| 75 |
+
midtrain checkpoints were not kept, nor for `gemma4_26b_a4b_graft`, which is
|
| 76 |
+
grafted rather than midtrained.
|
| 77 |
+
|
| 78 |
`MODELS_DEFERRED.json` at the root is the worklist for a later checkpoint port.
|
| 79 |
The standing policy through this consolidation was to take evals and scores now
|
| 80 |
and defer weights, and that file records what was deferred, where it lives and
|