CyanMonkey
/

TestSubject-2

Model card Files Files and versions

TestSubject-2

Rose X1.5 SLM (98.8M params).

Architecture

Property	Value
Layers	22
Hidden	576
Heads	9 (kv=3)
QK Norm	True
XSA	True
Refresh Gate	[6, 13]
Params	98.766M

Training

Tokens: 5,030,707,200
Val PPL: 11.63
Optimizer: muon_adamw

Downloads last month: -

Safetensors

Model size

98.8M params

Tensor type

F32

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support