scibert_application_form_20250221

Fine-tuned model from the PsyNamic project.

Superseded. This is the model of the initial PsyNamic submission (tag submission-v1). It was replaced after retraining under a corrected protocol (Nov 2026) by STRIDE-lab/biomedbert-abstract-application-form-20261106. All current models: PsyNamic collection.

Base Model

allenai/scibert_scivocab_uncased

Task

Application Form (multi-label: several labels per abstract possible)

Describes how the substance was administered (e.g., oral, nasal, intravenous).

Labels (id2label)

ID Label Definition
0 Oral –
1 Nasal –
2 Intravenous –
3 Smoking Including inhalation.
4 Subcutaneous –
5 Other Including sublingual.
6 Unknown –
7 Not applicable E.g., for systematic reviews.

Training Parameters

{
  "mode": "train",
  "data": "<private_dataset>",
  "task": "Application Form",
  "model": "scibert",
  "cross_val": false,
  "batch_size": 8,
  "learning_rate": 5e-05,
  "weight_decay": 0.01,
  "lr_scheduler": "linear",
  "warmup_ratio": 0.1,
  "epochs": 30,
  "dropout": 0.1,
  "early_stopping_patience": 5,
  "gradient_clipping": 0.1,
  "device": "cuda",
  "load": null,
  "max_length": 512,
  "is_multilabel": true
}
Downloads last month
85
Safetensors
Model size
0.1B params
Tensor type
F32
Β·
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for STRIDE-lab/scibert-application-form-20250221

Finetuned
(140)
this model

Collection including STRIDE-lab/scibert-application-form-20250221