dolphin03_hermes05_ties

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the TIES merge method using meta-llama/Llama-3.1-8B as a base.

Models Merged

The following models were included in the merge:

  • ./hermes_slerp_0.5
  • ./dolphin_slerp_0.3

Configuration

The following YAML configuration was used to produce this model:

base_model: meta-llama/Llama-3.1-8B
dtype: bfloat16
merge_method: ties
models:
- model: ./dolphin_slerp_0.3
  parameters:
    density: 0.5
    weight: 0.5
- model: ./hermes_slerp_0.5
  parameters:
    density: 0.5
    weight: 0.5
parameters:
  int8_mask: true
  normalize: false
Downloads last month
29
Safetensors
Model size
8B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for ForSureTesterSim/dolphin03-hermes05-ties

Finetuned
(1,454)
this model

Paper for ForSureTesterSim/dolphin03-hermes05-ties