clef-GGUF

GGUF BF16, Q8_0 and Q4_K_M, for llama.cpp b11671. A quantized build of Cloudflare's Clef (27B), made for "The Noise Floor of a Quantization Comparison" by Aleks Blagojevich and Trevor Sunderland (Level5). This isn't an official Cloudflare release.

Paper: https://arxiv.org/abs/2611.15671

Measurements, recipes and per-record outputs: https://github.com/Level5Tech/clef-quant-bench

The paper and all six builds, in one collection: https://huggingface.co/collections/Level5Tech/the-noise-floor-of-a-quantization-comparison-6afd62e8288cc5e14becefaf

Archived release (all versions): https://doi.org/10.5281/zenodo.24184497

The base model is under Apache-2.0. Its LICENSE is included here, and NOTICE says these weights were modified by quantization.

Citation

@misc{blagojevich2026noisefloorquantizationcomparison,
  title={The Noise Floor of a Quantization Comparison: Engine, restart, batch and kernel drift, measured against 8-bit and 4-bit effects in two decision models},
  author={Aleks Blagojevich and Trevor Sunderland},
  year={2026},
  eprint={2611.15671},
  archivePrefix={arXiv},
  primaryClass={cs.LG},
  url={https://arxiv.org/abs/2611.15671},
}
Downloads last month
701
GGUF
Model size
27B params
Architecture
clef
Hardware compatibility
Log In to add your hardware

4-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Level5Tech/clef-GGUF

Base model

Qwen/Qwen3.8-27B
Finetuned
Cloudflare/clef
Quantized
(46)
this model

Collection including Level5Tech/clef-GGUF

Paper for Level5Tech/clef-GGUF