Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

vector-quantization

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

75

Base only

Active filters: vector-quantization

TheDrainFlorist/Qwen3.8-Flash-Next-VQ-2.1bpw

Text Generation • 25B • Updated about 16 hours ago • 1.92k • 3

TheDrainFlorist/Qwen3.8-27B-VQ-4.5bpw

Text Generation • 19B • Updated 2 days ago • 1.43k • 1

TheDrainFlorist/Qwen3.8-Flash-Next-VQ-3.2bpw

Text Generation • 43B • Updated about 16 hours ago • 1.25k • 1

TheDrainFlorist/Qwen3.8-Flash-Next-VQ-4.4bpw

Text Generation • 90B • Updated about 16 hours ago • 1.27k • 1

ik/speechless-twi-stage1-rvq-whisper-medium

Updated Sep 2, 2025

ik/speechless-twi-stage1-rvq-twiwhisper-merged

Updated Sep 2, 2025

XuejiFang/UniTok_transformers

Image-to-Image • 0.8B • Updated Sep 13, 2025 • 8

robotics-diffusion-transformer/RVQActionTokenizer

Robotics • 0.4B • Updated Feb 7 • 78 • 3

khania/motion-mgvqvae

Feature Extraction • Updated Mar 26 • 5

TTS-AGI/DACVAE-RVQ-vocab16k-400-hz

Updated Mar 21 • 6

EchoLabs33/zamba2-1.2b-hxq

Text Generation • 1B • Updated Apr 18 • 25

EchoLabs33/tinyllama-1.1b-hxq

Text Generation • 1B • Updated Apr 18 • 15

EchoLabs33/mamba-130m-hxq

Text Generation • 0.1B • Updated Apr 18 • 17

EchoLabs33/qwen2.5-coder-3b-hxq

Text Generation • 3B • Updated May 9 • 64

EchoLabs33/qwen2.5-3b-instruct-hxq

Text Generation • 3B • Updated Apr 28 • 67

EchoLabs33/mamba2-1.3b-hxq

Text Generation • 1B • Updated Apr 18 • 20

EchoLabs33/qwen2.5-7b-instruct-hxq

Text Generation • 8B • Updated May 9 • 29

EchoLabs33/qwen2.5-14b-instruct-hxq

Text Generation • 15B • Updated Apr 28 • 148

EchoLabs33/zamba2-2.7b-instruct-hxq

Text Generation • 3B • Updated May 10 • 254

EchoLabs33/zamba2-7b-instruct-hxq

Text Generation • 13B • Updated Apr 18 • 42

eugenehp/NeuroRVQ

Feature Extraction • Updated Mar 31 • 20 • 1

EchoLabs33/olmoe-1b-7b-instruct-hxq

Text Generation • 7B • Updated Apr 18 • 9

EchoLabs33/clip-vit-large-patch14-hxq

Zero-Shot Image Classification • 0.4B • Updated Apr 18 • 12

EchoLabs33/bert-base-uncased-hxq

Fill-Mask • 0.1B • Updated Apr 3 • 4

lew96123/qwen3.5-0.8b-custom-packed-8bit

Image-Text-to-Text • Updated Apr 6 • 3

lew96123/qwen3.5-0.8b-custom-packed-4bit

Image-Text-to-Text • Updated Apr 6 • 6

lew96123/qwen3.5-0.8b-custom-packed-2bit

Image-Text-to-Text • Updated Apr 6 • 10

lew96123/qwen3.5-0.8b-custom-packed-1bit

Image-Text-to-Text • Updated Apr 6 • 23 • 1

ik/speechless-twi-stage1-rvq-gemma4

Updated Apr 12 • 1

ik/speechless-twi-stage1-rvq-gemma4-512