Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,473

Base only

Active filters: moe

InternScience/Agents-A1-Q4_K_M-GGUF

Text Generation • 35B • Updated 26 days ago • 24.6k • 140

thinkingmachines/Inkling-Small-NVFP4

Image-Text-to-Text • 156B • Updated 11 days ago • 125k • 69

gbuzhf/KAT-Coder-V2.5-Dev-MTP-GGUF

36B • Updated 8 days ago • 25k • 9

mlx-community/DeepSeek-V4-Flash-0731-2.4bit-mixed

Text Generation • 26B • Updated 5 days ago • 1.15k • 9

ManniX-ITA/Qwen3.6-27B-A3B-Coder-MTP-GGUF

Text Generation • 26B • Updated 7 days ago • 77.9k • 26

nerkyor/Qwen3.6-35B-A3B-DSV4Pro-SFT-GPT56Sol-RL-Agent-GGUF

35B • Updated 9 days ago • 32.8k • 13

LiquidAI/LFM2.5-8B-A1B-MLX-8bit

Text Generation • 8B • Updated Jun 1 • 1.51k • 29

otheru/DeepSeek-V4-Flash-Strix-Halo-GGUF

Text Generation • 284B • Updated about 16 hours ago • 2.22k • 12

Vontra/DeepSeek-V4-Flash-0731-MXFP4-MLX

Text Generation • 59B • Updated 7 days ago • 8.82k • 14

True2456/DeepSeek-V4-Flash-0731-REAP37-native-MLX

Text Generation • 31B • Updated 8 days ago • 2.29k • 12

olka-fi/Ling-3.0-flash-MXFP4

Text Generation • 127B • Updated 5 days ago • 1.36k • 6

sakamakismile/Ling-3.0-flash-W4A4-NVFP4

Text Generation • 75B • Updated 4 days ago • 157 • 6

LiquidAI/LFM2-8B-A1B-GGUF

Text Generation • 8B • Updated Jun 29 • 1.91k • 117

LiquidAI/LFM2-8B-A1B-ONNX

Text Generation • Updated Jun 29 • 135 • 10

LiquidAI/LFM2-8B-A1B-smoltalk-LoRA

Updated Jun 10 • 12 • 9

LiquidAI/LFM2-24B-A2B-ONNX

Text Generation • Updated Mar 25 • 97 • 13

LiquidAI/LFM2-24B-A2B-MLX-bf16

Text Generation • 24B • Updated Feb 24 • 81 • 7

LiquidAI/LFM2-24B-A2B-MLX-8bit

Text Generation • 24B • Updated Feb 24 • 166 • 18

LiquidAI/LFM2-24B-A2B-MLX-6bit

Text Generation • 24B • Updated Feb 24 • 102 • 8

LiquidAI/LFM2-24B-A2B-MLX-5bit

Text Generation • 24B • Updated Feb 24 • 87 • 6

LiquidAI/LFM2-24B-A2B-MLX-4bit

Text Generation • 24B • Updated Feb 24 • 183 • 10

LiquidAI/LFM2.5-8B-A1B-ONNX

Text Generation • Updated May 29 • 81 • 11

LiquidAI/LFM2.5-8B-A1B-MLX-4bit

Text Generation • 1B • Updated Jun 1 • 1.21k • 15

LiquidAI/LFM2.5-8B-A1B-MLX-6bit

Text Generation • 8B • Updated Jun 1 • 433 • 8

LiquidAI/LFM2.5-8B-A1B-MLX-5bit

Text Generation • 8B • Updated Jun 1 • 307 • 8

LiquidAI/LFM2.5-8B-A1B-MLX-bf16

Text Generation • 8B • Updated Jun 1 • 355 • 8

unsloth/Inkling-Small-GGUF

Image-Text-to-Text • 264B • Updated 10 days ago • 97.7k • 77

nazeshinjite/DeepSeek-V4-Flash-0731-ds4-GGUF

Text Generation • 20B • Updated 7 days ago • 28.2k • 21

peculiar-ragdoll/Nail-Qwen3.6-35B-A3B-MLX

Image-Text-to-Text • 6B • Updated about 18 hours ago • 5

huihui-ai/Huihui-Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated

Text Generation • 36B • Updated Apr 21 • 25k • • 197