Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

213

Base only

Active filters: ik_llama.cpp

ji-farthing/DeepSeek-V4.1-Flash-1017-Abliterated-ik-llama-GGUF

Text Generation • Updated 5 days ago • 36 • 7

PollardWeights/Qwen2.5-Coder-1.5B-Instruct-Pollard

Text Generation • 2B • Updated Sep 10 • 72 • 2

christopherthompson81/Qwen3.8-27B-IQ4_KS-GGUF

27B • Updated 3 days ago • 246 • 1

PollardWeights/Nanbeige4.3-33B-Pollard

Text Generation • 33B • Updated 5 days ago • 1.3k • 1

Austriani/Gemma-4-E2B-it-ik_llama.cpp

5B • Updated 2 days ago • 629 • 1

Austriani/Nemotron-3.5-Bolt-E4B-Heretic-ik_llama.cpp

7B • Updated about 7 hours ago • 1

Austriani/MiniCPM5-2B-Heretic-ARA-ik_llama.cpp

3B • Updated about 3 hours ago • 1

NexesQuants/Llama-3.3-Nemotron-70B-Instruct-Abliterated-TA_v0.10-iMat-CQ-GGUF

71B • Updated Jul 17, 2025 • 204

ubergarm/DeepSeek-V3-0324-GGUF

Text Generation • 672B • Updated Jul 10, 2025 • 106 • 36

ubergarm/gemma-3-27b-it-qat-GGUF

Text Generation • 27B • Updated Jul 10, 2025 • 41 • 12

tdh111/bitnet-b1.58-2B-4T-GGUF

Text Generation • 3B • Updated May 16, 2025 • 350 • 10

ubergarm/Qwen3-235B-A22B-GGUF

Text Generation • 235B • Updated Jul 22, 2025 • 39 • 29

ArtusDev/Qwen3-235B-A22B-GGUF

Text Generation • 235B • Updated May 2, 2025 • 43 • 2

ubergarm/Qwen3-30B-A3B-GGUF

Text Generation • 31B • Updated Jul 10, 2025 • 115 • 20

ubergarm/DeepSeek-R1T-Chimera-GGUF

Text Generation • 672B • Updated Jul 10, 2025 • 56 • 1

ubergarm/Qwen3-14B-GGUF

Text Generation • 15B • Updated Jul 19, 2025 • 34 • 4

NexesQuants/mistral-small-3.1-24b-instruct-2503-iMat-IKLQ-GGUF

24B • Updated Jul 5, 2025 • 96

ubergarm/DeepSeek-R1-0528-GGUF

Text Generation • 672B • Updated Jul 19, 2025 • 318 • 53

NexesQuants/SicariusSicarii_Nano_Imp_1B-iMat-IKL-NXS-CQ-GGUF

1B • Updated Jul 5, 2025 • 14 • 1

NexesQuants/Gemma-3-4b_X-Ray-Abli_Linear_v1.01-iMat-IKL-NXS-CQ-GGUF

4B • Updated Jul 5, 2025 • 21

anikifoss/DeepSeek-R1-0528-DQ4_K_R4

Text Generation • 672B • Updated Nov 27, 2025 • 113 • 9

NexesQuants/Fallen-Gemma3-27B-v1-Q8_0-iMat-IKL-NXS-GGUF

27B • Updated Jul 5, 2025 • 22

NexesQuants/google_gemma-3-27b-it-qat-q4_0-unquantized-iMat-NXS-GGUF

27B • Updated Jul 5, 2025 • 72

ubergarm/Kimi-Dev-72B-GGUF

Text Generation • 73B • Updated Jul 10, 2025 • 72 • 3

ubergarm/Hunyuan-A13B-Instruct-GGUF

Text Generation • 80B • Updated Jul 10, 2025 • 50 • 13

Kebob/DeepSeek-V3-0324-IK_GGUF

671B • Updated Jul 6, 2025 • 62 • 1

Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF

671B • Updated Jul 8, 2025 • 50 • 2

Kebob/DeepSeek-R1-0528-IK_GGUF

671B • Updated Jul 6, 2025 • 7 • 1

ubergarm/DeepSeek-TNG-R1T2-Chimera-GGUF

Text Generation • 672B • Updated Jul 11, 2025 • 132 • 6

NexesQuants/gghfez_Writer-Large-2411-iMat-IKL-CQ-GGUF

123B • Updated Jul 31, 2025 • 49