Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

llama-cpp-python

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

41

Base only

Active filters: llama-cpp-python

asumansaree/trendyol_llm_7b_chat_v1_0_gguf

Text Generation • 7B • Updated Jun 20, 2025 • 29

Sakalti/nekomata-7b-gguf

Text Generation • 8B • Updated Oct 17, 2024 • 15

erdemyavuz/llama-3-8b-chat-doctor

8B • Updated Mar 3 • 33 • 1

seasparks/Llama-3.1-8B-Instruct-LegalCite-gguf

Text Generation • 8B • Updated Apr 7, 2025 • 23

Prince-1/orpheus_3b_0.1_GGUF

Text-to-Speech • 3B • Updated May 1, 2025 • 520

marcorez8/llama-cpp-python-windows-blackwell-cuda

Updated Jun 2, 2025 • 4

dougeeai/llama-cpp-python-wheels

Updated Nov 9, 2025 • 12

terasut/typhoon-si-med-thinking-4b-research-preview-GGUF

Text Generation • 4B • Updated Jan 21 • 19

intrect/VELA

Text Generation • 8B • Updated Apr 1 • 184 • 4

Habibur2/Phi-3.5-mini-GGUF

Text Generation • 4B • Updated Jan 30 • 7

Habibur2/Qwen2.5-0.5B-GGUF

Text Generation • 0.5B • Updated Jan 30 • 29 • 1

Habibur2/Qwen2.5-Math-1.5B-GGUF

Text Generation • 2B • Updated Jan 31 • 30 • 2

chronorus/chatbot-poc

3B • Updated Feb 1 • 12

trajis-tech/llama-cpp-python-trajis-tech-nonavx512-cuda

ClaireLee2429/gemma-2b-recipes-gguf

Text Generation • 3B • Updated Feb 17 • 41

James040/llama-cpp-python-wheels

pushkarsharma/LegalSahayk_q4_k_m

Text Generation • 8B • Updated Mar 12 • 18

jeremygracey-ai/FetchMerck_AI

Text Generation • 7B • Updated Apr 23 • 46 • 1

AaryanK/ModelGate

Text Classification • 2B • Updated Mar 22 • 108 • 5

enwrit/writ-lint-0.8B

Text Generation • 0.8B • Updated Mar 25 • 29

ericflo/qwen3-0.6b-summarizer

Summarization • 0.6B • Updated Apr 5 • 176

kertpoli/lua-coder-qwen25-3b-gguf

Text Generation • 3B • Updated Apr 15 • 45

neuralbroker/blitzkode

Text Generation • 2B • Updated May 16 • 25

flwrlabs/Lizzy-7B-GGUF

Text Generation • 7B • Updated May 25 • 242 • 14

maytman12/s2s-complete-setup

Automatic Speech Recognition • Updated Apr 28 • 28 • 1

Theogott/spr-qwen3_5-9b-dora-vramsafe-gguf

Text Generation • 9B • Updated May 1 • 73 • 1

pragnyanramtha/gguf-chat-template-truncation-poc

1.03M • Updated May 12 • 16

Roopalgn/sahayak-tb-gemma4-e2b-gguf

Text Generation • 5B • Updated May 18 • 90

sankalphs/noir-verdict-nemotron-4b-gguf

Text Generation • 4B • Updated Jun 14 • 24

yiyuliu/voice-command-intent-qwen0.5b

Text Generation • 0.5B • Updated Jul 12 • 37