Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,247

Base only

Active filters: llama-cpp

BennyDaBall/Krea-2-Engineer-V1-GGUF

Text Generation • 4B • Updated 7 days ago • 2.69k • 20

jica98/qwen3.5-4B-super-coder

Text Generation • 4B • Updated 7 days ago • 18k • 24

vcruz305/Ornith-1.0-35B-AEON-Ultimate-Uncensored-GGUF

Text Generation • 35B • Updated 1 day ago • 8.61k • 10

LordNeel/Agents-A1-GGUF

Text Generation • 35B • Updated 3 days ago • 9.53k • 9

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated 21 days ago • 20.2k • 83

prithivMLmods/VibeThinker-3B-GGUF

Text Generation • 3B • Updated 18 days ago • 55.5k • 66

LordNeel/Ornith-1.0-35B-GGUF-llamacpp-tp1

Text Generation • 35B • Updated 4 days ago • 17.5k • 9

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated 24 days ago • 12.4k • 104

Bahushruth/Qwen3.6-35B-A3B-abliterated-v4-GGUF

Text Generation • 35B • Updated 1 day ago • 7.5k • 6

wepiqx/Ornith-1.0-9B-ASHQ1-GGUF

Text Generation • 9B • Updated 3 days ago • 1.61k • 7

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 9.73k • 319

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 15k • 732

mitkox/FastContext-1.0-4B-SFT-Q4_K_M-GGUF

4B • Updated 19 days ago • 3.49k • 15

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 33.4k • 33

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 20k • 51

shuhulx/Qwopus3.5-4B-Coder-Fable5-v1-GGUF

Text Generation • 4B • Updated 18 days ago • 4.33k • 6

Gwakweena/Huihui-Qwen-AgentWorld-35B-A3B-abliterated-Q4_K_M-GGUF

Text Generation • 35B • Updated 7 days ago • 2.17k • 3

ankk98/dspark-gemma4-12b-block7-Q4_0-GGUF

3B • Updated 4 days ago • 1.46k • 3

prithivMLmods/Q3.5-9B-DS-v4-Flash-v2.0-GGUF

Image-Text-to-Text • 9B • Updated 2 days ago • 83 • 3

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 602 • 247

aiplatforms/ru-uncensored-v2-gguf

Text Generation • 12B • Updated May 7 • 1.2k • 7

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 9.04k • 51

deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF

Text Generation • 8B • Updated Apr 16 • 5.08k • 27

PocketAiHub/talkie-1930-13b-it-GGUF

13B • Updated May 5 • 51 • 2

spiritbuun/buun-Qwen3.6-chat_template

Updated May 28 • 53

gaston-parravicini/LFM2.5-8B-A1B-Uncensored-Gaston-GGUF

Text Generation • 8B • Updated May 30 • 6.95k • 17

prithivMLmods/Holo-3.1-9B-GGUF

Image-Text-to-Text • 9B • Updated Jun 2 • 94.6k • 9

semparuthiveeran/VibeThinker-3B-Q4_K_M-GGUF

Text Generation • 3B • Updated 17 days ago • 78k • 3

wepiqx/Qwythos-9B-Claude-Mythos-5-1M-MTP-SHQ8-GGUF

Text Generation • 9B • Updated 11 days ago • 3.49k • 6

rafw007/ornith-1.0-9b-claude-coder

Text Generation • Updated 7 days ago • 2