Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

163

Base only

Active filters: ik_llama.cpp

Radamanthys11/Qwen3.6-27B-DFlash-GGUF

Text Generation • 2B • Updated Jun 15 • 155 • 1

Radamanthys11/Kimi-K2.5-DFlash-GGUF

Text Generation • 3B • Updated Jun 15 • 280

sokann/DeepSeek-V4-Flash-GGUF

284B • Updated Jul 3 • 594 • 4

AnthonyL1996/Qwopus3.6-27B-Coder-ik-MTP-GGUF

Text Generation • 27B • Updated Jun 18 • 2.47k

sokann/GLM-5.2-GGUF-2.244bpw

753B • Updated 15 days ago • 9.49k • 26

SixVolts/GLM-5.2-ewaste-edition-GGUF

Text Generation • 754B • Updated Jul 4 • 9k • 13

gghfez/DeepSeek-V3-0324-Opus3-Styletune-GGUF

Updated Jun 25 • 4

sokann/GLM-5.2-GGUF-1.630bpw

753B • Updated 28 days ago • 1.25k • 6

xero0000/Gordon-35B-A3B-mixed-q2k-imat

Text Generation • 35B • Updated 8 days ago • 280 • 2

xero0000/Vortigaunt-35B-mixed-q2k-imat

Text Generation • 35B • Updated Jun 30 • 25

xero0000/Gman-35B-A3B-mixed-q2k-imat

Text Generation • 35B • Updated Jun 30 • 15

xero0000/Kleiner-Coder-35B-mixed-q2k

Text Generation • 36B • Updated Jun 30 • 51

xero0000/Gordon-35B-A3B-mixed-q2k-imat-MTP

Text Generation • 36B • Updated Jul 2 • 41

xero0000/G-Man-35B-A3B-abliterated-mixed-q2k-MTP

Text Generation • 36B • Updated Jul 2 • 49

xero0000/Vortigaunt-Ornith-1.0-35B-mixed-q2k-MTP

Text Generation • 36B • Updated Jul 2 • 65

xero0000/Alyx-AgentWorld-35B-A3B-mixed-q2k-MTP

Text Generation • 36B • Updated Jul 2 • 58

xero0000/Alyx-AgentWorld-35B-A3B-mixed-q2k

Text Generation • 35B • Updated Jul 2 • 77

muzzy/GLM-5.2-GGUF

Text Generation • 753B • Updated 14 days ago • 4.58k • 8

jkyamog/MiniMax-M3-mmproj-GGUF

0.9B • Updated Jul 12 • 75

sokann/GLM-5.2-GGUF-2.788bpw

753B • Updated 28 days ago • 1.96k • 4

xero0000/Qwen3.6-35B-A3B-vram13-GGUF

Text Generation • 35B • Updated Jul 13 • 3.54k • 2

xero0000/Qwen3.6-27B-vram14-GGUF

Text Generation • 27B • Updated Jul 13 • 365 • 1

xero0000/Qwopus3.6-35B-A3B-Coder-vram13-GGUF

Text Generation • 36B • Updated Jul 13 • 319 • 1

KeinNiemand/Kuwutu-7B-CYOA-IK-GGUF-v2

Text Generation • 8B • Updated Jul 15 • 41

xero0000/Kleiner-Coder-35B-vram13-MTP

Text Generation • 36B • Updated about 1 month ago • 103

gghfexp/Kimi-K2.7-Code-GGUF

Text Generation • 1T • Updated 23 days ago • 200 • 1

Koshkasa/Naphula_Slimaki-Tavern-24B-v1.3_IQ4_KT-GGUF

Text Generation • 24B • Updated 23 days ago • 218

Koshkasa/TheDrummer_Skyfall-31B-v4.2_IQ3_KT-GGUF

Text Generation • 31B • Updated 21 days ago • 581

Koshkasa/DarkArtsForge_Zepar-24B-v1_IQ3_KT_attn

Text Generation • 24B • Updated 21 days ago • 101

Koshkasa/TheDrummer_Skyfall-31B-v4.2-IQ4_KSS-GGUF

Text Generation • 31B • Updated 20 days ago • 381 • 1