Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

961

Base only

Active filters: 4bit

Jiunsong/supergemma4-26b-uncensored-mlx-4bit-v2

Text Generation • 25B • Updated Apr 12 • 17.5k • 278

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated 4 days ago • 10.6k • 82

mlx-community/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated 4 days ago • 13.3k • 68

mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated 4 days ago • 15.1k • 49

AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit

Text Generation • 35B • Updated May 27 • 1.03k • 43

mlx-community/gemma-4-12B-it-qat-OptiQ-4bit

Text Generation • 12B • Updated 4 days ago • 6.48k • 8

mlx-community/ThinkingCap-Qwen3.6-27B-OptiQ-4bit

Image-Text-to-Text • 27B • Updated 4 days ago • 563 • 2

mlx-community/gemma-4-12B-coder-fable5-composer2.5-v1-OptiQ-4bit

Image-Text-to-Text • 12B • Updated 4 days ago • 651 • 2

mlx-community/Ornith-1.0-35B-OptiQ-4bit

Image-Text-to-Text • 35B • Updated 4 days ago • 436 • 2

empero-ai/openNemo-Cascade-2-30B-A3B

Text Generation • 32B • Updated Mar 24 • 328 • 9

aufklarer/Nemotron-3.5-ASR-Streaming-0.6B-MLX-4bit

Automatic Speech Recognition • 0.2B • Updated Jun 4 • 118 • 4

mlx-community/gemma-4-e4b-it-qat-OptiQ-4bit

Text Generation • 7B • Updated 4 days ago • 4.66k • 9

mlx-community/gemma-4-31B-it-qat-OptiQ-4bit

Text Generation • 31B • Updated 4 days ago • 6.14k • 6

mlx-community/VibeThinker-3B-OptiQ-4bit

Text Generation • 0.6B • Updated 3 days ago • 543 • 3

wang-yang/Agents-A1-MTPLX-Q4

Text Generation • 35B • Updated 14 days ago • 2.35k • 8

Alennnndy/Qwen3.6-27B-AWQ-4bit

Text Generation • 28B • Updated 15 days ago • 1.82k • 2

Nitishsharma9/super-lite-model-upload

2B • Updated 9 days ago • 99 • 4

MainzelMennchen/prompt-tuner-8b

Text Generation • 1B • Updated 4 days ago • 495 • 1

thisisaditichouhan/Phi-2-4bit-Quantized-Model

Text Generation • Updated 6 days ago • 20 • 1

mlx-community/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-OptiQ-4bit

Text Generation • 0.2B • Updated 4 days ago • 421 • 2

MarkChen1214/cohere-transcribe-03-2026-MLX-Mixed-2bit3bit4bit

Automatic Speech Recognition • 0.2B • Updated about 3 hours ago • 56 • 1

MarkChen1214/cohere-transcribe-arabic-07-2026-MLX-Mixed-2bit3bit4bit

Automatic Speech Recognition • 0.2B • Updated about 3 hours ago • 93 • 1

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 12 • 40

mayaeary/pygmalion-6b_dev-4bit-128g

Text Generation • Updated Mar 28, 2023 • 11 • 121

mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g

Text Generation • Updated Mar 31, 2023 • 6 • 2

mayaeary/PPO_Pygway-6b-Mix-4bit-128g

Text Generation • Updated Mar 31, 2023 • 1 • 2

Ancestral/Dolly_Shygmalion-6b-4bit-128g

Text Generation • Updated Apr 9, 2023 • 5 • 5

Ancestral/PPO_Shygmalion-6b-4bit-128g

Text Generation • Updated Apr 9, 2023 • 3

Ancestral/Dolly_Malion-6b-4bit-128g

Text Generation • Updated Apr 10, 2023 • 1

4bit/pygmalion-6b-4bit-128g

Text Generation • Updated Apr 13, 2023 • 9 • 3