Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

2,244

Full-text search

Active filters: 2-bit

fifrio/Qwen3-1.7B-gptq-2bit-calibration-Tamil-128samples

2B • Updated 20 days ago • 21

fifrio/Qwen3-1.7B-gptq-2bit-calibration-Swahili-128samples

2B • Updated 20 days ago • 27

fifrio/Qwen3-1.7B-gptq-2bit-calibration-Chinese-128samples

2B • Updated 20 days ago • 24

garrison/Magidonia-24B-v4.3-mlx-2Bit

24B • Updated 19 days ago • 43

garrison/Cydonia-24B-v4.3-mlx-2Bit

24B • Updated 19 days ago • 142 • 1

Intel/Qwen3-8B-w2g64-AutoRound-test

2B • Updated 14 days ago • 36 • 1

fifrio/gemma-3-4b-it-gptq-2bit-calibration-English-128samples

4B • Updated 14 days ago • 16

fifrio/gemma-3-4b-it-gptq-2bit-calibration-Indonesian-128samples

4B • Updated 14 days ago • 16

fifrio/gemma-3-4b-it-gptq-2bit-calibration-Tamil-128samples

4B • Updated 14 days ago • 10

fifrio/gemma-3-4b-it-gptq-2bit-calibration-Swahili-128samples

4B • Updated 14 days ago • 13

fifrio/gemma-3-4b-it-gptq-2bit-calibration-Chinese-128samples

4B • Updated 14 days ago • 13

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-English-128samples

8B • Updated 12 days ago • 36

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-Indonesian-128samples

8B • Updated 12 days ago • 40

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-Tamil-128samples

8B • Updated 12 days ago • 36

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-Swahili-128samples

8B • Updated 12 days ago • 88 • 2

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-Chinese-128samples

8B • Updated 12 days ago • 34

fifrio/aya-expanse-8b-gptq-2bit-calibration-English-128samples

8B • Updated 11 days ago • 26

fifrio/aya-expanse-8b-gptq-2bit-calibration-Indonesian-128samples

8B • Updated 11 days ago • 26

fifrio/aya-expanse-8b-gptq-2bit-calibration-Tamil-128samples

8B • Updated 11 days ago • 36

fifrio/aya-expanse-8b-gptq-2bit-calibration-Swahili-128samples

8B • Updated 11 days ago • 24

fifrio/aya-expanse-8b-gptq-2bit-calibration-Chinese-128samples

8B • Updated 11 days ago • 23

SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q2

Text Generation • 1B • Updated 7 days ago • 72

cosmicgob/Qwen3-30B-A3B-Instruct-2507-mlx-2Bit

Text Generation • 31B • Updated 4 days ago • 54

AiAF/rp-sft-merged_1000-MLX-2Bit

Text Generation • 0.3B • Updated 9 minutes ago