Inference Providers
Active filters: 8bit
mlx-community/Qwen3.5-0.8B-OptiQ-4bit
Text Generation
• 0.2B • Updated • 1.9k
• 4
mlx-community/Qwen3.5-27B-heretic-8bit
Image-Text-to-Text
• 8B • Updated • 7.8k
• 8
mlx-community/Qwen3.5-4B-OptiQ-4bit
Text Generation
• 0.8B • Updated • 4.04k
• 7
mlx-community/Qwen3.5-9B-OptiQ-4bit
Text Generation
• 9B • Updated • 5.25k
• 12
legraphista/glm-4-9b-chat-GGUF
Text Generation
• 9B • Updated • 12.7k
• 21
mlx-community/Qwen3.5-2B-MLX-8bit
0.9B • Updated • 4.78k
• 3
mlx-community/Qwen3.5-4B-MLX-8bit
2B • Updated • 2.43k
• 2
AITRADER/Amsi-fin-o1.5-mxfp8-MLX
Image-Text-to-Text
• 3B • Updated • 114
• 1
vanch007/Huihui-Qwen3.5-9B-abliterated-mlx-8bit
Image-Text-to-Text
• 3B • Updated • 54
• 1
TheCluster/Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-MLX-8bit
Image-Text-to-Text
• 9B • Updated • 1
crumb/gpt-j-6b-finetune-super-glue
Text Generation
• Updated • 4
ethzanalytics/gpt-j-6B-8bit-sharded
Text Generation
• 6B • Updated • 5
• 7
ethzanalytics/gpt-j-8bit-daily_dialogues
Text Generation
• 6B • Updated • 10
• 4
ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps
Text Generation
• Updated • 4
ethzanalytics/dolly-v2-12b-sharded-8bit
Text Generation
• Updated • 9
• 4
pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit
Summarization
• 3B • Updated • 18
ethzanalytics/open_llama_13b-sharded-8bit
Text Generation
• Updated • 2
richardr1126/spider-skeleton-wizard-coder-8bit
Text Generation
• Updated • 7
• 1
Trelis/Llama-2-7b-chat-hf-hosted-inference-8bit
Text Generation
• 7B • Updated • 5
• 7
Trelis/mpt-7b-instruct-hosted-inference-8bit
Text Generation
• Updated • 5
ecastera/eva-mistral-catmacaroni-7b-spanish
Text Generation
• 7B • Updated • 1
• 2
ecastera/eva-mistral-turdus-7b-spanish
Text Generation
• 7B • Updated • 4
ecastera/eva-mistral-7b-spanish-GGUF
7B • Updated • 47
• 9
BioMistral/BioMistral-7B-BnB.8
Text Generation
• 7B • Updated • 40
alokabhishek/Llama-2-7b-chat-hf-bnb-8bit
Text Generation
• 7B • Updated • 10
• 2
alokabhishek/Mistral-7B-Instruct-v0.2-bnb-8bit
Text Generation
• 7B • Updated • 2
• 2
alokabhishek/Llama-2-7b-chat-hf-8.0-bpw-exl2
Text Generation
• Updated • 1
• 1
alokabhishek/Mistral-7B-Instruct-v0.2-8.0-bpw-exl2
Text Generation
• Updated • 2
• 1
alokabhishek/Meta-Llama-3-8B-Instruct-bnb-8bit
Text Generation
• 8B • Updated • 1
• 2
alokabhishek/Meta-Llama-3-8B-Instruct-8.0-bpw-exl2
Text Generation
• Updated • 1