lokeshe09/Qwen3.8-27B-INT8
Image-Text-to-Text • 28B • Updated • 877 • 4
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
473
Active filters: llmcompressor
AEON-7/Qwen3.6-35B-A3B-heretic-NVFP4
Image-Text-to-Text • 21B • Updated • 436k • 65
vrfai/Qwen3.8-27B-FP8
Image-Text-to-Text • 27B • Updated • 223 • 3
vrfai/Qwen3.8-27B-NVFP4
Image-Text-to-Text • 27B • Updated • 94 • 3
Twu31/Qwen3.8-27B-AWQ-INT4-MTP-LowLatency
Image-Text-to-Text • 6B • Updated • 172 • 3
vrfai/Qwen3.8-27B-FP8-dynamic
Image-Text-to-Text • 27B • Updated • 184 • 2
RedHatAI/Qwen2.5-3B-FP8-dynamic
Text Generation • 3B • Updated • 667 • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16
Text Generation • 33B • Updated • 3.16k • 6
kakrotto/gemma-4-31B-it-uncensored-heretic-FP8
31B • Updated • 1.06k • 4
AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-NVFP4
Text Generation • 19B • Updated • 9.62k • 87
lokeshe09/Qwen3.8-27B-W4A16
Image-Text-to-Text • 28B • Updated • 101 • 1
RukaRat/Qwen3.8-27B-INT8-W8A8-imatrix-MTP
Image-Text-to-Text • 27B • Updated • 1.99k • 2
Twu31/Qwen3.6-35B-A3B-GPTQ-INT4-W4A16-LowLatency
Image-Text-to-Text • 6B • Updated • 12 • 1
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic
Text Generation • 8B • Updated • 52.9k • 9
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
Text Generation • 8B • Updated • 24.1k • 20
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16
Text Generation • 8B • Updated • 92.5k • 30
RedHatAI/Llama-3.2-1B-Instruct-quantized.w8a8
Text Generation • 1B • Updated • 30.1k • 8
RedHatAI/Llama-3.2-3B-Instruct-quantized.w8a8
Text Generation • 4B • Updated • 1.09k • 1
RedHatAI/Llama-3.2-1B-Instruct-FP8
Text Generation • 1B • Updated • 494k • 4
RedHatAI/Llama-3.2-3B-Instruct-FP8
Text Generation • 4B • Updated • 2.03k • 6
RedHatAI/Qwen2.5-0.5B-quantized.w8a8
Text Generation • 0.6B • Updated • 799
RedHatAI/Qwen2.5-0.5B-Instruct-quantized.w8a8
Text Generation • 0.6B • Updated • 548
RedHatAI/Qwen2.5-1.5B-quantized.w8a8
Text Generation • 2B • Updated • 474k • 4
RedHatAI/Qwen2.5-7B-quantized.w8a8
Text Generation • 8B • Updated • 102 • 1
RedHatAI/Qwen2.5-72B-quantized.w8a8
Text Generation • 73B • Updated • 32
RedHatAI/Qwen2.5-7B-quantized.w4a16
Text Generation • 8B • Updated • 233
RedHatAI/Qwen2.5-0.5B-FP8-dynamic
Text Generation • 0.6B • Updated • 49
RedHatAI/Qwen2.5-1.5B-FP8-dynamic
Text Generation • 2B • Updated • 66
RedHatAI/Qwen2.5-7B-FP8-dynamic
Text Generation • 8B • Updated • 78
RedHatAI/Qwen2.5-72B-FP8-dynamic
Text Generation • 73B • Updated • 39 • 1