inference-optimization/Qwen3-30B-A3B-7-bits-mode-hybrid-per-tensor
27B • Updated • 54
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
inference-optimization/Qwen3-30B-A3B-7-bits-mode-heuristic-per-tensor
27B • Updated • 63
inference-optimization/Qwen3-30B-A3B-6.5-bits-mode-noise-per-tensor
25B • Updated • 51
inference-optimization/Qwen3-30B-A3B-6.5-bits-mode-hybrid-per-tensor
25B • Updated • 48
inference-optimization/Qwen3-30B-A3B-6.5-bits-mode-heuristic-per-tensor
25B • Updated • 51
inference-optimization/Qwen3-30B-A3B-6-bits-mode-noise-per-tensor
23B • Updated • 46
inference-optimization/Qwen3-30B-A3B-6-bits-mode-hybrid-per-tensor
23B • Updated • 54
inference-optimization/Qwen3-30B-A3B-6-bits-mode-heuristic-per-tensor
23B • Updated • 68
inference-optimization/Qwen3-30B-A3B-5.5-bits-mode-noise-per-tensor
21B • Updated • 49
inference-optimization/Qwen3-30B-A3B-5.5-bits-mode-hybrid-per-tensor
21B • Updated • 47
inference-optimization/Qwen3-30B-A3B-5.5-bits-mode-heuristic-per-tensor
21B • Updated • 43
inference-optimization/Qwen3-30B-A3B-5-bits-mode-noise-per-tensor
19B • Updated • 47
inference-optimization/Qwen3-30B-A3B-5-bits-mode-hybrid-per-tensor
19B • Updated • 49
inference-optimization/Qwen3-30B-A3B-5-bits-mode-heuristic-per-tensor
19B • Updated • 63
inference-optimization/Qwen3-8B-7-bits-mode-noise-per-tensor
6B • Updated • 77
inference-optimization/Qwen3-8B-7-bits-mode-hybrid-per-tensor
7B • Updated • 88
inference-optimization/Qwen3-8B-7-bits-mode-heuristic-per-tensor
7B • Updated • 94
inference-optimization/Qwen3-8B-6.5-bits-mode-noise-per-tensor
6B • Updated • 68
inference-optimization/Qwen3-8B-6.5-bits-mode-hybrid-per-tensor
7B • Updated • 63
inference-optimization/Qwen3-8B-6.5-bits-mode-heuristic-per-tensor
7B • Updated • 74
inference-optimization/Qwen3-8B-6-bits-mode-noise-per-tensor
6B • Updated • 65
inference-optimization/Qwen3-8B-6-bits-mode-hybrid-per-tensor
6B • Updated • 64
inference-optimization/Qwen3-8B-6-bits-mode-heuristic-per-tensor
6B • Updated • 68
inference-optimization/Qwen3-8B-5.5-bits-mode-noise-per-tensor
6B • Updated • 66
inference-optimization/Qwen3-8B-5.5-bits-mode-hybrid-per-tensor
6B • Updated • 66
inference-optimization/Qwen3-8B-5.5-bits-mode-heuristic-per-tensor
6B • Updated • 68
inference-optimization/Qwen3-8B-5-bits-mode-noise-per-tensor
6B • Updated • 64
inference-optimization/Qwen3-8B-5-bits-mode-hybrid-per-tensor
6B • Updated • 71
inference-optimization/Qwen3-8B-5-bits-mode-heuristic-per-tensor
6B • Updated • 67
inference-optimization/Llama-3.1-8B-Instruct-7-bits-mode-noise-per-tensor
7B • Updated • 55