Qwopus3.5-v3-oQ-Quantization
Collection
2 items • Updated
How to use zesming/Qwopus3.5-27B-v3-oQ8e with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download zesming/Qwopus3.5-27B-v3-oQ8e --local-dir Qwopus3.5-27B-v3-oQ8e
This model was quantized using oQ mixed-precision quantization.
8-bit