Quantized Model in GGML of: https://huggingface.co/zarakiquemparte/hermeslimarp-l2-7b
If you need other quantized models use @TheBloke:
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Quantized Model in GGML of: https://huggingface.co/zarakiquemparte/hermeslimarp-l2-7b
If you need other quantized models use @TheBloke: