Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,275

Full-text search

Active filters: dpo

webxos/microclaw-for-openclaw-version-2026.2.17

Text Generation • Updated 3 days ago • 286 • 5

mradermacher/gpt-4o-distil-Llama-3.1-8B-Instruct-PaperWitch-heresy-GGUF

8B • Updated 6 days ago • 1.31k • 4

F16/z-image-turbo-flow-dpo

Feature Extraction • Updated 1 day ago • 3

mlabonne/NeuralDaredevil-8B-abliterated

Text Generation • 8B • Updated Jan 23 • 15.3k • • 262

HumanLLMs/Human-Like-Mistral-Nemo-Instruct-2407

Text Generation • 12B • Updated Jan 15 • 463 • • 26

MuXodious/gpt-4o-distil-Llama-3.1-8B-Instruct-PaperWitch-heresy

Text Generation • 8B • Updated 6 days ago • 47 • 2

mlabonne/NeuralHermes-2.5-Mistral-7B

Text Generation • 7B • Updated Apr 8, 2024 • 82 • 153

QuantFactory/NeuralDaredevil-8B-abliterated-GGUF

Text Generation • 8B • Updated May 29, 2024 • 5.48k • 84

openmed-community/AFM-4.5B-OpenMed-GGUF

Text Generation • 5B • Updated Oct 2, 2025 • 201 • 8

anilsanli/Turkish-Llama-DPO-Programming-Adapter

Text Generation • Updated Jan 25 • 18 • 1

antonisbast/Llama-3.2-3B-Gordon-Ramsay-DPO

Text Generation • Updated 1 day ago • 1

qqo/dpo-qwen-cot-merged

Text Generation • 2B • Updated 7 days ago • 119 • 1

mradermacher/gpt-4o-distil-Llama-3.1-8B-Instruct-PaperWitch-heresy-i1-GGUF

8B • Updated 6 days ago • 3.82k • 1

MuXodious/gpt-4o-distil-Llama-3.3-70B-Instruct-PaperWitch-heresy

Text Generation • 71B • Updated 3 days ago • 55 • 1

lyogavin/Anima33B-DPO-Belle-1k

Text Generation • Updated Jul 2, 2023 • 1

lyogavin/Anima33B-DPO-Belle-1k-merged

Text Generation • Updated Jul 2, 2023 • 14 • 12

daekeun-ml/Llama-2-ko-DPO-13B

Text Generation • 13B • Updated Oct 31, 2023 • 10 • 19

lewtun/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 5, 2024 • 2

alignment-handbook/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 10, 2024 • 37 • 3

alignment-handbook/zephyr-7b-dpo-qlora

Updated Jan 9, 2024 • 9 • 9

argilla/notus-7b-v1-lora

Text Generation • Updated Dec 4, 2023 • 2 • 7

argilla/notus-7b-v1-lora-adapter

Text Generation • Updated Dec 4, 2023 • 3

argilla/notus-7b-v1

Text Generation • 7B • Updated Dec 5, 2023 • 129 • 123

ContextualAI/archangel_sft_pythia1-4b

Text Generation • 1B • Updated Jan 11, 2024 • 6

ContextualAI/archangel_sft_pythia2-8b

Text Generation • 3B • Updated Jan 11, 2024 • 5 • 1

ContextualAI/archangel_sft_pythia6-9b

Text Generation • 7B • Updated Jan 11, 2024 • 1

ContextualAI/archangel_sft_pythia12-0b

Text Generation • 12B • Updated Jan 11, 2024 • 6

ContextualAI/archangel_sft_llama7b

Text Generation • 7B • Updated Jan 11, 2024 • 49 • 1

ContextualAI/archangel_sft_llama13b

Text Generation • 13B • Updated Jan 11, 2024 • 7

ContextualAI/archangel_sft_llama30b

Text Generation • 33B • Updated Jan 11, 2024 • 4