DatPySci/zephyr-7b-kto-iter0
Text Generation • 7B • Updated • 8
Edit Models filters
Model Tree
Apps
Inference Providers
Models
257
Active filters: kto, trl
eperim/mistral-QLORA-KTO
Updated • 2
lewtun/kto-aligned-model-lora
Updated • 1
Weni/WeniGPT-QA-Zephyr-7B-4.0.1-KTO
Updated • 5
Weni/WeniGPT-Agents-Zephyr-1.0.22-KTO
Updated • 3
Weni/WeniGPT-Agents-Zephyr-1.0.23-KTO
Updated • 2
DatPySci/zephyr-7b-kto-iter0-des133
Text Generation • 7B • Updated • 9
superemohot/llama3-8b_cp-p1_tv-llama3-emb_ft-b8.3patch1e1_spin-kto-b8.3p3b1-nft
Text Generation • 8B • Updated • 6
superemohot/llama3-8b_cp-p1_tv-llama3-emb_spin-kto-b8.3p3b1
Text Generation • 8B • Updated • 6
NBA55/Experiment_with_trained_model_Final_KTO_for_all_3_issues-epoch-2
Updated
stojchet/kto-python-6k-bad-ds
Updated • 2
sfulay/kto-aligned-model-lora
Updated • 4
stojchet/test_kto
Updated • 2
stojchet/big_kto1
Updated • 2
stojchet/lr_kto1
Updated • 8
stojchet/lr_kto2
Updated • 2
stojchet/kto1
Text Generation • 1B • Updated • 3
stojchet/w_kto1
Updated • 1
asmith26/kto_model
Text Generation • 4B • Updated • 3
stojchet/kto2
Text Generation • 1B • Updated • 2
stojchet/kto_test
Text Generation • 1B • Updated • 3
stojchet/py_base1_kto1
Updated
stojchet/py_base1_kto1_no_ref
Updated
stojchet/kto5k1
Text Generation • 1B • Updated • 12
stojchet/kto5k2
Text Generation • 1B • Updated • 3
stojchet/kto5k3
Text Generation • 1B • Updated • 4
stojchet/kto5k4
Text Generation • 1B • Updated • 3
stojchet/kto10k1
Text Generation • 1B • Updated • 3
stojchet/kto10k2
Text Generation • 1B • Updated • 3
stojchet/nkto1
Text Generation • 1B • Updated • 16