lyogavin/Anima33B-DPO-Belle-1k-merged
Text Generation • Updated • 172 • 12
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
13,545
Active filters: dpo
daekeun-ml/Llama-2-ko-DPO-13B
Text Generation • 13B • Updated • 25 • 19
lewtun/zephyr-7b-dpo-full
Text Generation • 7B • Updated • 19
alignment-handbook/zephyr-7b-dpo-full
Text Generation • 7B • Updated • 44 • 3
alignment-handbook/zephyr-7b-dpo-qlora
Updated • 18 • 9
argilla/notus-7b-v1-lora
Text Generation • 7B • Updated • 26 • 7
argilla/notus-7b-v1-lora-adapter
Text Generation • Updated • 3
argilla/notus-7b-v1
Text Generation • 7B • Updated • 113 • 124
ContextualAI/archangel_sft_pythia1-4b
Text Generation • 1B • Updated • 38
ContextualAI/archangel_sft_pythia2-8b
Text Generation • 3B • Updated • 63 • 2
ContextualAI/archangel_sft_pythia6-9b
Text Generation • 7B • Updated • 34
ContextualAI/archangel_sft_pythia12-0b
Text Generation • 12B • Updated • 32
ContextualAI/archangel_sft_llama7b
Text Generation • 7B • Updated • 33 • 1
ContextualAI/archangel_sft_llama13b
Text Generation • 13B • Updated • 36
ContextualAI/archangel_sft_llama30b
Text Generation • 33B • Updated • 32
ContextualAI/archangel_slic_llama30b
Text Generation • 33B • Updated • 15
ContextualAI/archangel_slic_pythia1-4b
Text Generation • 1B • Updated • 34
ContextualAI/archangel_slic_pythia2-8b
Text Generation • 3B • Updated • 35
ContextualAI/archangel_slic_pythia6-9b
Text Generation • 7B • Updated • 29
ContextualAI/archangel_slic_pythia12-0b
Text Generation • 12B • Updated • 32
ContextualAI/archangel_slic_llama7b
Text Generation • 7B • Updated • 19 • 1
ContextualAI/archangel_slic_llama13b
Text Generation • 13B • Updated • 17
ContextualAI/archangel_dpo_pythia1-4b
Text Generation • 1B • Updated • 38
ContextualAI/archangel_dpo_pythia2-8b
Text Generation • 3B • Updated • 27
ContextualAI/archangel_dpo_pythia6-9b
Text Generation • 7B • Updated • 28
ContextualAI/archangel_dpo_pythia12-0b
Text Generation • 12B • Updated • 30
ContextualAI/archangel_dpo_llama7b
Text Generation • 7B • Updated • 28
ContextualAI/archangel_dpo_llama13b
Text Generation • 13B • Updated • 58
ContextualAI/archangel_dpo_llama30b
Text Generation • 33B • Updated • 27
ContextualAI/archangel_kto_pythia1-4b
Text Generation • 1B • Updated • 40