Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

13,544

Base only

Active filters: dpo

NU-World-Model-Embodied-AI/phyworld

Video-to-Video • Updated Aug 7 • 13

ewin-reg/MiniCPM5-1B-Agentic-Tooluse-Merged-FP16

Text Generation • 1B • Updated Jul 29 • 322 • 17

wxzhang/dpo-selective-redteaming

Text Generation • 7B • Updated May 19, 2024 • 105 • 5

trentmkelly/gpt-4o-distil-Llama-3.1-8B-Instruct

Text Generation • Updated Jan 30 • 25 • 3

mradermacher/gpt-4o-distil-Llama-3.1-8B-Instruct-PaperWitch-heresy-GGUF

8B • Updated Feb 19 • 819 • 10

CEIA-RL/energy-exp1-dpo-offline

Text Generation • 4B • Updated May 31 • 120 • 6

ewin-reg/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated Jul 29 • 1.28k • 87

JiangLing-js/Qwen3.8-27B-Chinese-Xuanhuan-Novel-Writer-DPO

Text Generation • Updated Aug 29 • 166 • 9

ranjanrajib/DPO-trained-Qwen2.5-Python-Coder-7B

Text Generation • 8B • Updated 25 days ago • 722 • 6

mlabonne/NeuralBeagle14-7B

Text Generation • 7B • Updated Mar 4, 2024 • 91 • 159

mlabonne/TwinLlama-3.1-8B-DPO

Text Generation • 8B • Updated Oct 6, 2024 • 127 • 25

trentmkelly/gpt-4o-distil-Llama-3.3-70B-Instruct

Text Generation • Updated Feb 2 • 19 • 4

WYNN747/burmese-coder-4b

Text Generation • 7B • Updated Apr 12 • 44 • 4

CEIA-RL/qwen3-4b-dw-lr-dpo-offline

Text Generation • 4B • Updated Apr 9 • 52 • 4

ReXeeD/Luminus-1.5B-Roleplay

Text Generation • 2B • Updated Apr 29 • 45 • 3

MRockatansky/Gemma-4-31B-storymaxxed2-GGUF

Text Generation • 31B • Updated Jul 4 • 303 • 3

MRockatansky/Gemma-4-31B-Storymaxxed3

Text Generation • 31B • Updated Jun 26 • 126 • • 5

empero-ai/Qwythos-27B-v1

Image-Text-to-Text • 28B • Updated Jul 29 • 716 • 172

haven-ai-companion/haven-chat-v3.0

Text Generation • 8B • Updated Jul 22 • 281 • 3

arunsingh80475/qwen2.5-14b-humanizer-v4-lora

Text Generation • Updated 4 days ago • 59 • 1

UnstableLlama/Love-Aligned-31B

Text Generation • 31B • Updated 20 days ago • 1.2k • 8

Shockem/Qwen3.8-27b-Terse-Coder-LoRA

0.1B • Updated 18 days ago • 663 • 4

dolev31/ProactiveInquirer-Qwen3-8B-Merged

Text Generation • 8B • Updated 8 days ago • 1.11k • 2

mradermacher/Qwen2.5-1.5B-Financial-Code-Engine-GGUF

2B • Updated 14 days ago • 496 • 1

joycx/Qwen3.8-27B-Velocity

Text Generation • Updated 9 days ago • 102 • 3

XcaliburMoon/XcaliburBiz-1.8B-report

Text Generation • 2B • Updated 1 day ago • 557 • 1

flaviocr2023/movie-safety-llama-3.1-8b

8B • Updated 3 days ago • 25 • 1

hohq/qwen35-9b-stage2-dpo-lora

Text Generation • Updated 2 days ago • 14 • 1

mradermacher/L3.3-70B-PippaMaid-2.0-heretic-i1-GGUF

71B • Updated May 25 • 814 • 1

lyogavin/Anima33B-DPO-Belle-1k

Text Generation • Updated Jul 2, 2023 • 1