Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2310.05914

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

65

Base only

Active filters: 2310.05914

Davd-b01/qwen3.8-flash-next-40b-prune-research

Text Generation • 41B • Updated 13 days ago • 2.03k • 3

GeneZC/MiniChat-1.5-3B

Text Generation • 3B • Updated Jun 27, 2024 • 165 • 36

afrideva/MiniChat-1.5-3B-GGUF

Text Generation • 3B • Updated Nov 26, 2023 • 402 • 3

augmxnt/shisa-7b-v1

Text Generation • 8B • Updated Nov 19, 2025 • 116 • 30

TheBloke/shisa-7B-v1-AWQ

Text Generation • 8B • Updated Dec 7, 2023 • 23 • 2

TheBloke/shisa-7B-v1-GPTQ

Text Generation • 8B • Updated Dec 7, 2023 • 32 • 2

LoneStriker/shisa-7b-v1-3.0bpw-h6-exl2

Text Generation • Updated Dec 7, 2023 • 19 • 1

LoneStriker/shisa-7b-v1-4.0bpw-h6-exl2

Text Generation • Updated Dec 7, 2023 • 16

LoneStriker/shisa-7b-v1-5.0bpw-h6-exl2

Text Generation • Updated Dec 7, 2023 • 15

LoneStriker/shisa-7b-v1-6.0bpw-h6-exl2

Text Generation • Updated Dec 7, 2023 • 19

LoneStriker/shisa-7b-v1-8.0bpw-h8-exl2

Text Generation • Updated Dec 7, 2023 • 19 • 1

tsunemoto/MiniChat-1.5-3B-GGUF

3B • Updated Dec 18, 2023 • 296 • 2

GeneZC/MiniChat-2-3B

Text Generation • 3B • Updated Jun 27, 2024 • 726 • 24

afrideva/MiniChat-2-3B-GGUF

Text Generation • 3B • Updated Dec 27, 2023 • 379 • 1

cgus/MiniChat-2-3B-exl2

Text Generation • Updated Jan 12, 2024 • 18

MaziyarPanahi/shisa-7b-v1-Mistral-7B-Instruct-v0.1

Text Generation • 7B • Updated Jan 17, 2024 • 17

MaziyarPanahi/shisa-7b-v1-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • 7B • Updated Jan 28, 2024 • 610

euclaise/Memphis-CoT-3B

Text Generation • 3B • Updated Feb 4, 2024 • 125 • 31

YeonwooSung/mistral-7b-cot-neftune-v0.1

Text Generation • 7B • Updated Mar 3, 2024 • 11 • 1

H-D-T/Buzz-8b-Large-v0.5

Text Generation • 8B • Updated May 14, 2024 • 69 • 29

LoneStriker/Buzz-8b-Large-v0.5-GGUF

8B • Updated May 9, 2024 • 119 • 1

LoneStriker/Buzz-8b-Large-v0.5-3.0bpw-h6-exl2

Text Generation • Updated May 9, 2024 • 12

LoneStriker/Buzz-8b-Large-v0.5-4.0bpw-h6-exl2

Text Generation • Updated May 9, 2024 • 13

LoneStriker/Buzz-8b-Large-v0.5-5.0bpw-h6-exl2

Text Generation • Updated May 9, 2024 • 12

LoneStriker/Buzz-8b-Large-v0.5-6.0bpw-h6-exl2

Text Generation • Updated May 9, 2024 • 17

LoneStriker/Buzz-8b-Large-v0.5-8.0bpw-h8-exl2

Text Generation • Updated May 9, 2024 • 16

QuantFactory/Buzz-8b-Large-v0.5-GGUF

Text Generation • 8B • Updated Jun 8, 2024 • 1.33k

afrideva/Buzz-8b-Large-v0.5-GGUF

Text Generation • 8B • Updated May 14, 2024 • 153

cgus/MiniChat-2-3B-iMat-GGUF

3B • Updated May 17, 2024 • 93

anamikac2708/Llama3-8b-finetuned-NEFTune-investopedia-Lora-Adapters

Updated Jun 18, 2024