Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,090

Base only

Active filters: ggml

DeimantasLT/kmynas-pipiras-gguf

Automatic Speech Recognition • 0.6B • Updated 3 days ago • 112 • 1

vibe-app/nemotron-3-diarization-gguf

99.2M • Updated 3 days ago • 54 • 1

Bonenk/OmniVoice-GGUF

Text-to-Speech • 0.6B • Updated 2 days ago • 73 • 1

vibe-app/parakeet-tdt-0.6b-v3-he-gguf

Automatic Speech Recognition • 0.6B • Updated about 8 hours ago • 159 • 1

malteos/bloom-6b4-clp-german

Text Generation • 6B • Updated Apr 6, 2024 • 196 • 38

nouamanetazi/bloomz-560m-ggml

Updated Mar 15, 2023 • 4

maximeseth/alpaca-native-7B-ggml

Updated Mar 26, 2023 • 3 • 1

bertin-project/bertin-gpt-j-6B-alpaca

Text Generation • 6B • Updated Nov 10, 2024 • 94 • 7

CRD716/ggml-LLaMa-65B-quantized

Text Generation • Updated Sep 9, 2023 • 29

CRD716/ggml-vicuna-1.1-quantized

Text Generation • Updated Sep 9, 2023 • 43

Drake-AI/GPT-J-6b-Skein-ggml-q4_1

Updated Apr 18, 2023 • 1

Arjay87/bloomz_7b1.cpp

Updated Apr 21, 2023

nicholascao/chatbloom-1b7-sft

Text Generation • 2B • Updated Aug 12, 2023 • 57 • 6

ravenscroftj/CodeGen-350M-multi-ggml-quant

Text Generation • Updated Apr 24, 2023 • 2

ravenscroftj/CodeGen-2B-multi-ggml-quant

Text Generation • Updated Aug 5, 2023 • 2

ravenscroftj/CodeGen-6B-multi-ggml-quant

Text Generation • Updated Apr 24, 2023 • 9

ShadowPower/ggml-alpaca-chatgpt

Text Generation • Updated May 12, 2023 • 8

rozek/OpenLLaMA_7B_300BT_q4

Text Generation • Updated May 5, 2023 • 1

mverrilli/dolly-v2-3b-ggml

Updated May 17, 2023 • 2

mverrilli/dolly-v2-12b-ggml

Updated May 8, 2023 • 1

mverrilli/dolly-v2-7b-ggml

Updated May 18, 2023 • 1

Green-Sky/ggml-mpt-7b-storywriter

Updated May 20, 2023 • 14

ShadowPower/ggml-alpaca-chatgpt-new

Text Generation • Updated May 27, 2023 • 7

rustformers/mpt-7b-ggml

Text Generation • Updated Jun 9, 2023 • 231 • 46

digitous/13B-HyperMantis_GGML

Updated May 24, 2023 • 1

rustformers/redpajama-3b-ggml

Text Generation • Updated Jun 9, 2023 • 81 • 7

rustformers/pythia-ggml

Text Generation • Updated Jun 9, 2023 • 116 • 5

rustformers/bloom-ggml

Text Generation • Updated Jun 9, 2023 • 137 • 8

CalderaAI/30B-Lazarus-GGMLv5_1

Updated May 27, 2023 • 7

rustformers/bloomz-ggml

Text Generation • Updated Jun 9, 2023 • 73 • 6