Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

21,240

Base only

Active filters: gguf-my-repo

NikolayKozloff/LLMBG-Llama-3.1-8B-BG-Reasoning-v0.1-Q8_0-GGUF

Text Generation • 8B • Updated Feb 9, 2025 • 144 • 11

israellaguan/TinyLlama_V1.1_Tree_of_thoughts-Q8_0-GGUF

1B • Updated Sep 19, 2024 • 122 • 10

ewin-reg/MiniCPM5-1B-Agentic-Tooluse-v3-GGUF

Text Generation • 1B • Updated Jul 29 • 3.04k • 16

WSDW/Qwen2.5-7B-Instruct-Uncensored-Q4_K_M-GGUF

Text Generation • 8B • Updated Oct 6, 2024 • 7.26k • 4

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 1.83k • 368

Aldaris/Qwen3-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 29, 2025 • 10.3k • 9

huihui-ai/BaronLLM_Offensive_Security-abliterated-GGUF

Text Generation • 8B • Updated Jun 11, 2025 • 917 • 70

WANG-CC/flux2-klein-9b-uncensored-text-encoder-Q8_0-GGUF

Text-to-Image • 8B • Updated Jul 13 • 14k • 10

KKdu/MEDOVUCHA-gpt2-Q4_K_M-GGUF

0.2B • Updated May 23, 2024 • 32 • 1

godolike/deepseek-coder-6.7b-instruct-Q4_K_M-GGUF

7B • Updated Jul 18, 2024 • 471 • 3

yaneivan/dolphin-2.9.4-llama3.1-8b-Q4_K_M-GGUF

8B • Updated Aug 4, 2024 • 2.32k • 3

HuggingFaceTB/smollm-135M-instruct-v0.2-Q8_0-GGUF

0.1B • Updated Aug 18, 2024 • 3.14k • 8

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 37.3k • 48

hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 55.8k • 33

HuggingFaceTB/SmolLM2-1.7B-Instruct-GGUF

Text Generation • 2B • Updated Nov 5, 2024 • 8.14k • 54

apto-as/Qwen2.5-Coder-14B-Instruct-Q5_K_M-GGUF

Text Generation • 15B • Updated Nov 24, 2024 • 620 • 2

ggml-org/Qwen2.5-Coder-3B-Q8_0-GGUF

Text Generation • 3B • Updated Nov 26, 2024 • 2.01k • 17

itlwas/Qwen2.5-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Jan 5, 2025 • 94 • 1

itlwas/Dolphin3.0-Llama3.1-8B-Q4_K_M-GGUF

8B • Updated Jan 5, 2025 • 2.31k • 5

Luisz21/gemma-3-1b-it-abliterated-Q8_0-GGUF

Text Generation • 1.0B • Updated Mar 13, 2025 • 470 • 1

C10X/gemma-3-finetuneSSD-Q8_0-GGUF

2B • Updated Apr 3, 2025 • 17 • 1

enacimie/Qwen3-4B-Q4_K_M-GGUF

Text Generation • 4B • Updated Dec 30, 2025 • 3.74k • 5

ldostadi/Foundation-Sec-8B-abliterated-Q4_K_M-GGUF

Text Generation • 8B • Updated May 15, 2025 • 122 • 3

FinancialSupport/Qwen3-8B-Q4_K_M-GGUF

8B • Updated Jul 7, 2025 • 1 • 1

NikolayKozloff/Hermes-4-14B-Q5_K_M-GGUF

15B • Updated Sep 2, 2025 • 142 • 2

NikolayKozloff/Hermes-4-14B-Q4_K_M-GGUF

15B • Updated Sep 2, 2025 • 402 • 2

Gideon531/Huihui-Qwen3-8B-abliterated-v2-Q5_0-GGUF

Text Generation • 8B • Updated Sep 3, 2025 • 52 • 1

ggml-org/Qwen3-Reranker-0.6B-Q8_0-GGUF

Text Ranking • 0.6B • Updated Oct 3, 2025 • 90.2k • 29

ijohn07/Qwen3-14B-Uncensored-Q4_K_M-GGUF

15B • Updated Oct 6, 2025 • 1.52k • 2

diegom1379/zombiesgrid-Q8_0-GGUF

4B • Updated Nov 13, 2025 • 6 • 1