Models you can run yourself
A model, every quantisation somebody made of it, and what each one costs to run.
Only one source knows: GGUF quantisations 2349 · Hugging Face models 66
Covers. Every GGUF repository created since 2026-08-23, and the base model behind each one. 2,684 of those bases are named; without a Hugging Face token the run is throttled off after roughly 600 to 750 of them, so the model side of the join is partial and the scope says so on its front page. Excludes. Ollama, whose library names no Hugging Face repository to join on. Benchmarks, which have no machine-readable source.
Compared · what is held against what, and from which column of each source
| Property | Hugging Face models | GGUF quantisations |
|---|---|---|
| Licence | cardData.license | cardData.license |
Everything else the sources say is shown side by side, and not compared.
Found
1–25 of 41| Thing | Kind | Licence | Downloads | Date |
|---|---|---|---|---|
| deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct · Hugging Face models, GGUF quantisations | model 1 quantisation 1 | other | 203 / 903499 | 2024-06-14 |
| deepseek-ai/DeepSeek-V2-Lite deepseek-ai/DeepSeek-V2-Lite · Hugging Face models, GGUF quantisations | model 1 quantisation 1 | other | 0 / 216842 | 2024-05-15 |
| agentionai/Qwen3.8-Flash-Next-ROCmFP4-FAST-imatrix-GGUF agentionai/Qwen3.8-Flash-Next-ROCmFP4-FAST-imatrix-GGUF · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | apache-2.0 / other | 1549 / 73255 / 87780 | 2026-08-28 |
| deepseek-ai/deepseek-coder-1.3b-base deepseek-ai/deepseek-coder-1.3b-base · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | other | 162 / 25239 / 34619 | 2023-10-28 |
| drowzeys/keys-DeepSeekV4-Flash-GA-0731-Dspark-Abliterated-Anchored-Tensors drowzeys/keys-DeepSeekV4-Flash-GA-0731-Dspark-Abliterated-Anchored-Tensors · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | mit / other | 237 / 24131 / 27892 | 2026-08-01 |
| amd/Instella-MoE-16B-A3B-Think amd/Instella-MoE-16B-A3B-Think · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | other | 2861 / 3138 / 373 | 2026-07-23 |
| ApolloRaines/Jenzin-Wuang-Nemotron-30B-A3B-BF16 ApolloRaines/Jenzin-Wuang-Nemotron-30B-A3B-BF16 · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | other | 10491 / 1117 / 2406 / 407 | 2026-09-02 |
| d4rkninja/tanpo-marketing d4rkninja/tanpo-marketing · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | other | 1963 / 2010 / 481 | 2026-09-16 |
| ecloudtech/Erk-14B ecloudtech/Erk-14B · Hugging Face models, GGUF quantisations | model 2 quantisation 3 | other | 1589 / 1853 / 206 / 441 / 712 | 2026-07-19 |
| atakankutalp/LFM2.5-2.6B-heretic atakankutalp/LFM2.5-2.6B-heretic · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | other | 1312 / 1544 / 313 | 2026-09-25 |
| audnai/penclaw-GLM-5.3-abliterated audnai/penclaw-GLM-5.3-abliterated · Hugging Face models, GGUF quantisations | model 1 quantisation 1 | other | 1 / 1442 | 2026-09-01 |
| AItonomy/PhAI-IDE-72B AItonomy/PhAI-IDE-72B · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | other | 1053 / 1105 / 1659 / 395 | 2026-09-15 |
| Blackfrost-AI/CYBER-FROST-3.8-BF16 Blackfrost-AI/CYBER-FROST-3.8-BF16 · Hugging Face models, GGUF quantisations | model 1 quantisation 3 | other | 1047 / 682 / 795 / 8866 | 2026-09-15 |
| 0bserverx/RVN-Qwen3.8-Flash-Next-Abliterated-Uncensored 0bserverx/RVN-Qwen3.8-Flash-Next-Abliterated-Uncensored · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | apache-2.0 / other | 1021 / 12829 / 579 / 60690 | 2026-08-31 |
| aiuser3993/GLM-Edge-1.5B-Chat-Greek aiuser3993/GLM-Edge-1.5B-Chat-Greek · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | other | 1015 / 212 / 306 | 2026-08-28 |
| agastyasridharan/Qwen2.5-3B-Instruct-Sheldon-SFT-v2 agastyasridharan/Qwen2.5-3B-Instruct-Sheldon-SFT-v2 · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | other | 701 / 797 / 833 | 2026-09-09 |
| Akahsizrr/Cyber-Prime-1.1-2.6B Akahsizrr/Cyber-Prime-1.1-2.6B · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | other | 602 / 637 / 790 | 2026-09-23 |
| QuixiAI/WizardLM-7B-Uncensored QuixiAI/WizardLM-7B-Uncensored · Hugging Face models | model 2 | other | 527 | 2023-05-04 |
| d4rkninja/tanpo-ops d4rkninja/tanpo-ops · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | other | 374 / 521 / 552 | 2026-09-18 |
| Dingdust/ContextPilot-8B-heretic Dingdust/ContextPilot-8B-heretic · Hugging Face models, GGUF quantisations | model 2 quantisation 2 | other | 2476 / 470 / 514 / 697 | 2026-09-06 |
| 0xzknw/LFM2.5-2.6B-Heretic-NX-PRIME 0xzknw/LFM2.5-2.6B-Heretic-NX-PRIME · Hugging Face models | model 2 | other | 377 | 2026-08-25 |
| byroneverson/glm-4-9b-chat-abliterated byroneverson/glm-4-9b-chat-abliterated · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | other | 265 / 281 / 963 | 2024-08-24 |
| FineEnvs/LFM2.5-2.6B-opencode-RL FineEnvs/LFM2.5-2.6B-opencode-RL · Hugging Face models, GGUF quantisations | model 1 quantisation 2 | other | 2116 / 262 / 682 | 2026-10-01 |
| emberian/h-05b-replay emberian/h-05b-replay · Hugging Face models, GGUF quantisations | model 2 quantisation 1 | other | 232 / 261 / 397 | 2026-09-06 |
| carrtesy/EXAONE-4.0-1.2B-JEV carrtesy/EXAONE-4.0-1.2B-JEV · Hugging Face models, GGUF quantisations | model 1 quantisation 1 | other | 254 / 338 | 2026-10-02 |
Facets
Licence 8663 of 11204 claims
other73
Task 1426 of 11204 claims
Sources
Hugging Face models primary
The model itself: its licence, its task and how many people fetch it.
model · failing1658
GGUF quantisations high
Which quantisations exist, which is what decides whether it runs on the machine somebody has.
quantisation · current9546