Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,151

Base only

Active filters: GGUF

tsunemoto/Nous-Hermes-2-Yi-34B-GGUF

34B • Updated Dec 26, 2023 • 56 • 1

andrijdavid/Mistral-T5-7B-v1-GGUF

Text Generation • Updated Dec 27, 2023 • 1

andrijdavid/Marcoroni-7B-v3-GGUF

Text Generation • 7B • Updated Dec 27, 2023 • 539

andrijdavid/mindy-7b-v2-GGUF

Text Generation • 7B • Updated Dec 27, 2023 • 109

andrijdavid/supermario-v2-GGUF

Text Generation • 7B • Updated Dec 27, 2023 • 72

andrijdavid/CatPPT-base-GGUF

Text Generation • 7B • Updated Dec 27, 2023 • 142 • 1

andrijdavid/LMCocktail-10.7B-v1-GGUF

Text Generation • 11B • Updated Dec 27, 2023 • 74 • 1

andrijdavid/Sakura-SOLAR-Instruct-GGUF

Text Generation • 11B • Updated Dec 28, 2023 • 52 • 1

tsunemoto/TinyLlama-1.1B-Chat-v0.6-x8-MoE-GGUF

6B • Updated Dec 29, 2023 • 127 • 6

mozilla-ai/TinyLlama-1.1B-Chat-v1.0-llamafile

Updated Jan 6, 2025 • 7.38k • 15

andrijdavid/CarbonVillain-en-10.7B-v2-GGUF

Text Generation • 11B • Updated Jan 1, 2024 • 32

andrijdavid/StopCarbon-10.7B-v5-GGUF

Text Generation • 11B • Updated Jan 1, 2024 • 52 • 1

LiteLLMs/CarbonVillain-en-10.7B-v3-GGUF

Text Generation • 11B • Updated Jan 1, 2024 • 45

yargpt/vicuna-13b-v1.5-gguf

Text Generation • 13B • Updated Jan 2, 2024 • 14 • 1

andrijdavid/TinyLlama-1.1B-Chat-v1.0-GGUF

Text Generation • 1B • Updated Jan 19, 2024 • 275 • 2

andrijdavid/finance-chat-GGUF

Text Generation • 7B • Updated Jan 19, 2024 • 896 • 4

andrijdavid/TinyLlama-1.1B-32k-GGUF

Text Generation • 1B • Updated Jan 2, 2024 • 142

andrijdavid/MobileLLaMA-1.4B-Base-GGUF

Text Generation • 1B • Updated Jan 2, 2024 • 246 • 2

andrijdavid/tinyfrank-1.4B-GGUF

Text Generation • 1B • Updated Jan 2, 2024 • 54

andrijdavid/MiniMA-2-3B-GGUF

Text Generation • 3B • Updated Jan 2, 2024 • 125

Trelis/Tiny

Text Generation • 1B • Updated Feb 22, 2024 • 7

tsunemoto/FlatDolphinMaid-8x7B-GGUF

47B • Updated Jan 4, 2024 • 63

rabil/TinyLlama-1.1B-Chat-v1.0-llamafile

Updated Jan 4, 2024 • 127

tsunemoto/Norobara-ZLoss-8x7B-GGUF

47B • Updated Jan 5, 2024 • 25

rabil/deepseek-coder-6.7b-instruct-llamafile

Updated Jan 5, 2024 • 170 • 3

rabil/dolphin-2_6-phi-2-llamafile

Updated Jan 7, 2024 • 42

tsunemoto/LiteLlama-460M-1T-GGUF

0.5B • Updated Jan 7, 2024 • 96 • 6

rabil/openchat-3.5-0106-llamafile

Updated Jan 11, 2024 • 32

tuantran1632001/Psyfighter2-Orca2-13B-ties-GGUF

13B • Updated Jan 12, 2024 • 147

sethuiyer/MedleyMD-GGUF

13B • Updated Jan 15, 2024 • 26 • 1