wiktorwojcik112/gemma-2-2b-it-Q4_K_M-GGUF
Text Generation • 3B • Updated • 21
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
25,074
Active filters: llama-cpp
reach-vb/Meta-Llama-3.1-8B-Q8_0-GGUF
Text Generation • 8B • Updated • 7
reach-vb/Meta-Llama-3.1-8B-Q2_K-GGUF
Text Generation • 8B • Updated • 10 • 2
SansarK/TinyLlama_v1.1-Q5_K_S-GGUF
1B • Updated • 8
aifoundry-org/granite-8b-code-instruct-128k-Q4_K_M-GGUF
Text Generation • 8B • Updated • 33 • 1
adrlau/Chocolatine-3B-Instruct-DPO-Revised-Q4_K_M-GGUF
Text Generation • 4B • Updated • 5 • 1
Niansuh/Mistral-Nemo-Instruct-2407-Q8_0-GGUF
12B • Updated • 15
kaetemi/Meta-Llama-3-8B-Q2_K-GGUF
Text Generation • 8B • Updated • 16
lomaky/Gemma-2-2b-it-chat-doctor-Q4_K_M-GGUF
3B • Updated • 15
Sovenok-Hacker/gemma-2-2b-it-Q4_0-GGUF
Text Generation • 3B • Updated • 40 • 1
shoemaker/L3.1-8B-sunfall-v0.6.1-dpo-Q8_0-GGUF
8B • Updated • 18 • 1
pegasus912/Nemo-12B-Marlin-v2-Q4_K_M-GGUF
12B • Updated • 11
kaetemi/Meta-Llama-3-8B-Q4_K_M-GGUF-c3o12
Text Generation • 8B • Updated • 11
kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-c3o12
Text Generation • 8B • Updated • 37
MugenYume/elm-turbo-0.25-instruct-Q4_K_M-GGUF
2B • Updated • 9
Johnyquest7/BioMistral-merged-zephyr-Q4_K_M-GGUF
7B • Updated • 19 • 1
MugenYume/elm-turbo-0.50-instruct-Q4_K_M-GGUF
2B • Updated • 7
shoemaker/L3-8B-sunfall-v0.5-Q8_0-GGUF
8B • Updated • 23 • 1
kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-c3o14
Text Generation • 8B • Updated • 25
knickyen/TAIDE-LX-7B-Chat-Q4_K_M-GGUF
7B • Updated • 5
Xusilak/gemma-2-27b-it-Q4_K_M-GGUF
Text Generation • 27B • Updated • 12
cha9ro/Llama-3.1-8B-EZO-1.1-it-Q4_K_M-GGUF
Text Generation • 8B • Updated • 11
VAIBHAV22334455/NOVA-3B-V4-Q8_0-GGUF
2B • Updated • 1
Pyroserenus/MindfulMagnumMaid-12b-v0.1-Q6_K-GGUF
12B • Updated • 28 • 1
Xusilak/gemma-2-9b-it-Q8_0-GGUF
Text Generation • 9B • Updated • 8
nguyenphuthien/ura-llama-2.1-8b-Q6_K-GGUF
8B • Updated • 8
Parkoz/Llama-3.1-Korean-8B-Instruct-Q4_K_M-GGUF
8B • Updated • 23
Parkoz/Llama-3.1-Korean-8B-Instruct-Q4_K_S-GGUF
8B • Updated • 13
owns-01bit/gemma-2-2b-Q3_K_S-GGUF
Text Generation • 3B • Updated • 32
Mihaiii/shieldgemma-2b-Q5_K_M-GGUF
Text Generation • 3B • Updated • 12