Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

speculative-decoding

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

556

Base only

Active filters: speculative-decoding

mlx-community/Qwen3.6-27B-MTP-4bit

Text Generation • 66.4M • Updated 5 days ago • 1.35k • 3

z-lab/Qwen3.5-9B-DFlash

Text Generation • 1B • Updated Apr 7 • 18.8k • 34

Lorbus/Qwen3.6-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated Apr 22 • 1.48M • 110

AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-NVFP4

Text Generation • 19B • Updated 2 days ago • 91.5k • 68

lyf/Qwen3.6-27B-heretic-v2-mtp-int4-AutoRound

Image-Text-to-Text • 3B • Updated Apr 28 • 2.99k • 8

z-lab/gemma-4-31B-it-DFlash

Text Generation • 2B • Updated 30 days ago • 35.3k • 94

Youssofal/Qwen3.6-27B-MTPLX-Optimized

Text Generation • 27B • Updated May 4 • 5.43k • 7

mlx-community/gemma-4-E2B-it-assistant-bf16

Text Generation • 78M • Updated May 5 • 2.97k • 6

poolside/Laguna-XS.2-speculator.dflash

0.6B • Updated 19 days ago • 747 • 7

Youssofal/Qwen3.6-27B-MTPLX-Optimized-Quality

Image-Text-to-Text • 8B • Updated 4 minutes ago • 4.85k • 4

LordNeel/DeepSeek-V4-Flash-Acti-MTP-W4A16-FP8

Text Generation • 44B • Updated 27 days ago • 2.94k • 11

GestaltLabs/Ornstein3.6-27B-MTP-NSC-ACE-SABER-GGUF

Image-Text-to-Text • 27B • Updated 24 days ago • 5.93k • 11

gaston-parravicini/Qwen3.6-27B-Abliterated-MTP-GGUF

27B • Updated 20 days ago • 5.23k • 7

canada-quant/DeepSeek-V4-Flash-NVFP4-FP8-MTP

171B • Updated 9 days ago • 3.04k • 8

ManniX-ITA/Qwen3.6-27B-Omnimerge-v4-MTP-GGUF

27B • Updated 16 days ago • 8.05k • 5

dealignai/Qwen3.6-35B-A3B-MXFP8-CRACK-MTP

Image-Text-to-Text • 10B • Updated 13 days ago • 1.5k • 6

Huang2020/Qwen3-4B-Domino-b16

Text Generation • 0.6B • Updated 5 days ago • 365 • 2

prithivMLmods/Qwen3.6-35B-A3B-MTP-GGUF

Image-Text-to-Text • 36B • Updated 6 days ago • 3.76k • 3

fraQtl/Qwen3.6-35B-A3B-Hi-Fi-MTP-runtime

Text Generation • Updated 7 days ago • 591 • 2

bytkim/Qwen3.6-27B-MTP-pi-tune-GGUF

Text Generation • Updated 4 days ago • 1.48k • 2

sjakek/gemma4-12b-mtp-assistant

Text Generation • 0.4B • Updated 3 days ago • 2.6k • 3

bahadirakdemir/gemma-4-12B-it-assistant-fp8

Text Generation • 0.4B • Updated 3 days ago • 135 • 2

colefuoco00/gemma-4-12B-it-assistant-GGUF

0.4B • Updated 3 days ago • 1.36k • 2

ji-farthing/gemma-4-qat-q4_0-MTP-assistants-ik-llama-GGUF

0.4B • Updated about 17 hours ago • 448 • 2

Janvitos/gemma-4-12B-it-qat-assistant-MTP-Q8_0-GGUF

0.4B • Updated about 8 hours ago • 2

z-lab/Qwen3-8B-DFlash-b16

Text Generation • 1B • Updated Apr 7 • 58.8k • 25

z-lab/Qwen3.5-35B-A3B-DFlash

Text Generation • 0.5B • Updated Apr 7 • 5.49k • 37

z-lab/Qwen3.5-4B-DFlash

Text Generation • 0.5B • Updated Apr 7 • 20.9k • 24

lightseekorg/kimi-k2.5-eagle3

3B • Updated Mar 16 • 39k • 13

z-lab/Kimi-K2.5-DFlash

Text Generation • 3B • Updated Apr 18 • 1.7k • 31