Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

140

Base only

Active filters: sglang

AxionML/Gemma-4-12B-FP8

Image-Text-to-Text • 12B • Updated 2 days ago • 1.44k • 3

AxionML/Qwen3.5-9B-NVFP4

Image-Text-to-Text • 7B • Updated Mar 3 • 872k • 17

SwitchXDDD/multilingual-eagle3-qwen3-8b

0.4B • Updated 3 days ago • 13 • 1

AxionML/Gemma-4-12B-NVFP4

Image-Text-to-Text • 8B • Updated 2 days ago • 1.11k • 1

Rifky/LFM2.5-8B-A1B-FP8

8B • Updated 2 days ago • 21 • 1

SurfaceData/llava-v1.6-mistral-7b-sglang

Image-Text-to-Text • 8B • Updated Mar 7, 2024 • 14 • 9

SurfaceData/llava-v1.6-vicuna-7b-sglang

Image-Text-to-Text • 7B • Updated Mar 7, 2024 • 14 • 1

tclf90/qwen2.5-72b-instruct-gptq-int4

Text Generation • 73B • Updated May 12, 2025 • 73 • 2

tclf90/qwen2.5-72b-instruct-gptq-int3

Text Generation • 69B • Updated May 12, 2025 • 65

alvarobartt/grok-2-tokenizer

Updated Aug 27, 2025 • 3

unsloth/grok-2

Text Generation • Updated Sep 6, 2025 • 109 • 5

osmapi/MiniMax-M2-THRIFT

173B • Updated Nov 13, 2025 • 1.56k • 35

mradermacher/MiniMax-M2-THRIFT-GGUF

Updated Apr 28 • 2

JasmineBBB/Kimi-Linear-48B-A3B-Instruct-bnb-4bit

Text Generation • 49B • Updated Nov 5, 2025 • 6 • 1

mradermacher/MiniMax-M2-THRIFT-i1-GGUF

173B • Updated Apr 28 • 79 • 10

bartowski/VibeStudio_MiniMax-M2-THRIFT-GGUF

Text Generation • 173B • Updated Nov 20, 2025 • 1.73k • 8

osmapi/MiniMax-M2-THRIFT-55

106B • Updated Dec 3, 2025 • 145 • 5

JinnP/SGLang-EAGLE3-Qwen3-Coder-30B-A3B-Instruct

Text Generation • 0.2B • Updated Nov 25, 2025 • 13 • 2

mradermacher/MiniMax-M2-THRIFT-55-GGUF

106B • Updated Apr 18 • 31 • 2

mradermacher/MiniMax-M2-THRIFT-55-i1-GGUF

106B • Updated Apr 19 • 399 • 2

osmapi/MiniMax-M2-THRIFT-55-MLX-4bit

106B • Updated Dec 2, 2025 • 30 • 2

osmapi/MiniMax-M2-THRIFT-55-MLX-6bit

106B • Updated Dec 3, 2025 • 24

Doradus-AI/MiroThinker-v1.0-30B-FP8

Text Generation • 31B • Updated Dec 5, 2025 • 9 • 4

Doradus-AI/Hermes-4.3-36B-FP8

Text Generation • 36B • Updated Dec 7, 2025 • 277 • 3

Doradus-AI/RnJ-1-Instruct-FP8

Text Generation • 9B • Updated Dec 7, 2025 • 618k • 4

QuantTrio/Kimi-K2.5-E304

Image-Text-to-Text • 841B • Updated Feb 2 • 383 • 3

bullpoint/Qwen3-Coder-Next-AWQ-4bit

Text Generation • 14B • Updated Feb 3 • 69.2k • 26

QuantTrio/Qwen3-Coder-Next-E336

Text Generation • 53B • Updated Feb 6 • 131 • 2

QuantTrio/Qwen3-Coder-Next-E400

Text Generation • 63B • Updated Feb 6 • 14 • 2

elon-trump/pixtral-12b-2409-w4a16-gptq

3B • Updated Apr 25