Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

2,213

Full-text search

Active filters: quantized

jedisct1/MiMo-7B-RL-GGUF

Updated 9 days ago • 19.5k • 16

RedHatAI/Qwen3-32B-FP8-dynamic

Text Generation • Updated 7 days ago • 448 • 5

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic

Image-Text-to-Text • Updated 9 minutes ago • 8.8k • 11

ABDALLALSWAITI/FLUX.1-dev-ControlNet-Union-Pro-2.0-fp8

Text-to-Image • Updated 20 days ago • 3.72k • 19

argmaxinc/whisperkit-coreml

Automatic Speech Recognition • Updated 17 days ago • 366k • 130

MaziyarPanahi/Qwen3-32B-GGUF

Text Generation • Updated 10 days ago • 84.1k • 2

NextGenC/erynn-1-774m

Text Generation • Updated 10 days ago • 7 • 2

RedHatAI/Qwen3-32B-quantized.w4a16

Text Generation • Updated 4 days ago • 51 • 2

afrideva/TinyLlama-1.1B-alpaca-chat-v1.5-GGUF

Text Generation • Updated Nov 6, 2023 • 56 • 2

afrideva/TinyMistral-248M-GGUF

Text Generation • Updated Dec 11, 2023 • 10.6k • 5

afrideva/TinyLlama-1.1B-Chat-v0.4-GGUF

Text Generation • Updated Nov 16, 2023 • 100 • 4

afrideva/TinyLlama-1.1B-Chat-v0.6-GGUF

Text Generation • Updated Nov 20, 2023 • 167 • 10

afrideva/Tiny-Vicuna-1B-GGUF

Text Generation • Updated Nov 23, 2023 • 339k • 7

afrideva/phi-2-uncensored-GGUF

Text Generation • Updated Dec 21, 2023 • 1.19k • 11

afrideva/Astrea-RP-v1-3B-GGUF

Text Generation • Updated Dec 26, 2023 • 112 • 3

MaziyarPanahi/BASH-Coder-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26, 2024 • 101 • 3

MaziyarPanahi/miqu-1-70b-sf-GPTQ

Text Generation • Updated Feb 4, 2024 • 13 • 10

qualcomm/Stable-Diffusion

Unconditional Image Generation • Updated Apr 30, 2024 • 24

Lewdiculous/Kunoichi-DPO-v2-7B-GGUF-Imatrix

Text Generation • Updated May 4, 2024 • 3.62k • 39

AetherArchitectural/GGUF-Quantization-Script

Text Generation • Updated Dec 18, 2024 • 65

MaziyarPanahi/Yi-9B-GGUF

Text Generation • Updated Mar 14, 2024 • 420 • 15

MaziyarPanahi/Saul-Instruct-v1-GGUF

Text Generation • Updated Mar 10, 2024 • 299 • 8

MaziyarPanahi/zephyr-orpo-141b-A35b-v0.1-GGUF

Text Generation • Updated Apr 12, 2024 • 9.21k • 29

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 293k • 80

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 9.55k • 127

Lewdiculous/Aura_v2_7B-GGUF-IQ-Imatrix

Updated Apr 16, 2024 • 203 • 13

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14, 2024 • 18.8k • 169

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23, 2024 • 328k • 89

afrideva/TeenyTinyLlama-160m-GGUF

Text Generation • Updated May 12, 2024 • 119 • 2

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 326k • 96

	
		OSZAR »