mradermacher
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
MA
MaziyarPanahi
Mistral-Small-Instruct-2409-GGUF
Chat & write13.34 GBNo license stated↓ 153.7K153,673 catalog downloads
MA
MaziyarPanahi
DeepSeek-R1-0528-Qwen3-8B-GGUF
Chat & write5.03 GBNo license stated↓ 153.4K153,372 catalog downloads
MA
MaziyarPanahi
Llama-3.2-3B-Instruct-GGUF
Chat & write2.02 GBNo license stated↓ 153.3K153,277 catalog downloads
MA
MaziyarPanahi
mistral-small-3.1-24B-instruct-2503-hf-GGUF
Chat & write14.33 GBNo license stated↓ 153K152,994 catalog downloads
MA
MaziyarPanahi
mathstral-7B-v0.1-GGUF
Chat & write4.37 GBNo license stated↓ 152.6K152,611 catalog downloads
MA
MaziyarPanahi
Phi-4-mini-instruct-GGUF
Chat & write2.49 GBNo license stated↓ 151.9K151,851 catalog downloads
MA
MaziyarPanahi
gemma-2-2B-it-GGUF
Chat & write1.71 GBNo license stated↓ 151.3K151,274 catalog downloads
MA
MaziyarPanahi
gemma-3-27B-it-GGUF
Chat & write16.55 GBNo license stated↓ 151.2K151,184 catalog downloads
MA
MaziyarPanahi
Mistral-Nemo-Instruct-2407-GGUF
Chat & write7.48 GBNo license stated↓ 151.1K151,096 catalog downloads
MA
MaziyarPanahi
Qwen2.5-7B-Instruct-GGUF
Chat & write4.68 GBNo license stated↓ 150.7K150,738 catalog downloads
MA
MaziyarPanahi
gemma-3-1B-it-GGUF
Chat & write806 MBNo license stated↓ 150.7K150,729 catalog downloads