MaziyarPanahi
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
MA
MaziyarPanahi
Llama-3.2-1B-Instruct-GGUF
Chat & write808 MBNo license stated↓ 158.7K158,682 catalog downloads
MA
MaziyarPanahi
gemma-3-4B-it-GGUF
Chat & write2.49 GBNo license stated↓ 156.7K156,701 catalog downloads
MA
MaziyarPanahi
Llama-3-8B-Instruct-32k-v0.1-GGUF
Chat & write4.92 GBNo license stated↓ 156.3K156,260 catalog downloads
MA
MaziyarPanahi
phi-4-GGUF
Chat & write9.05 GBNo license stated↓ 154.8K154,798 catalog downloads
SU
sugoitoolkit
Sugoi-14B-Ultra-GGUF
Translate text8.99 GBapache-2.0↓ 181.9K181,923 catalog downloads
EM
empero-ai
Qwen3.8-4B-Distill-GGUF
Chat & write2.78 GBapache-2.0↓ 175.2K175,175 catalog downloads
EM
empero-ai
Qwen3.8-2B-Distill-GGUF
Chat & write1.31 GBapache-2.0↓ 171.2K171,158 catalog downloads
IN
internlm
internlm2_5-20B-chat-gguf
Chat & write11.98 GBapache-2.0↓ 122122 catalog downloads
IN
inclusionAI
DR-Venus-4B-SFT-GGUF
General2.72 GBNo license stated↓ 146146 catalog downloads
UN
Understand imagesapache-2.0↓ 4.8K4,841 catalog downloads
BA
bartowski
EVA-Qwen2.5-14B-v0.2-GGUF
Chat & write8.99 GBapache-2.0↓ 4.8K4,838 catalog downloads