bartowski
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
TheDrummer_Snowpiercer-15B-v4-GGUF
Chat & write9.11 GBNo license stated↓ 3.8K3,793 catalog downloads
BA
bartowski
Qwen2.5-Coder-3B-GGUF
Chat & write1.93 GBNo license stated↓ 3.8K3,765 catalog downloads
QU
QuantFactory
DeepSeek-R1-Distill-Qwen-14B-abliterated-v2-GGUF
Chat & write8.99 GBNo license stated↓ 3.7K3,737 catalog downloads
MA
MaziyarPanahi
Meta-Llama-3.1-8B-Instruct-GGUF
Chat & write4.92 GBllama3.1↓ 152K152,036 catalog downloads
Generalapache-2.0↓ 150.7K150,709 catalog downloads
MA
MaziyarPanahi
Mistral-Small-24B-Instruct-2501-GGUF
Chat & write14.33 GBapache-2.0↓ 149.3K149,332 catalog downloads
MA
MaziyarPanahi
WizardLM-2-7B-GGUF
Chat & writeapache-2.0↓ 145.7K145,693 catalog downloads
RE
ReadyArt
Serenity-26B-A4B-GGUF
Chat & write16.8 GBapache-2.0↓ 143.3K143,266 catalog downloads
Understand imagesapache-2.0↓ 139.9K139,867 catalog downloads
LL
Understand imagesapache-2.0↓ 126.2K126,173 catalog downloads
HA
handy-computer
parakeet-tdt-0.6B-v2-gguf
Transcribe speech475 MBcc-by-4.0↓ 122.8K122,814 catalog downloads