bartowski
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
Qwen2.5-Coder-3B-GGUF
Chat & write1.93 GBNo license stated↓ 3.8K3,765 catalog downloads
QU
QuantFactory
DeepSeek-R1-Distill-Qwen-14B-abliterated-v2-GGUF
Chat & write8.99 GBNo license stated↓ 3.7K3,737 catalog downloads
MA
MaziyarPanahi
Meta-Llama-3.1-8B-Instruct-GGUF
Chat & write4.92 GBllama3.1↓ 152K152,036 catalog downloads
Generalapache-2.0↓ 150.7K150,709 catalog downloads
MA
MaziyarPanahi
Mistral-Small-24B-Instruct-2501-GGUF
Chat & write14.33 GBapache-2.0↓ 149.3K149,332 catalog downloads
MA
MaziyarPanahi
Yi-1.5-6B-Chat-GGUF
Chat & write3.67 GBapache-2.0↓ 146.4K146,352 catalog downloads
MA
MaziyarPanahi
WizardLM-2-7B-GGUF
Chat & writeapache-2.0↓ 145.7K145,693 catalog downloads
Understand imagesapache-2.0↓ 139.9K139,867 catalog downloads
LL
Understand imagesapache-2.0↓ 126.2K126,173 catalog downloads
HA
handy-computer
parakeet-tdt-0.6B-v2-gguf
Transcribe speech475 MBcc-by-4.0↓ 122.8K122,814 catalog downloads
Generalapache-2.0↓ 121.8K121,765 catalog downloads