CompendiumLabs
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
MR
mradermacher
Qwen3.8-9B-heretic-uncensored-GGUF
Generalapache-2.0↓ 27.5K27,522 catalog downloads
HU
hugging-quants
Llama-3.2-3B-Instruct-Q4_K_M-GGUF
Chat & write2.02 GBNo license stated↓ 35K34,973 catalog downloads
MU
Mungert
neutts-air-GGUF
General666 MBNo license stated↓ 34.8K34,807 catalog downloads
HA
handy-computer
Fun-ASR-MLT-Nano-2512-gguf
Transcribe speech557 MBNo license stated↓ 32.5K32,461 catalog downloads
QU
QuantFactory
Llama-3-Open-Ko-8B-GGUF
Chat & write4.92 GBNo license stated↓ 1K1,025 catalog downloads
Understand imagesmit↓ 34.4K34,417 catalog downloads
Chat & write16.81 GBapache-2.0↓ 34.2K34,244 catalog downloads
MR
Chat & write16.54 GBapache-2.0↓ 31.7K31,655 catalog downloads
MR
Chat & write18.69 GBapache-2.0↓ 31.6K31,566 catalog downloads
MR
mradermacher
MN-12B-Mag-Mell-R1-GGUF
Chat & write7.48 GBNo license stated↓ 29K29,017 catalog downloads
MR
mradermacher
Qwen3.8-9B-heretic-uncensored-i1-GGUF
Chat & write5.63 GBNo license stated↓ 28.4K28,394 catalog downloads