TheBloke
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
QU
QuantFactory
Peach-2.0-9B-8k-Roleplay-GGUF
Chat & write5.33 GBmit↓ 816816 catalog downloads
TH
TheBloke
airoboros-mistral2.2-7B-GGUF
Chat & write4.37 GBmit↓ 811811 catalog downloads
BA
bartowski
nvidia_OpenMath-Nemotron-1.5B-GGUF
Chat & write986 MBcc-by-4.0↓ 809809 catalog downloads
BA
bartowski
magnaraxy-9B-GGUF
Chat & write5.76 GBapache-2.0↓ 808808 catalog downloads
QU
QuantFactory
LLaMA-3-8B-SFR-SFT-R-GGUF
Chat & write4.92 GBllama3↓ 808808 catalog downloads
QU
QuantFactory
Llama-3-8B-Magpie-Pro-SFT-200K-v0.1-GGUF
Chat & write4.92 GBllama3↓ 806806 catalog downloads
QU
QuantFactory
llama-3-nvidia-ChatQA-1.5-8B-GGUF
Chat & write4.92 GBllama3↓ 806806 catalog downloads
BA
bartowski
Darkest-muse-v1-GGUF
Chat & write5.76 GBapache-2.0↓ 796796 catalog downloads
BA
Chat & write4.26 GBapache-2.0↓ 790790 catalog downloads
BA
Chat & write6.46 GBapache-2.0↓ 784784 catalog downloads
QU
QuantFactory
Sparse-Llama-3.1-8B-2of4-GGUF
Chat & write4.92 GBllama3.1↓ 783783 catalog downloads