mradermacher
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
Wayfarer-12B-GGUF
Chat & write7.48 GBapache-2.0↓ 1.1K1,051 catalog downloads
BA
bartowski
open-thoughts_OpenThinker-32B-GGUF
Chat & write19.85 GBapache-2.0↓ 985985 catalog downloads
BA
bartowski
StarDust-12B-v2-GGUF
Chat & write7.48 GBapache-2.0↓ 980980 catalog downloads
QU
QuantFactory
gpt2-GGUF
Chat & write113 MBmit↓ 973973 catalog downloads
BA
Chat & write4.94 GBapache-2.0↓ 959959 catalog downloads
TH
TheBloke
cinematika-7B-v0.1-GGUF
Chat & write4.37 GBapache-2.0↓ 942942 catalog downloads
BA
bartowski
LLAMA-3_8B_Unaligned_Alpha-GGUF
Chat & write4.92 GBapache-2.0↓ 931931 catalog downloads
BA
bartowski
ozone-ai_Reverb-7B-GGUF
Chat & write4.68 GBapache-2.0↓ 883883 catalog downloads
QU
QuantFactory
Llama3.1-8B-PRM-Deepseek-Data-GGUF
Chat & write4.92 GBNo license stated↓ 1.1K1,143 catalog downloads
QU
QuantFactory
Skywork-Critic-Llama-3.1-8B-GGUF
Chat & write4.92 GBNo license stated↓ 991991 catalog downloads
QU
QuantFactory
DeepSeek-Coder-V2-Lite-Base-GGUF
Chat & write10.36 GBNo license stated↓ 945945 catalog downloads