unsloth
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
TwinLlama-3.1-8B-DPO3-GGUF
Chat & write4.92 GBapache-2.0↓ 514514 catalog downloads
QU
QuantFactory
SuperCorrect-7B-GGUF
Answer questions4.68 GBapache-2.0↓ 512512 catalog downloads
GG
ggml-org
Llama-2-7B-GGUF
Chat & write3.79 GBllama2↓ 511511 catalog downloads
BA
bartowski
dolphin-2.9.3-Yi-1.5-34B-32k-GGUF
Chat & write20.66 GBapache-2.0↓ 507507 catalog downloads
QU
QuantFactory
Qwen2.5-7B-GGUF
Chat & write4.68 GBapache-2.0↓ 501501 catalog downloads
TH
TheBloke
Mistral-7B-Merge-14-v0.1-GGUF
Chat & write4.37 GBapache-2.0↓ 501501 catalog downloads
BA
bartowski
Mistral-Crab-DPO-GGUF
Chat & write4.37 GBapache-2.0↓ 497497 catalog downloads
QU
QuantFactory
Qwen2.5-Math-1.5B-GGUF
Chat & write986 MBapache-2.0↓ 495495 catalog downloads
BA
bartowski
granite-3.0-2B-instruct-GGUF
Chat & write1.6 GBapache-2.0↓ 494494 catalog downloads
LM
lmstudio-community
mathstral-7B-v0.1-GGUF
Chat & write4.37 GBapache-2.0↓ 492492 catalog downloads
QU
QuantFactory
Yi-Coder-9B-GGUF
Chat & write5.33 GBapache-2.0↓ 491491 catalog downloads