bartowski
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
QU
QuantFactory
gemma-2-baku-2B-it-GGUF
Chat & write1.71 GBgemma↓ 923923 catalog downloads
QU
QuantFactory
Qwen2.5-0.5B-Instruct-GGUF
Chat & write398 MBapache-2.0↓ 922922 catalog downloads
QU
QuantFactory
ArliAI-Llama-3-8B-Dolfin-v0.3-GGUF
Chat & write4.92 GBllama3↓ 921921 catalog downloads
QU
QuantFactory
Control-8B-V1.1-GGUF
Chat & write4.92 GBagpl-3.0↓ 916916 catalog downloads
BA
bartowski
TAID-LLM-1.5B-GGUF
Chat & write986 MBapache-2.0↓ 914914 catalog downloads
QU
QuantFactory
Bielik-7B-Instruct-v0.1-GGUF
Chat & write4.37 GBcc-by-nc-4.0↓ 914914 catalog downloads
BA
bartowski
Dans-DangerousWinds-V1.1.0-12B-GGUF
Chat & write7.48 GBapache-2.0↓ 905905 catalog downloads
BA
bartowski
EVA-Qwen2.5-14B-v0.0-GGUF
Chat & write8.99 GBapache-2.0↓ 903903 catalog downloads
QU
QuantFactory
Phi-3-mini-128k-instruct-GGUF
Chat & write2.39 GBmit↓ 902902 catalog downloads
BA
bartowski
mathstral-7B-v0.1-GGUF
Chat & write4.37 GBapache-2.0↓ 900900 catalog downloads
BA
Chat & write8.99 GBcc-by-4.0↓ 900900 catalog downloads