QuantFactory
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
PygmalionAI_Eleusis-12B-GGUF
Chat & write7.48 GBapache-2.0↓ 2K1,952 catalog downloads
BA
bartowski
ProCreations_grug-3B-GGUF
Chat & write2.68 GBapache-2.0↓ 2K1,951 catalog downloads
TH
Chat & write28.45 GBapache-2.0↓ 1.9K1,924 catalog downloads
LM
lmstudio-community
Devstral-Small-2507-GGUF
Chat & write14.33 GBapache-2.0↓ 1.9K1,923 catalog downloads
GG
ggml-org
Nomic-Embed-Text-V2-GGUF
Compare sentences512 MBapache-2.0↓ 1.9K1,910 catalog downloads
LM
lmstudio-community
gemma-1.1-2B-it-GGUF
Chat & write1.63 GBgemma↓ 1.9K1,903 catalog downloads
UN
unsloth
Qwen-Image-GGUF
Create images13.13 GBapache-2.0↓ 1.9K1,886 catalog downloads
BA
bartowski
Phi-3.1-mini-128k-instruct-GGUF
Chat & write2.39 GBmit↓ 1.9K1,874 catalog downloads
BA
bartowski
Qwen2.5-Coder-0.5B-GGUF
Chat & write398 MBapache-2.0↓ 1.9K1,871 catalog downloads
BA
Chat & write4.92 GBapache-2.0↓ 1.9K1,868 catalog downloads
BA
bartowski
FineMath-Llama-3B-GGUF
Chat & write2.02 GBapache-2.0↓ 1.9K1,862 catalog downloads