Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
LI
LiquidAI
LFM2.5-230M-GGUF
Chat & write153 MBNo license stated↓ 595.1K595,066 catalog downloads
LI
LiquidAI
LFM2.5-8B-A1B-GGUF
Chat & write5.16 GBNo license stated↓ 535.5K535,515 catalog downloads
SE
Serveurperso
MiniMax-Music3-GGUF
General1.39 GBNo license stated↓ 527.8K527,764 catalog downloads
IN
inclusionAI
ArmorOCR-GGUF
Understand imagesapache-2.0↓ 473473 catalog downloads
CO
CohereLabs
tiny-aya-earth-GGUF
Chat & write2.14 GBcc-by-nc-4.0↓ 410410 catalog downloads
CO
CohereLabs
tiny-aya-fire-GGUF
Chat & write2.14 GBcc-by-nc-4.0↓ 401401 catalog downloads
OP
openbmb
MiniCPM4.1-8B-GGUF
Chat & write4.97 GBapache-2.0↓ 380380 catalog downloads
LM
lmstudio-community
Mistral-7B-Instruct-v0.3-GGUF
Chat & write4.37 GBapache-2.0↓ 15.3K15,346 catalog downloads
TH
TheBloke
dolphin-2.5-mixtral-8x7b-GGUF
Chat & write26.44 GBapache-2.0↓ 15.2K15,239 catalog downloads
UN
Chat & writeapache-2.0↓ 15.1K15,135 catalog downloads
BA
bartowski
Mistral-Nemo-Instruct-2407-GGUF
Chat & write7.48 GBapache-2.0↓ 14.9K14,920 catalog downloads