bartowski
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
NO
NousResearch
Nous-Capybara-7B-V1-GGUF
General4.08 GBmit↓ 5151 catalog downloads
BA
bartowski
allura-org_remnant-mn-12B-GGUF
Chat & write7.48 GBapache-2.0↓ 2K2,043 catalog downloads
BA
Chat & write13.66 GBapache-2.0↓ 2K2,034 catalog downloads
TH
TheBloke
OpenHermes-2-Mistral-7B-GGUF
Chat & write4.37 GBapache-2.0↓ 2K2,021 catalog downloads
BA
Chat & write2.32 GBapache-2.0↓ 2K1,992 catalog downloads
TH
TheBloke
dolphin-2.6-mixtral-8x7b-GGUF
Chat & write26.44 GBapache-2.0↓ 2K1,991 catalog downloads
BA
bartowski
Replete-LLM-V2.5-Qwen-0.5B-GGUF
Chat & write491 MBapache-2.0↓ 2K1,985 catalog downloads
BA
bartowski
Phi-3-medium-4k-instruct-GGUF
Chat & write8.57 GBmit↓ 2K1,983 catalog downloads
LM
lmstudio-community
granite-3.1-8B-instruct-GGUF
Chat & write4.94 GBapache-2.0↓ 2K1,971 catalog downloads
BA
Chat & write1.12 GBmit↓ 2K1,967 catalog downloads
QU
Chat & write2.02 GBcc-by-4.0↓ 2K1,963 catalog downloads