bartowski
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
Chat & write13.66 GBapache-2.0↓ 2K2,034 catalog downloads
BA
bartowski
Violet_Twilight-v0.1-GGUF
Chat & write7.48 GBapache-2.0↓ 2K2,025 catalog downloads
TH
TheBloke
OpenHermes-2-Mistral-7B-GGUF
Chat & write4.37 GBapache-2.0↓ 2K2,021 catalog downloads
TH
TheBloke
deepsex-34B-GGUF
Chat & write20.66 GBmit↓ 2K2,016 catalog downloads
BA
Chat & write2.32 GBapache-2.0↓ 2K1,992 catalog downloads
TH
TheBloke
dolphin-2.6-mixtral-8x7b-GGUF
Chat & write26.44 GBapache-2.0↓ 2K1,991 catalog downloads
BA
bartowski
Replete-LLM-V2.5-Qwen-0.5B-GGUF
Chat & write491 MBapache-2.0↓ 2K1,985 catalog downloads
BA
bartowski
Phi-3-medium-4k-instruct-GGUF
Chat & write8.57 GBmit↓ 2K1,983 catalog downloads
LM
lmstudio-community
granite-3.1-8B-instruct-GGUF
Chat & write4.94 GBapache-2.0↓ 2K1,971 catalog downloads
BA
bartowski
open-r1_OpenR1-Qwen-7B-GGUF
Chat & write4.68 GBapache-2.0↓ 2K1,959 catalog downloads
QU
QuantFactory
Llama-3.1-8B-Stheno-v3.4-GGUF
Chat & write4.92 GBcc-by-nc-4.0↓ 2K1,959 catalog downloads