bartowski
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for Llama GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
Replete-Coder-V2-Llama-3.1-8B-GGUF
Chat & write4.92 GBapache-2.0↓ 2.1K2,125 catalog downloads
BA
bartowski
Llama-3-8B-Instruct-Coder-GGUF
Chat & write4.92 GBapache-2.0↓ 1.6K1,597 catalog downloads
Chat & write4.92 GBapache-2.0↓ 1.6K1,568 catalog downloads
BA
bartowski
Llama-3-11.5B-Instruct-Coder-v2-GGUF
Chat & write7.01 GBapache-2.0↓ 1.6K1,583 catalog downloads
Chat & write4.92 GBapache-2.0↓ 1.5K1,472 catalog downloads
QU
QuantFactory
Llama-3.2-3B-Agent007-Coder-GGUF
Chat & write2.02 GBapache-2.0↓ 1K1,022 catalog downloads
MR
mradermacher
AMD-Llama-135m-code-i1-GGUF
Chat & write86 MBapache-2.0↓ 954954 catalog downloads
TH
TheBloke
Llama-2-Coder-7B-GGUF
Chat & write4.08 GBapache-2.0↓ 1.1K1,119 catalog downloads
QU
QuantFactory
AMD-Llama-135m-code-GGUF
Chat & write86 MBapache-2.0↓ 685685 catalog downloads
Chat & write4.92 GBapache-2.0↓ 861861 catalog downloads
BA
bartowski
AMD-Llama-135m-code-GGUF
Chat & write86 MBapache-2.0↓ 279279 catalog downloads