All downloadable models
2,889 of 24,133 models match
Download buttons use cached availability checks. Each click checks availability before the file is sent. Listed from the hosted-file index (refreshed every few minutes).
Includes models whose estimated memory need is at most 32 GB (from public metadata; not a runtime guarantee).
‘No license’ shows rows labeled ‘No license stated’.
Showing 73–96 of 2,889
gemma 3 270m it
unsloth · Text & chat · 253.1 MB · 1 file
gemma-3-270m-it-Q4_K_M.gguf · 253.1 MB · GGUF
Checked. Ready to download.
License: Gemma Terms of Use
This check proves the file arrived unchanged. Not that the model is safe.
Phi 3.5 mini instruct
bartowski · Code · 2.39 GB · 1 file
Phi-3.5-mini-instruct-Q4_K_M.gguf · 2.39 GB · GGUF
Checked. Ready to download.
License: MIT
This check proves the file arrived unchanged. Not that the model is safe.
gemma 3 1b it
lmstudio-community · Text & chat · 806.1 MB · 1 file
gemma-3-1b-it-Q4_K_M.gguf · 806.1 MB · GGUF
Checked. Ready to download.
License: Gemma Terms of Use
This check proves the file arrived unchanged. Not that the model is safe.
gemma 3 1b it
unsloth · Text & chat · 2.03 GB · 8 files
model.safetensors · 2 GB · Safetensors
Checked. Ready to download.
License: Gemma Terms of Use
This check proves the file arrived unchanged. Not that the model is safe.
All files for this model (8)
added_tokens.json · 35 bytes
Checked. Ready to download.
License: Gemma Terms of Use
This check proves the file arrived unchanged. Not that the model is safe.
generation_config.json · 233 bytes
Checked. Ready to download.
License: Gemma Terms of Use
This check proves the file arrived unchanged. Not that the model is safe.
- See all 8 files on the model page
Qwen2.5 1.5B Instruct unsloth bnb 4bit
unsloth · Text & chat · 1.54 GB · 10 files
model.safetensors · 1.53 GB · Safetensors
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
All files for this model (10)
generation_config.json · 270 bytes
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
added_tokens.json · 605 bytes
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
- See all 10 files on the model page
North Mini Code 1.0
unsloth · Text & chat · 446.2 GB · 26 files
Checking download availability again… Open model page · Try again
Llama 3.2 1B Instruct Q4 K M
hugging-quants · Text & chat · 807.7 MB · 1 file
llama-3.2-1b-instruct-q4_k_m.gguf · 807.7 MB · GGUF
Checked. Ready to download.
No license stated
This check proves the file arrived unchanged. Not that the model is safe.
Qwen2.5 3B Instruct
bartowski · Text & chat · 1.93 GB · 1 file
Qwen2.5-3B-Instruct-Q4_K_M.gguf · 1.93 GB · GGUF
Checked. Ready to download.
No license stated
This check proves the file arrived unchanged. Not that the model is safe.
Qwen3 4B Thinking 2507
MaziyarPanahi · Text & chat · 2.5 GB · 1 file
Qwen3-4B-Thinking-2507.Q4_K_M.gguf · 2.5 GB · GGUF
Checked. Ready to download.
No license stated
This check proves the file arrived unchanged. Not that the model is safe.
Qwen2 1.5B Instruct
Qwen · Text & chat · 1.63 GB · 8 files
model.safetensors · 1.61 GB · Safetensors
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
All files for this model (8)
generation_config.json · 242 bytes
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
config.json · 840 bytes
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
- See all 8 files on the model page
Qwen2.5 Coder 1.5B Instruct
Qwen · Code · 9.76 GB · 9 files
qwen2.5-coder-1.5b-instruct-q4_k_m.gguf · 1.12 GB · GGUF
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
All files for this model (9)
NVIDIA Nemotron 3 Nano 4B
lmstudio-community · Text & chat · 2.84 GB · 1 file
NVIDIA-Nemotron-3-Nano-4B-Q4_K_M.gguf · 2.84 GB · GGUF
Checked. Ready to download.
No license stated
This check proves the file arrived unchanged. Not that the model is safe.
Qwen1.5 1.8B Chat
Qwen · Text & chat · 3.68 GB · 6 files
model.safetensors · 3.67 GB · Safetensors
Checked. Ready to download.
No license stated
This check proves the file arrived unchanged. Not that the model is safe.
All files for this model (6)
generation_config.json · 206 bytes
Checked. Ready to download.
No license stated
This check proves the file arrived unchanged. Not that the model is safe.
config.json · 662 bytes
Checked. Ready to download.
No license stated
This check proves the file arrived unchanged. Not that the model is safe.
- See all 6 files on the model page
LFM2.5 1.2B Instruct
unsloth · Text & chat · 730.9 MB · 1 file
LFM2.5-1.2B-Instruct-Q4_K_M.gguf · 730.9 MB · GGUF
Checked. Ready to download.
No license stated
This check proves the file arrived unchanged. Not that the model is safe.
Qwen2 1.5B Instruct
Qwen · Text & chat · 5.26 GB · 5 files
qwen2-1_5b-instruct-q4_k_m.gguf · 986 MB · GGUF
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
All files for this model (5)
VibeThinker 3B
prithivMLmods · Code · 1.93 GB · 1 file
VibeThinker-3B.Q4_K_M.gguf · 1.93 GB · GGUF
Checked. Ready to download.
License: MIT
This check proves the file arrived unchanged. Not that the model is safe.
DeepSeek R1 Distill Llama 8B
unsloth · Text & chat · 4.92 GB · 1 file
DeepSeek-R1-Distill-Llama-8B-Q4_K_M.gguf · 4.92 GB · GGUF
Checked. Ready to download.
License: Llama 3.1 Community
This check proves the file arrived unchanged. Not that the model is safe.
Qwen2.5 1.5B unsloth bnb 4bit
unsloth · Text & chat · 1.42 GB · 10 files
model.safetensors · 1.4 GB · Safetensors
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
All files for this model (10)
generation_config.json · 171 bytes
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
added_tokens.json · 605 bytes
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
- See all 10 files on the model page
Llama 2 7B Chat
TheBloke · Text & chat · 4.08 GB · 1 file
llama-2-7b-chat.Q4_K_M.gguf · 4.08 GB · GGUF
Checked. Ready to download.
License: Llama 2 Community
This check proves the file arrived unchanged. Not that the model is safe.
SmolLM2 1.7B Instruct
bartowski · Text & chat · 1.06 GB · 1 file
SmolLM2-1.7B-Instruct-Q4_K_M.gguf · 1.06 GB · GGUF
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
Dolphin3.0 Llama3.1 8B
dphn · Text & chat · 4.92 GB · 1 file
Dolphin3.0-Llama3.1-8B-Q4_K_M.gguf · 4.92 GB · GGUF
Checked. Ready to download.
License: Llama 3.1 Community
This check proves the file arrived unchanged. Not that the model is safe.
gemma 3 270m it
unsloth · Text & chat · 570.8 MB · 8 files
model.safetensors · 536.2 MB · Safetensors
Checked. Ready to download.
License: Gemma Terms of Use
This check proves the file arrived unchanged. Not that the model is safe.
All files for this model (8)
added_tokens.json · 35 bytes
Checked. Ready to download.
License: Gemma Terms of Use
This check proves the file arrived unchanged. Not that the model is safe.
generation_config.json · 233 bytes
Checked. Ready to download.
License: Gemma Terms of Use
This check proves the file arrived unchanged. Not that the model is safe.
- See all 8 files on the model page
deepseek coder 6.7B instruct
TheBloke · Text & chat · 4.08 GB · 1 file
deepseek-coder-6.7b-instruct.Q4_K_M.gguf · 4.08 GB · GGUF
Checked. Ready to download.
No license stated
This check proves the file arrived unchanged. Not that the model is safe.
microsoft Phi 4 mini instruct
bartowski · Text & chat · 2.49 GB · 1 file
microsoft_Phi-4-mini-instruct-Q4_K_M.gguf · 2.49 GB · GGUF
Checked. Ready to download.
No license stated
This check proves the file arrived unchanged. Not that the model is safe.
These files are for a computer. Phones can’t run them. Downloads open with a program like LM Studio, Ollama or llama.cpp.