All downloadable models
2,855 of 24,133 models match
Download buttons use cached availability checks. Each click checks availability before the file is sent. Listed from the hosted-file index (refreshed every few minutes).
Includes models whose estimated memory need is at most 8 GB (from public metadata; not a runtime guarantee).
‘No license’ shows rows labeled ‘No license stated’.
Showing 49–72 of 2,855
Qwen2.5 1.5B Instruct
MaziyarPanahi · Text & chat · 986 MB · 1 file
Qwen2.5-1.5B-Instruct.Q4_K_M.gguf · 986 MB · GGUF
Checked. Ready to download.
No license stated
This check proves the file arrived unchanged. Not that the model is safe.
Qwen2 7B Instruct
MaziyarPanahi · Text & chat · 4.68 GB · 1 file
Qwen2-7B-Instruct.Q4_K_M.gguf · 4.68 GB · GGUF
Checked. Ready to download.
No license stated
This check proves the file arrived unchanged. Not that the model is safe.
Ministral 3 3B Reasoning 2512
MaziyarPanahi · Text & chat · 2.15 GB · 1 file
Ministral-3-3B-Reasoning-2512.Q4_K_M.gguf · 2.15 GB · GGUF
Checked. Ready to download.
No license stated
This check proves the file arrived unchanged. Not that the model is safe.
Llama 3 8B Instruct 64k
MaziyarPanahi · Text & chat · 4.92 GB · 1 file
Llama-3-8B-Instruct-64k.Q4_K_M.gguf · 4.92 GB · GGUF
Checked. Ready to download.
No license stated
This check proves the file arrived unchanged. Not that the model is safe.
TinyLlama 1.1B Chat v1.0
TheBloke · Text & chat · 770 MB · 9 files
model.safetensors · 768.1 MB · Safetensors
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
All files for this model (9)
generation_config.json · 124 bytes
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
quantize_config.json · 212 bytes
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
- See all 9 files on the model page
SmolLM2 1.7B Instruct
HuggingFaceTB · Text & chat · 21 GB · 27 files
model.safetensors · 3.42 GB · Safetensors
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
All files for this model (27)
generation_config.json · 132 bytes
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
train_results.json · 232 bytes
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
- See all 27 files on the model page
Qwen3 4B
unsloth · Text & chat · 67.8 GB · 30 files
Qwen3-4B-Q4_K_M.gguf · 2.5 GB · GGUF
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
All files for this model (30)
Qwen3 8B
unsloth · Text & chat · 133.4 GB · 29 files
Qwen3-8B-Q4_K_M.gguf · 5.03 GB · GGUF
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
All files for this model (29)
Llama 3.2 1B Instruct
bartowski · Text & chat · 807.7 MB · 1 file
Llama-3.2-1B-Instruct-Q4_K_M.gguf · 807.7 MB · GGUF
Checked. Ready to download.
License: Llama 3.2 Community
This check proves the file arrived unchanged. Not that the model is safe.
Llama 3.2 3B Instruct
bartowski · Text & chat · 2.02 GB · 1 file
Llama-3.2-3B-Instruct-Q4_K_M.gguf · 2.02 GB · GGUF
Checked. Ready to download.
License: Llama 3.2 Community
This check proves the file arrived unchanged. Not that the model is safe.
Qwen3 0.6B
unsloth · Text & chat · 10.9 GB · 32 files
Qwen3-0.6B-Q4_K_M.gguf · 396.7 MB · GGUF
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
All files for this model (32)
SmolLM2 135M Instruct
unsloth · Text & chat · 105.5 MB · 1 file
SmolLM2-135M-Instruct-Q4_K_M.gguf · 105.5 MB · GGUF
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
Qwen2.5 Coder 0.5B Instruct
Qwen · Code · 999.6 MB · 8 files
model.safetensors · 988.1 MB · Safetensors
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
All files for this model (8)
generation_config.json · 243 bytes
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
config.json · 659 bytes
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
- See all 8 files on the model page
Meta Llama 3.1 8B Instruct
lmstudio-community · Text & chat · 4.92 GB · 1 file
Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf · 4.92 GB · GGUF
Checked. Ready to download.
License: Llama 3.1 Community
This check proves the file arrived unchanged. Not that the model is safe.
DeepSeek R1 0528 Qwen3 8B
lmstudio-community · Text & chat · 13.7 GB · 2 files
DeepSeek-R1-0528-Qwen3-8B-Q4_K_M.gguf · 5.03 GB · GGUF
Checked. Ready to download.
License: MIT
This check proves the file arrived unchanged. Not that the model is safe.
All files for this model (2)
LFM2.5 350M
LiquidAI · Text & chat · 229.3 MB · 1 file
LFM2.5-350M-Q4_K_M.gguf · 229.3 MB · GGUF
Checked. Ready to download.
No license stated
This check proves the file arrived unchanged. Not that the model is safe.
Qween3 4B thinking finetune
pramodlohra · Text & chat · 2.5 GB · 1 file
qwen3-4b-thinking-2507.Q4_K_M.gguf · 2.5 GB · GGUF
Checked. Ready to download.
No license stated
This check proves the file arrived unchanged. Not that the model is safe.
DeepSeek R1 Distill Qwen 1.5B
unsloth · Text & chat · 9.65 GB · 9 files
DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M.gguf · 1.12 GB · GGUF
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
All files for this model (9)
Qwen3 4B DFlash
AtomicChat · Text & chat · 577 MB · 1 file
Open model page
All files for this model (1)
Qwen3-4B-DFlash.Q8_0.gguf · 577 MB · GGUF
Checked. Ready to download.
License: MIT
This check proves the file arrived unchanged. Not that the model is safe.
Qwen3.5 4B DFlash
AtomicChat · Text & chat · 685.1 MB · 1 file
Open model page
All files for this model (1)
Qwen3.5-4B-DFlash.Q8_0.gguf · 685.1 MB · GGUF
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
Qwen2 7B Instruct
Qwen · Text & chat · 4.68 GB · 1 file
qwen2-7b-instruct-q4_k_m.gguf · 4.68 GB · GGUF
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
Qwen3 0.6B unsloth bnb 4bit
unsloth · Text & chat · 592.1 MB · 11 files
model.safetensors · 576.2 MB · Safetensors
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
All files for this model (11)
generation_config.json · 237 bytes
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
special_tokens_map.json · 614 bytes
Checked. Ready to download.
License: Apache 2.0
This check proves the file arrived unchanged. Not that the model is safe.
- See all 11 files on the model page
gemma 3 270m it
unsloth · Text & chat · 253.1 MB · 1 file
gemma-3-270m-it-Q4_K_M.gguf · 253.1 MB · GGUF
Checked. Ready to download.
License: Gemma Terms of Use
This check proves the file arrived unchanged. Not that the model is safe.
Phi 3.5 mini instruct
bartowski · Code · 2.39 GB · 1 file
Phi-3.5-mini-instruct-Q4_K_M.gguf · 2.39 GB · GGUF
Checked. Ready to download.
License: MIT
This check proves the file arrived unchanged. Not that the model is safe.
These files are for a computer. Phones can’t run them. Downloads open with a program like LM Studio, Ollama or llama.cpp.