Hugging Bay Downloads | Hugging Bay

Downloads

Some files are checked and ready. The rest are still being checked.

How checking works

Downloadable. The files passed our public gates and the download button is here today. That’s all it means. Not safe, not guaranteed to run.
Checked on this Mac. The file’s fingerprint matches the published one, byte for byte. That proves it arrived unchanged. Not that the model is safe.
Running locally. This device did the work: a real first reply was produced here. Not on a server.

Two small chat models. Qwen2.5 0.5B and 1.5B. Run in a computer’s browser tab, with nothing to install. On a phone, we first check whether it can run them. Every other model is a file you download to a computer and open with a free app like LM Studio, Ollama or llama.cpp; nothing is held back, and each file is labeled with its license. 'License: unknown' simply means we couldn't confirm it. Searching and reading need no account.

‘No license’ shows rows labeled ‘License: unknown’. It is not permission to reuse the files however you want.

Density:

Checked Open Details for the file's checks and next steps.

Mistral 7BMistral-7B-Instruct-v0.3-Q4_K_M.gguf · 4.4 GB · GGUF
License: Apache 2.0
Download file
Details →
Mistral-7B-Instruct-v0.3-Q4_K_M.gguf · 4.4 GB · GGUF
License: Apache 2.0. Free to use and share, keep the credit notice
Checked
This check proves the file arrived unchanged. Not that the model is safe.
Next: open it with a free app like LM Studio, Ollama or llama.cpp. A model file doesn’t run on its own.
Open model page
Phi 3.5 MiniPhi-3.5-mini-instruct.Q4_K_M.gguf · 2.4 GB · GGUF
License: MIT
Download file
Details →
Phi-3.5-mini-instruct.Q4_K_M.gguf · 2.4 GB · GGUF
License: MIT. Free to use and share, keep the credit notice
Checked
This check proves the file arrived unchanged. Not that the model is safe.
Next: open it with a free app like LM Studio, Ollama or llama.cpp. A model file doesn’t run on its own.
Open model page
Qwen2.5 0.5Bqwen2.5-0.5b-instruct-q4_k_m.gguf · 491 MB · GGUF
License: Apache 2.0
Download file
Details →
qwen2.5-0.5b-instruct-q4_k_m.gguf · 491 MB · GGUF
License: Apache 2.0. Free to use and share, keep the credit notice
Checked
This check proves the file arrived unchanged. Not that the model is safe.
Next: open it with a free app like LM Studio, Ollama or llama.cpp. A model file doesn’t run on its own.
Open model page
Qwen3 0.6BQwen3-0.6B-Q4_K_M.gguf · 484 MB · GGUF
License: Apache 2.0
Download file
Details →
Qwen3-0.6B-Q4_K_M.gguf · 484 MB · GGUF
License: Apache 2.0. Free to use and share, keep the credit notice
Checked
This check proves the file arrived unchanged. Not that the model is safe.
Next: open it with a free app like LM Studio, Ollama or llama.cpp. A model file doesn’t run on its own.
Open model page
TinyLlama 1.1Btinyllama-1.1b-chat-v1.0.Q2_K.gguf · 483 MB · GGUF
License: Apache 2.0
Download file
Details →
tinyllama-1.1b-chat-v1.0.Q2_K.gguf · 483 MB · GGUF
License: Apache 2.0. Free to use and share, keep the credit notice
Checked
This check proves the file arrived unchanged. Not that the model is safe.
Next: open it with a free app like LM Studio, Ollama or llama.cpp. A model file doesn’t run on its own.
All files for this model (5)
- All files for this model (5)
Open model page
gte large en v1.5model.safetensors · 1.7 GB · Safetensors
License: Apache 2.0
Download file
Details →
model.safetensors · 1.7 GB · Safetensors
License: Apache 2.0. Free to use and share, keep the credit notice
Checked
This check proves the file arrived unchanged. Not that the model is safe.
All files for this model (10)
- All files for this model (10)
Open model page
gte multilingual reranker basemodel.safetensors · 612 MB · Safetensors
License: Apache 2.0
Download file
Details →
model.safetensors · 612 MB · Safetensors
License: Apache 2.0. Free to use and share, keep the credit notice
Checked
This check proves the file arrived unchanged. Not that the model is safe.
All files for this model (5)
- All files for this model (5)
Open model page
gte reranker modernbert basemodel.safetensors · 598 MB · Safetensors
License: Apache 2.0
Download file
Details →
model.safetensors · 598 MB · Safetensors
License: Apache 2.0. Free to use and share, keep the credit notice
Checked
This check proves the file arrived unchanged. Not that the model is safe.
All files for this model (5)
- All files for this model (5)
Open model page
gte base en v1.5model.safetensors · 547 MB · Safetensors
License: Apache 2.0
Download file
Details →
model.safetensors · 547 MB · Safetensors
License: Apache 2.0. Free to use and share, keep the credit notice
Checked
This check proves the file arrived unchanged. Not that the model is safe.
All files for this model (10)
- All files for this model (10)
Open model page
gte Qwen2 1.5B
License: unknown
Choose files →
Details →
All files for this model (16)
- All files for this model (16)
Open model page

These files are for a computer. Phones can’t run them. Downloads open with an app like LM Studio, Ollama or llama.cpp.

Browse all downloadable models

Open interactive downloads page