Skip to main content

AI models that run on this device.

Two small chat models run in a computer’s browser here; every other model is a file you download.

Download Hugging Face files

Choose a file hosted on Hugging Bay and copy its download command.

Pick a hosted model

HF_ENDPOINT=https://hf.huggingbay.xyz hf download Qwen/Qwen2.5-0.5B-Instruct-GGUF qwen2.5-0.5b-instruct-q4_k_m.gguf

Download the file

Install the Hugging Face CLI first. With a file selected, run its command in your terminal. The client prints the saved path and may reuse a file already in your local cache.

Make it permanent

Add one line to your shell profile, then open a new terminal.

export HF_ENDPOINT=https://hf.huggingbay.xyz

To switch back to Hugging Face, remove that line or run unset HF_ENDPOINT (PowerShell: Remove-Item Env:HF_ENDPOINT), then open a new terminal.

Good to know
  • Only models hosted on Hugging Bay work here. Others return not found. Unset HF_ENDPOINT and run again to use Hugging Face.
  • Transformers needs every required file in a model, including config, tokenizer, and weights.
  • Older installs may use huggingface-cli instead of hf download.
  • A file listing here does not prove your tool can load or run the model.
  • Public metadata can lag privacy changes by about 5 minutes; every download is checked again.