Skip to main content

AI models that run on this device.

Two small chat models run in a computer’s browser here; every other model is a file you download.

Build a local agent

Source templates for TypeScript and Python. Local tasks need an installed runtime and a model with current run support.

Agent starter kit

Download source templates

The kit finds model files for your memory budget and compares downloads with their recorded SHA-256.

Triage sample emails or answer a question from a local document. Use Ollama for the default setup, or follow the README for llama.cpp.

Install and start Ollama first. Use Node.js 22.12 or later for TypeScript, or Python 3.10 or later for Python. Download time depends on the model and your connection.

A task needs a model with current run support. The search may return none.

Start from the download

unzip hugging-bay-starter.zip -d hugging-bay-starter
cd hugging-bay-starter

TypeScript

sh examples/agent-starter/setup.sh typescript

Python

sh examples/agent-starter/setup.sh python

Model downloads use the network; tasks run on your machine.

The download contains source templates and sample data. Install a runtime separately for tasks.

API docs · MCP docs