michael-a-kuykendall/shimmy
michael-a-kuykendall/shimmy: ⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary. License: apache-2.0. Hugging Bay hosted release. Scan: pending.
- License
- apache-2.0
- Scan status
- pending
- Hosting status
- external
- Upstream
- Michael-A-Kuykendall/shimmy
Open interactive artifact page