interestinglsy/swiftllm
interestinglsy/swiftllm: A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of vLLM). License: apache-2.0. Hugging Bay hosted release. Scan: pending.
- License
- apache-2.0
- Scan status
- pending
- Hosting status
- external
- Upstream
- interestingLSY/swiftLLM
Open interactive artifact page