intel/auto-round

Name: intel/auto-round
Creator: intel
License: apache-2.0
Keywords: dataset, dataset, code, transformers, github, source-code, python, github-import, external-catalog, github, code, tool, diffusers, gguf, int4, llms, mxfp4, nvfp4, omni, quantization, rounding, sglang, transformers, vllm, vlms

intel/auto-round: A SOTA quantization algorithm for high-accuracy low-bit LLM inference, seamlessly optimized for CPU/XPU/CUDA, with multi-datatype support and full compatibility with vLLM, SGLang, and Transformers. License: apache-2.0. Hugging Bay hosted rele

License: apache-2.0
Scan status: pending
Hosting status: external
Upstream: intel/auto-round

Open interactive artifact page