No matches. Try a model format, tool name or error.
On this page
Open your download
Open a downloaded GGUF in LM Studio, Ollama or llama.cpp. Developer steps for safetensors and ONNX.
Next: open it
model_int8qdt.onnx
For developers
This file is for developers. Load it with onnxruntime, keeping any .onnx_data file beside it.
Check it's the right file
This check proves the file arrived unchanged. Not that the model is safe.
Or check it in a terminal · SHA-256
shasum -a 256 ~/Downloads/'model_int8qdt.onnx'
Compare with the recorded SHA-256: f08c1818b0a485208862f3b2346d0a3592ee1de5a4e08376d01ce548ecc5dab6
Keep these steps for later
GGUF
Choose a GGUF file to see its app steps.
Safetensors
This file is for developers. Load the model folder with transformers.