On this page

Open your download

Open a downloaded GGUF in LM Studio, Ollama or llama.cpp. Developer steps for safetensors and ONNX.

Next: open it

model.onnx

  1. For developers

    This file is for developers. Load it with onnxruntime, keeping any .onnx_data file beside it.

Check it's the right file

This check proves the file arrived unchanged. Not that the model is safe.

Or check it in a terminal · SHA-256
shasum -a 256 ~/Downloads/'model.onnx'

Compare with the recorded SHA-256: ee98aa9903134b586986103601652e734249e9f5fb996d48dc73a3d4689f29ad

Keep these steps for later

GGUF

Choose a GGUF file to see its app steps.

Safetensors

This file is for developers. Load the model folder with transformers.