Skip to main content

AI models that run on this device.

Two small chat models run in a computer’s browser here; every other model is a file you download.

microsoft

Phi-3.5-mini-instruct-onnx

Try browser chat with a small demo model (a separate model; device support is checked before loading).

microsoft/Phi-3.5-mini-instruct-onnx
Model details
text generationLicense: mitSHA-256 recorded for 15 of 22 filesONNX

Content controls: not assessed.

The catalog lists this model for having conversations. Catalog sources: license, tags, task.

15 hosted of 22 listed

Hashes recorded. Date not recorded.

FileSizeSHA-256SourceDownload
Weights
cpu_and_mobile/cpu-int4-awq-block-128-acc-level-4/phi-3.5-mini-instruct-cpu-int4-awq-block-128-acc-level-4.onnx Default52.2 MB
c4f05e6e…a10225fdc4f05e6ef52f2588df181e566afbf5e8eeba097fece2fc8246770473a10225fd
HostedDownload
gpu/gpu-int4-awq-block-128/model.onnx26.2 MB
c022f639…c0807ee7c022f639a6db4f0da6308e2f578fc698ac59c19a1976daee77783845c0807ee7
HostedDownload
Tokenizer & config
config.json3.45 KB
224de4f6…b5804974224de4f6a15b9d2a89695ec04b7f7ab2dd93a008a506979925e5a88cb5804974
HostedDownload
cpu_and_mobile/cpu-int4-awq-block-128-acc-level-4/config.json3.45 KB
224de4f6…b5804974224de4f6a15b9d2a89695ec04b7f7ab2dd93a008a506979925e5a88cb5804974
HostedDownload
cpu_and_mobile/cpu-int4-awq-block-128-acc-level-4/genai_config.json1.58 KB
d1036a44…b626f580d1036a44e904c816c864931b961483eccf18e985dbd6797eecb33e01b626f580
HostedDownload
cpu_and_mobile/cpu-int4-awq-block-128-acc-level-4/tokenizer.json1.84 MB
d0f067e1…0d474db7d0f067e1e15cd0a36ebef3668024882cb67a80b86fb4b7b4b128481f0d474db7
HostedDownload
cpu_and_mobile/cpu-int4-awq-block-128-acc-level-4/tokenizer_config.json3.36 KB
a12badd3…24f5f222a12badd3fb56adb29bc7cfe03cf6fa7e3e19dd3d7602b85ce6ed63d424f5f222
HostedDownload
gpu/gpu-int4-awq-block-128/chat_template.jinja430 bytes
78d976a4…89982a9078d976a442bcde2f0be15aafbb8e3050e1104f86732266f68403251b89982a90
HostedDownload
gpu/gpu-int4-awq-block-128/config.json3.45 KB
224de4f6…b5804974224de4f6a15b9d2a89695ec04b7f7ab2dd93a008a506979925e5a88cb5804974
HostedDownload
gpu/gpu-int4-awq-block-128/genai_config.json1.53 KB
4c54a6aa…b8662c1f4c54a6aa89532decf72fce0dae51b770a001d41bc32c31f5a39ba6f7b8662c1f
HostedDownload
gpu/gpu-int4-awq-block-128/tokenizer.json3.62 MB
3cb815b9…393006473cb815b904d82b82b25dcd90edd00e71a5ee5443472ad611bcb84f1339300647
HostedDownload
gpu/gpu-int4-awq-block-128/tokenizer_config.json2.93 KB
78f1699f…9738f13c78f1699f672ba5c8c958fa9f69040560a0310967db88fcba80746d299738f13c
HostedDownload
cpu_and_mobile/cpu-int4-awq-block-128-acc-level-4/special_tokens_map.json569 bytes
474d6996…02313c34474d699677e264edd3851559548cbbb61801ad8da6b249c81455007602313c34
HostedDownload
gpu/gpu-int4-awq-block-128/special_tokens_map.json569 bytes
474d6996…02313c34474d699677e264edd3851559548cbbb61801ad8da6b249c81455007602313c34
HostedDownload
configuration_phi3.py0 bytes—Upstream onlyFile metadata
cpu_and_mobile/cpu-int4-awq-block-128-acc-level-4/configuration_phi3.py0 bytes—Upstream onlyFile metadata
cpu_and_mobile/cpu-int4-awq-block-128-acc-level-4/phi-3.5-mini-instruct-cpu-int4-awq-block-128-acc-level-4.onnx.data0 bytes—Upstream onlyFile metadata
gpu/gpu-int4-awq-block-128/configuration_phi3.py0 bytes—Upstream onlyFile metadata
gpu/gpu-int4-awq-block-128/model.onnx.data0 bytes—Upstream onlyFile metadata
Docs
README.md12.2 KB
f0376b37…62dff374f0376b376200ad6fb2f6e7c7f9ef5546c1b530b599707779e1db84eb62dff374
HostedDownload
.gitattributes0 bytes—Upstream onlyFile metadata
LICENSE0 bytes—Upstream onlyFile metadata

Check a download

In the folder where you saved phi-3.5-mini-instruct-cpu-int4-awq-block-128-acc-level-4.onnx, run:

macOS
shasum -a 256 -- 'phi-3.5-mini-instruct-cpu-int4-awq-block-128-acc-level-4.onnx'
Linux
sha256sum -- 'phi-3.5-mini-instruct-cpu-int4-awq-block-128-acc-level-4.onnx'
Windows
Get-FileHash -LiteralPath 'phi-3.5-mini-instruct-cpu-int4-awq-block-128-acc-level-4.onnx' -Algorithm SHA256

Compare the result with the recorded SHA-256.