Skip to main content

AI models that run on this device.

Two small chat models run in a computer’s browser here; every other model is a file you download.

mlabonne

NeuralQuant-9B

mlabonne/NeuralQuant-9B
Model details
text generationLicense: apache-2.0SHA-256 recorded for 7 of 9 filessafetensors

Content controls: not assessed.

Listed for generating text; for developers building text generation tools. Catalog sources: license, cardMetadata.license, task, cardMetadata.pipelineTag.

7 hosted of 9 listed

Hashes recorded. Date not recorded.

FileSizeSHA-256SourceDownload
Weights
model-00001-of-00002.safetensors9.94 GB
9f495844…26b654169f49584494c94f0bfa343b837276fa7cbbb9ae295cc52834d5ade2ce26b65416
HostedDownload
model-00002-of-00002.safetensors8.03 GB
b6a05288…e23666b3b6a05288133b038b14b994705728575bfdf9cd6a016c0f2ff88d82f5e23666b3
HostedDownload
Tokenizer & config
config.json642 bytes
738d6100…9f42f1e6738d6100306d0a7d968e7f4e2db042ec33a508ab7301e48827e01ad39f42f1e6
HostedDownload
model.safetensors.index.json28.4 KB
43811012…aface0a0438110121425efcc9b1a353805cebfc5aa0c32f6700b31eb27ce6e65aface0a0
HostedDownload
special_tokens_map.json624 bytes
35e7e566…62abdc9035e7e566342a030b1c035f811204838d135e2aa5bac84de2109b660862abdc90
HostedDownload
tokenizer_config.json1.01 KB
efc887db…6adfaaffefc887db84309c3cb3c3cf21e17b89b0638f82bf5690451e78f5d4856adfaaff
HostedDownload
tokenizer.json1.8 MB
fc4f0bd7…882f25fcfc4f0bd70b3709312d9d1d9e5ba674794b6bc5abc17429897a540f93882f25fc
HostedDownload
Docs
.gitattributes1.52 KB—Upstream onlyFile metadata
README.md603 bytes—Upstream onlyFile metadata

Check a download

In the folder where you saved config.json, run:

macOS
shasum -a 256 -- 'config.json'
Linux
sha256sum -- 'config.json'
Windows
Get-FileHash -LiteralPath 'config.json' -Algorithm SHA256

Compare the result with the recorded SHA-256.

Similar hosted models

Explore hosted models