Skip to main content

AI models that run on this device.

Two small chat models run in a computer’s browser here; every other model is a file you download.

mlabonne

NeuralQuant-9B

mlabonne/NeuralQuant-9B
text generationLicense: apache-2.0Hashes recordedsafetensors

Content controls: not assessed.

Model from Hugging Face for text generation: mlabonne/NeuralQuant-9B · transformers

What's included

7 hosted of 9 listed

Weights
Tokenizer & config
README, LICENSE & .gitattributes

About this model

External Hugging Face catalog record for mlabonne/NeuralQuant-9B. Task: text generation. Library: transformers. Popularity signal at import: 101 downloads and 0 likes.

Quick facts

Parameters
9B
Hosted here
7 hosted of 9 listed
Full repo upstream
18 GB
Format
safetensors
Downloads on Hugging Face
90
File hashes
Hashes recorded. Date not recorded.

License & source

License: apache-2.0

Check the license text and keep the required notices when you use or share the files.

Upstream source →

See the JSON record →

Task
text generation
Hosted here
at least 7 listed files; full count and size unknown
Full repo upstream
18 GB
Parameters
9B
Files
7 hosted of 9 listed
Added to Hugging Bay
Updated at source

FAQ

What is this model?

mlabonne/NeuralQuant-9B is an open-weights language model for text generation published by mlabonne, added to Hugging Bay Jun 30, 2026. Model from Hugging Face for text generation: mlabonne/NeuralQuant-9B · transformers

Can I use it commercially?

It is released under the apache-2.0 license. Commercial use is allowed. Permissive open license: commercial use, modification, and redistribution are permitted.

How big is it?

mlabonne/NeuralQuant-9B has 9B parameters. Hosted here: at least 7 listed files; full count and size unknown. Full repo upstream: 18 GB.

What can I download here?

Hosted here: at least 7 listed files; full count and size unknown. Full repo upstream: 18 GB. The original release is at https://huggingface.co/mlabonne/NeuralQuant-9B.

File checks and computer fit
File pattern scans

Automated file-pattern scans flagged nothing; not a safety guarantee. 7 hosted files carry a published SHA-256 you can re-hash. The machine-readable verdict is at /api/artifacts/hf-model-mlabonne-neuralquant-9b/safety on Hugging Bay.

Will mlabonne/NeuralQuant-9B run on my computer?

We can’t check the fit; we don’t know your machine. We don’t have your machine’s specs, so no check ran and no verdict is shown. Answer two quick questions and we’ll estimate, from the memory you tell us, whether it fits your machine. Or skip it; you can still download; fit isn’t checked.

Other versions of this model

1 repack listed on Hugging Face that name this model as their base (from each publisher card). This does not mean the files match the original weights.

Similar hosted models

Explore hosted models