NeuralQuant-9B-GGUF model info | Hugging Bay

Q: What is this model?

TheBloke/NeuralQuant-9B-GGUF is an open-weights language model for general published by TheBloke, added to Hugging Bay Jun 30, 2026. Model from Hugging Face for llm: TheBloke/NeuralQuant-9B-GGUF · transformers

Q: Can I use it commercially?

It is released under the apache-2.0 license. Commercial use is allowed. Permissive open license: commercial use, modification, and redistribution are permitted.

Q: How big is it?

TheBloke/NeuralQuant-9B-GGUF has 9B parameters. Hosted here: 1 file, 5.42 GB. Full repo upstream: 68.1 GB. The recommended download, neuralquant-9b.Q4_K_M.gguf (Q4_K_M), is 5.42 GB.

Q: What can I download here?

Hosted here: 1 file, 5.42 GB. Full repo upstream: 68.1 GB. The original release is at https://huggingface.co/TheBloke/NeuralQuant-9B-GGUF.

Q: File pattern scans

Automated file-pattern scans flagged nothing; not a safety guarantee. 1 hosted file carries a published SHA-256 you can re-hash. The machine-readable verdict is at /api/artifacts/hf-model-thebloke-neuralquant-9b-gguf/safety on Hugging Bay.

Q: Will TheBloke/NeuralQuant-9B-GGUF run on my computer?

We can’t check the fit; we don’t know your machine. We don’t have your machine’s specs, so no check ran and no verdict is shown. Answer two quick questions and we’ll estimate, from the memory you tell us, whether it fits your machine. Or skip it; you can still download; fit isn’t checked.

TheBloke

NeuralQuant 9B

Text generation

This receipt records checks for this exact file; it does not prove safety or that it will run on your device. Read the receipt

Model details

generalLicense: apache-2.0SHA-256 recorded for 12 of 15 filesGGUF

Can I run it?View as JSON →

Quick answer: compatibility and sources

Can I run NeuralQuant-9B-GGUF on my computer?

It depends on your memory, processor, file format and runtime. A download is not confirmed by the current file evidence; inspect the file record before trying it. A file-size fit is an estimate, not a successful run or speed promise. Read the license before use.

NeuralQuant-9B-GGUF is an open-weights language model for general. Model weights are learned parameters; a runtime loads them. A hosted file is an individual file Hugging Bay can serve. SHA-256 identifies exact file bytes. The availability date above applies to this file record, not the upstream metadata update date.

As of the recorded file availability check on 2026-10-29.

Recorded SHA-256 for neuralquant-9b.Q4_K_M.gguf: 33e506687556c9fa8f7ab86038cc11e0edf52ee8865cb5693c58e32435e51b25. Exact file evidence · Machine-readable source facts · Run evidence and any recorded receipts. A checksum fingerprints only the named file bytes; it does not prove safety, quality, a complete multi-file selection or a successful run.

Updated 2026-10-21 · Page-copy source revision 8871bab84e1cf80aea1686a944ec335078a6c036 · Source files: apps/web/lib/model-page-template.mjs, apps/web/lib/model-page-v3.mjs, apps/web/lib/aeo-page.mjs · Full revision record

Model metadata: As of 2026-09-03 at the model source. Popularity counters are source-reported, not measured by Hugging Bay. Availability checked 2026-10-29.

Key facts

Catalog record: Summarizes upstream metadata; it is not itself a download or run receipt.
File evidence: Lists exact filenames, availability and any recorded SHA-256 for individual files.
Run evidence: Reports measured results only when a receipt exists for named file bytes and a setup; otherwise unmeasured.
Checksum scope: SHA-256 fingerprints one file’s bytes; it does not prove safety, quality or a multi-file bundle.

Evidence you can inspect (plain text)

This page’s quick answer names the file record for hf-model-thebloke-neuralquant-9b-gguf.
Open /artifact/hf-model-thebloke-neuralquant-9b-gguf/files for this exact filenames, availability and any recorded SHA-256.
Open /evidence/artifacts/hf-model-thebloke-neuralquant-9b-gguf for run-readiness evidence tied to that record; absent receipts stay unmeasured.
Open /api/artifacts/hf-model-thebloke-neuralquant-9b-gguf/card.md for machine-readable source facts (not a runtime test).
A matching checksum on this page fingerprints only the named bytes shown in file evidence.

Unmeasured states are stated explicitly; this page does not invent run scores or compatibility guarantees.

Which date applies to which fact

File availability check: 2026-10-29
Committed page-copy sources: 2026-10-21
Upstream model metadata: Dates on artifact records when shown; not implied by page-copy revision
Run receipts: Only on /evidence pages when recorded; otherwise unmeasured

Page-copy revision (Updated line above) identifies committed text sources, not upstream model edits or test outcomes.

Requirements and source record

TheBloke/NeuralQuant-9B-GGUF

Content controls: not assessed.

The catalog does not give enough information to describe what this model is for. Catalog sources: license, cardMetadata.license, baseModel.

Download availability is being checked.

Hashes recorded. Date not recorded.

File	Size	SHA-256	Source	Download
Weights
`neuralquant-9b.Q4_K_M.gguf`	5.42 GB	`33e50668…35e51b25` `33e506687556c9fa8f7ab86038cc11e0edf52ee8865cb5693c58e32435e51b25`	Download availability is being checked.	File metadata
`neuralquant-9b.Q2_K.gguf`	3.82 GB	`113917de…6644e10f` `113917deeaf5f7e7995044213f08c2378e2022383fb63f2dfc5b6c816644e10f`	Download availability is being checked.	File metadata
`neuralquant-9b.Q3_K_L.gguf`	4.74 GB	`66b81e0c…8a475e32` `66b81e0c3ec0fb73ac276dc111d359bae1de1749e095c7f778497aa18a475e32`	Download availability is being checked.	File metadata
`neuralquant-9b.Q3_K_M.gguf`	4.35 GB	`1d1eeefc…6d16494b` `1d1eeefc3b5d3bd8ea00140f623b2dec7ea9f93285cd16dd4a897e196d16494b`	Download availability is being checked.	File metadata
`neuralquant-9b.Q3_K_S.gguf`	3.92 GB	`d1d2780d…e134bfb5` `d1d2780d5c85f3cbf33320e0c23195d56bccb3cccc746ea379ed8958e134bfb5`	Download availability is being checked.	File metadata
`neuralquant-9b.Q4_0.gguf`	5.09 GB	`6330ba05…cc26e944` `6330ba05a32bbf8d1d11c04f2ff5197740b000137cb8c4472fac8aa2cc26e944`	Download availability is being checked.	File metadata
`neuralquant-9b.Q4_K_S.gguf`	5.12 GB	`cfecfb1f…68e41b5a` `cfecfb1f736f7d1fd1a87465f0ae5d85e9f4a8f6b8aff558148075ab68e41b5a`	Download availability is being checked.	File metadata
`neuralquant-9b.Q5_0.gguf`	6.2 GB	`0f343623…cd83b56b` `0f343623eb3d99546075f8d5930ffd86795607d33963903318ecd86dcd83b56b`	Download availability is being checked.	File metadata
`neuralquant-9b.Q5_K_M.gguf`	6.37 GB	`7d4e6fef…82da4ec2` `7d4e6feff0956593bba8ad112720cc64b6b77a5271d1c9896bd0c67682da4ec2`	Download availability is being checked.	File metadata
`neuralquant-9b.Q5_K_S.gguf`	6.2 GB	`62ea8ec0…10a09c7a` `62ea8ec08bc05cb84b900a3a92914158aaef4ed2762a129a46e33bc610a09c7a`	Download availability is being checked.	File metadata
`neuralquant-9b.Q6_K.gguf`	7.37 GB	`1952a4f8…93af00f0` `1952a4f80fba430c608097b762ddde9562f978ce8942092bc1d1165793af00f0`	Download availability is being checked.	File metadata
`neuralquant-9b.Q8_0.gguf`	9.55 GB	`14cb91eb…10d4a82c` `14cb91ebef160f20d57cd4d9cbe5f1990314ab23fbc69755d2f51c8e10d4a82c`	Download availability is being checked.	File metadata
Tokenizer & config
`config.json`	31 bytes	—	Download availability is being checked.	File metadata
Docs
`.gitattributes`	2.27 KB	—	Download availability is being checked.	File metadata
`README.md`	18.5 KB	—	Download availability is being checked.	File metadata

Check a download

In the folder where you saved neuralquant-9b.Q4_K_M.gguf, run:

macOS

shasum -a 256 -- 'neuralquant-9b.Q4_K_M.gguf'

Linux

sha256sum -- 'neuralquant-9b.Q4_K_M.gguf'

Windows

Get-FileHash -LiteralPath 'neuralquant-9b.Q4_K_M.gguf' -Algorithm SHA256

Compare the result with the recorded SHA-256.