TheBloke/NeuralQuant-9B-GGUF file inventory
Browse hosted and upstream file records for TheBloke/NeuralQuant-9B-GGUF. Check its Run page for complete-kit status.
- Hosting
- hosted
- Hosted files
- 1
- Tool
- any
Run status: unknown. These file records do not make a complete run kit.
- .gitattributes
- README.md
- config.json
- neuralquant-9b.Q2_K.gguf - sha256
113917deeaf5f7e7995044213f08c2378e2022383fb63f2dfc5b6c816644e10f - neuralquant-9b.Q3_K_L.gguf - sha256
66b81e0c3ec0fb73ac276dc111d359bae1de1749e095c7f778497aa18a475e32 - neuralquant-9b.Q3_K_M.gguf - sha256
1d1eeefc3b5d3bd8ea00140f623b2dec7ea9f93285cd16dd4a897e196d16494b - neuralquant-9b.Q3_K_S.gguf - sha256
d1d2780d5c85f3cbf33320e0c23195d56bccb3cccc746ea379ed8958e134bfb5 - neuralquant-9b.Q4_0.gguf - sha256
6330ba05a32bbf8d1d11c04f2ff5197740b000137cb8c4472fac8aa2cc26e944 - neuralquant-9b.Q4_K_M.gguf - sha256
33e506687556c9fa8f7ab86038cc11e0edf52ee8865cb5693c58e32435e51b25- download this file - neuralquant-9b.Q4_K_S.gguf - sha256
cfecfb1f736f7d1fd1a87465f0ae5d85e9f4a8f6b8aff558148075ab68e41b5a - neuralquant-9b.Q5_0.gguf - sha256
0f343623eb3d99546075f8d5930ffd86795607d33963903318ecd86dcd83b56b - neuralquant-9b.Q5_K_M.gguf - sha256
7d4e6feff0956593bba8ad112720cc64b6b77a5271d1c9896bd0c67682da4ec2 - neuralquant-9b.Q5_K_S.gguf - sha256
62ea8ec08bc05cb84b900a3a92914158aaef4ed2762a129a46e33bc610a09c7a - neuralquant-9b.Q6_K.gguf - sha256
1952a4f80fba430c608097b762ddde9562f978ce8942092bc1d1165793af00f0 - neuralquant-9b.Q8_0.gguf - sha256
14cb91ebef160f20d57cd4d9cbe5f1990314ab23fbc69755d2f51c8e10d4a82c