Skip to main content

AI models that run on this device.

Two small chat models run in a computer’s browser here; every other model is a file you download.

bartowski

CodeLlama-7B-KStack-clean-GGUF

Try browser chat with a small demo model (a separate model; device support is checked before loading).

bartowski/CodeLlama-7B-KStack-clean-GGUF
Model details
text generationLicense: apache-2.0SHA-256 recorded for 24 of 26 filesGGUF

Content controls: not assessed.

The catalog lists this model for working with code. Catalog sources: license, cardMetadata.license, baseModel, tags, task, cardMetadata.pipelineTag.

1 hosted of 26 listed

Hashes recorded. Date not recorded.

FileSizeSHA-256SourceDownload
Weights
CodeLlama-7B-KStack-clean-Q4_K_M.gguf Default4.08 GB
02b84b0e…117975f802b84b0eb68cdadcfe6d4ade0e415b6cd8cc7a87ab46f3a0acf58db2117975f8
HostedDownload
CodeLlama-7B-KStack-clean-IQ1_M.gguf1.65 GB
8b65bd6f…7df860f68b65bd6f89a1d3318eacb3602c0907849a74de3b07d79a54cae1edb07df860f6
Upstream onlyFile metadata
CodeLlama-7B-KStack-clean-IQ1_S.gguf1.53 GB
6328c750…ec5f67b66328c750851e82bec257a2e1edc4876300861649c62b819e6b9bdc8bec5f67b6
Upstream onlyFile metadata
CodeLlama-7B-KStack-clean-IQ2_M.gguf2.36 GB
b99b711e…e28f05a2b99b711ec37b92e2477eb50101bfce8833093b093ccfad9e1f077ec1e28f05a2
Upstream onlyFile metadata
CodeLlama-7B-KStack-clean-IQ2_S.gguf2.2 GB
90ff6367…1bce369690ff63677253456dc8b92cd2b6ac52d6860038cf51dce63c25f6d3431bce3696
Upstream onlyFile metadata
CodeLlama-7B-KStack-clean-IQ2_XS.gguf2.03 GB
c2c50923…a891f619c2c5092329c5ed8eb63356d485d1b89ce1588c79325ae98c689b9ba1a891f619
Upstream onlyFile metadata
CodeLlama-7B-KStack-clean-IQ2_XXS.gguf1.86 GB
80c5ff62…31e6943280c5ff622bbd3f7832a1a759c43c971b03cf88071b98ea39f4fbb82731e69432
Upstream onlyFile metadata
CodeLlama-7B-KStack-clean-IQ3_M.gguf3.11 GB
ab2ee082…86ec58e7ab2ee0825f6ad7f897d294cbc995928f3036302c3fe6e36375da276e86ec58e7
Upstream onlyFile metadata
CodeLlama-7B-KStack-clean-IQ3_S.gguf2.95 GB
c3545244…5f911dd1c3545244ccd766c8e21aa1d9775f11b748480c20d008c17b2dc992565f911dd1
Upstream onlyFile metadata
CodeLlama-7B-KStack-clean-IQ3_XS.gguf2.8 GB
385fc116…e557eda4385fc1164fadc75294ae5f2bd9afa4a3ed0bb20192e8b725047f748ae557eda4
Upstream onlyFile metadata
CodeLlama-7B-KStack-clean-IQ3_XXS.gguf2.59 GB
ab5d7bd7…95e1267fab5d7bd736d36eb36c1f7debc5093a3fa21af6aa6e210b8e77900af495e1267f
Upstream onlyFile metadata
CodeLlama-7B-KStack-clean-IQ4_NL.gguf3.83 GB
fe3dcc4e…bf9c1f8ffe3dcc4ef77ff3e2aa30d395102c204708601604e91208c52c5fc739bf9c1f8f
Upstream onlyFile metadata
CodeLlama-7B-KStack-clean-IQ4_XS.gguf3.62 GB
78c6df8d…0959c55e78c6df8d053258f105b2a4bbf97f800c528bc5afac3b6e60da5ea1e30959c55e
Upstream onlyFile metadata
CodeLlama-7B-KStack-clean-Q2_K.gguf2.53 GB
6e9e5108…d8bbf0b36e9e51088b03a4fa9400aee153db6b07d00ba3d402a0119203b995ddd8bbf0b3
Upstream onlyFile metadata
CodeLlama-7B-KStack-clean-Q3_K_L.gguf3.6 GB
e31e97ff…ad0d5cdee31e97fffa939d0332e2c3fc152b821c96060339282ee449acfa0748ad0d5cde
Upstream onlyFile metadata
CodeLlama-7B-KStack-clean-Q3_K_M.gguf3.3 GB
6cdf0594…a1afc28e6cdf05947056cfc55f9dad8cd2c7fecf8be4a963ca296d126b93260ba1afc28e
Upstream onlyFile metadata
CodeLlama-7B-KStack-clean-Q3_K_S.gguf2.95 GB
cb8f888a…022af6f1cb8f888a59b543b081689bff11e68a1936d471afb1b919bea737a91c022af6f1
Upstream onlyFile metadata
CodeLlama-7B-KStack-clean-Q4_K_S.gguf3.86 GB
78da25a2…8121371678da25a254eb95146ad54cc3b3e434d5a0776d73eaa247312516aada81213716
Upstream onlyFile metadata
CodeLlama-7B-KStack-clean-Q5_K_M.gguf4.78 GB
9ed985d5…1ca601da9ed985d56b3e8af1f48ea459f57758615e05adfeffb026fa0d32d8c31ca601da
Upstream onlyFile metadata
CodeLlama-7B-KStack-clean-Q5_K_S.gguf4.65 GB
ef643663…91c3ea81ef643663f1459ae9afd403eec6b62968fa42b37e305cf66cda36dca391c3ea81
Upstream onlyFile metadata
CodeLlama-7B-KStack-clean-Q6_K.gguf5.53 GB
6fec8d61…6d3310696fec8d61add2c470371d63f9c202e5ad58cc1ab69dd684fb071df95f6d331069
Upstream onlyFile metadata
CodeLlama-7B-KStack-clean-Q8_0.gguf7.16 GB
9f61c875…936da03f9f61c8754ce895e8e381f4b67994b446d0e5d8f13eeeb1ea7f21eba8936da03f
Upstream onlyFile metadata
CodeLlama-7B-KStack-clean-f32.gguf27 GB
b9916f76…ede9b6deb9916f768d340f136212df1fc485f47e1f7435b40003619440e81d58ede9b6de
Upstream onlyFile metadata
Tokenizer & config
CodeLlama-7B-KStack-clean.imatrix4.56 MB
bdbe82f8…26d59ee3bdbe82f8b16c2817e73375ce8e396b8751248d14c201b3e3be995cd226d59ee3
Upstream onlyFile metadata
Docs
.gitattributes3.28 KB—Upstream onlyFile metadata
README.md8.87 KB—Upstream onlyFile metadata

Check a download

In the folder where you saved CodeLlama-7B-KStack-clean-Q4_K_M.gguf, run:

macOS
shasum -a 256 -- 'CodeLlama-7B-KStack-clean-Q4_K_M.gguf'
Linux
sha256sum -- 'CodeLlama-7B-KStack-clean-Q4_K_M.gguf'
Windows
Get-FileHash -LiteralPath 'CodeLlama-7B-KStack-clean-Q4_K_M.gguf' -Algorithm SHA256

Compare the result with the recorded SHA-256.