Skip to main content

AI models that run on this device.

Two small chat models run in a computer’s browser here; every other model is a file you download.

bartowski

CodeLlama-7B-KStack-GGUF

Try browser chat with a small demo model (a separate model; device support is checked before loading).

bartowski/CodeLlama-7B-KStack-GGUF
Model details
text generationLicense: apache-2.0SHA-256 recorded for 24 of 26 filesGGUF

Content controls: not assessed.

The catalog lists this model for working with code. Catalog sources: license, cardMetadata.license, tags, task, cardMetadata.pipelineTag.

1 hosted of 26 listed

Hashes recorded. Date not recorded.

FileSizeSHA-256SourceDownload
Weights
CodeLlama-7B-KStack-Q4_K_M.gguf Default4.08 GB
31941298…23816c763194129898305f0fa2fc24a1db1cf0ec9c4459ce2531a522d204220123816c76
HostedDownload
CodeLlama-7B-KStack-IQ1_M.gguf1.65 GB
e2042c36…23ff7cf4e2042c361cd478b52b122533460bdee1f99fe94c952e7384d855797923ff7cf4
Upstream onlyFile metadata
CodeLlama-7B-KStack-IQ1_S.gguf1.53 GB
bdd159f1…4cfa6328bdd159f142a9c8cb335b994bcbdda1b95d275c7a6ce9ed1a554f94824cfa6328
Upstream onlyFile metadata
CodeLlama-7B-KStack-IQ2_M.gguf2.36 GB
bd2d7523…e2228457bd2d7523138e6e838c98cd1fac048a64a1080bc2c38ce4386e5ea834e2228457
Upstream onlyFile metadata
CodeLlama-7B-KStack-IQ2_S.gguf2.2 GB
9f6b591c…179c6d4e9f6b591c18d154199a67205f61839e42352b2ce5d219be598fb4c01f179c6d4e
Upstream onlyFile metadata
CodeLlama-7B-KStack-IQ2_XS.gguf2.03 GB
83e9d0ad…8e94069983e9d0ad3eff81875156153cfe82dc9a3f2a18bccca41f8af55dce768e940699
Upstream onlyFile metadata
CodeLlama-7B-KStack-IQ2_XXS.gguf1.86 GB
792945d8…ca147d6d792945d8f78e9bc0e7da4db84b825b599b982465545d860703fc55edca147d6d
Upstream onlyFile metadata
CodeLlama-7B-KStack-IQ3_M.gguf3.11 GB
23ec8eb9…eda9ce6223ec8eb91a64061b2f6fec876f45b3694a1710258e2df0993c67f4dfeda9ce62
Upstream onlyFile metadata
CodeLlama-7B-KStack-IQ3_S.gguf2.95 GB
35f946c1…cb008da635f946c12875311e6728cf8b1d851cc5db8d1e79321685310ffa88b0cb008da6
Upstream onlyFile metadata
CodeLlama-7B-KStack-IQ3_XS.gguf2.8 GB
c1a519e2…c9083af2c1a519e2e574d274542ad32e038e13d1bcb86da7a96664a221d1db23c9083af2
Upstream onlyFile metadata
CodeLlama-7B-KStack-IQ3_XXS.gguf2.59 GB
17ce0873…c9b465c917ce08730a4402cae4703d72c228c9b9fbbefc961e9de4b57c44a682c9b465c9
Upstream onlyFile metadata
CodeLlama-7B-KStack-IQ4_NL.gguf3.83 GB
be2bbe85…0795ec21be2bbe85739b40fc00736887bc5871d36d995babeac58e15f69b48830795ec21
Upstream onlyFile metadata
CodeLlama-7B-KStack-IQ4_XS.gguf3.62 GB
90aa0ee6…8675916c90aa0ee6a09a28fa230c3087040f6919b1f23ef8f402d72c71e263e98675916c
Upstream onlyFile metadata
CodeLlama-7B-KStack-Q2_K.gguf2.53 GB
b2fe75a1…36856d47b2fe75a115e6a0a17aa0642deed9cc4936cc5cb519b1e2e0b1ad879a36856d47
Upstream onlyFile metadata
CodeLlama-7B-KStack-Q3_K_L.gguf3.6 GB
a7c397e8…57e451d1a7c397e8c4d854ae751b42dfc0f1f469a7acaa01dadc391590df929757e451d1
Upstream onlyFile metadata
CodeLlama-7B-KStack-Q3_K_M.gguf3.3 GB
5762aefe…d14ebda65762aefeff8da1f96af3c458c917840549e195ba5e6ff8fe2140b3c4d14ebda6
Upstream onlyFile metadata
CodeLlama-7B-KStack-Q3_K_S.gguf2.95 GB
04cbefbc…b98489cc04cbefbc842112450d3048dc87ff1dece91cbc486d83974487711d59b98489cc
Upstream onlyFile metadata
CodeLlama-7B-KStack-Q4_K_S.gguf3.86 GB
ff1e0ae1…4ed5b39fff1e0ae1bd965199258a8310a806c2b6d7f0c943bf65274b7980d0ab4ed5b39f
Upstream onlyFile metadata
CodeLlama-7B-KStack-Q5_K_M.gguf4.78 GB
1d455af5…ff7390a41d455af5d796f950a92631edd1358d756b19f8ec02c188b610c4bc24ff7390a4
Upstream onlyFile metadata
CodeLlama-7B-KStack-Q5_K_S.gguf4.65 GB
75198a3c…eb37e8db75198a3c84c9b2df501928045defcb8154d0b00f52b7cd29a9bc9022eb37e8db
Upstream onlyFile metadata
CodeLlama-7B-KStack-Q6_K.gguf5.53 GB
e72be652…bf5eb0dce72be6528b06c23af755e71c3f7511d171929b7c182f008ada9253c8bf5eb0dc
Upstream onlyFile metadata
CodeLlama-7B-KStack-Q8_0.gguf7.16 GB
4ea2ad8f…cdcf6f804ea2ad8ffc89f05e4d8d1405b1cca9e07c5ffd16f5f5a280f1363cbfcdcf6f80
Upstream onlyFile metadata
CodeLlama-7B-KStack-f32.gguf27 GB
a3de698d…7dadc7e2a3de698d6005d5e367e35c9c924b1a6a942999cd23cba9544d284c117dadc7e2
Upstream onlyFile metadata
Tokenizer & config
CodeLlama-7B-KStack.imatrix4.56 MB
5b16fa03…8ca2f2be5b16fa032d96349725b22e3f0b1ee07039f15c1cf5ff2b82ff8e0d568ca2f2be
Upstream onlyFile metadata
Docs
.gitattributes3.13 KB—Upstream onlyFile metadata
README.md8.4 KB—Upstream onlyFile metadata

Check a download

In the folder where you saved CodeLlama-7B-KStack-Q4_K_M.gguf, run:

macOS
shasum -a 256 -- 'CodeLlama-7B-KStack-Q4_K_M.gguf'
Linux
sha256sum -- 'CodeLlama-7B-KStack-Q4_K_M.gguf'
Windows
Get-FileHash -LiteralPath 'CodeLlama-7B-KStack-Q4_K_M.gguf' -Algorithm SHA256

Compare the result with the recorded SHA-256.