Skip to main content

AI models that run on this device.

Two small chat models run in a computer’s browser here; every other model is a file you download.

QuantFactory

CodeLlama-7b-Instruct-hf-GGUF

Try browser chat with a small demo model (a separate model; device support is checked before loading).

QuantFactory/CodeLlama-7b-Instruct-hf-GGUF
Model details
text generationLicense: unknownSHA-256 recorded for 12 of 14 filesGGUF

Content controls: not assessed.

The catalog lists this model for working with code. Catalog sources: baseModel, tags, task, cardMetadata.pipelineTag.

1 hosted of 14 listed

Hashes recorded. Date not recorded.

FileSizeSHA-256SourceDownload
Weights
CodeLlama-7b-Instruct-hf.Q4_K_M.gguf Default4.08 GB
24ceee69…b0bf93d324ceee698e690a283ce5e6c424009c15deb5b97bd12bcd852036eb2eb0bf93d3
HostedDownload
CodeLlama-7b-Instruct-hf.Q2_K.gguf2.53 GB
2a498bf0…44d13a0b2a498bf0a9e532c6a395143bdefca5ccaa0dea8fa2011afdfdc3f55944d13a0b
Upstream onlyFile metadata
CodeLlama-7b-Instruct-hf.Q3_K_L.gguf3.6 GB
7f50d8ac…1bdcfa6a7f50d8ac798906ed1d2b46ecdfdec4bba66a03e84e25abd261cc27f91bdcfa6a
Upstream onlyFile metadata
CodeLlama-7b-Instruct-hf.Q3_K_M.gguf3.3 GB
e7cc5630…28ff3b49e7cc56302152cc0d50ceaff1adf472f1edc22853708c879b9ee0b2c928ff3b49
Upstream onlyFile metadata
CodeLlama-7b-Instruct-hf.Q3_K_S.gguf2.95 GB
a705b68b…76562d65a705b68b316f1f890ae6bc0522832265a653ccc4bc2884d2fb193c8476562d65
Upstream onlyFile metadata
CodeLlama-7b-Instruct-hf.Q4_0.gguf3.83 GB
a85c6a3d…d733799aa85c6a3d6bd98dac63e7f0049ae74de773c6549d33015012c9093da3d733799a
Upstream onlyFile metadata
CodeLlama-7b-Instruct-hf.Q4_K_S.gguf3.86 GB
dd84da07…dd8c6605dd84da07d370cb2afdf8ccf5b325246ef6c223b3e8df48a21d4b1759dd8c6605
Upstream onlyFile metadata
CodeLlama-7b-Instruct-hf.Q5_0.gguf4.65 GB
07603177…dee9f506076031772208700afdf76b651250ffd256f19e872a55ae042e18af0cdee9f506
Upstream onlyFile metadata
CodeLlama-7b-Instruct-hf.Q5_K_M.gguf4.78 GB
1a3191f8…735bf3531a3191f8a7c13dc71e97417941d74bba92d646e065e6ca6af33981e6735bf353
Upstream onlyFile metadata
CodeLlama-7b-Instruct-hf.Q5_K_S.gguf4.65 GB
318da5b5…a0a3ff6c318da5b5c7e5671c9647e9b97e0d7fe4f8deac93fb5e532709abd626a0a3ff6c
Upstream onlyFile metadata
CodeLlama-7b-Instruct-hf.Q6_K.gguf5.53 GB
b720f1e8…214588ccb720f1e840443df9f31ed838da581a47095ad3a6f8d6af3caf9f4eb9214588cc
Upstream onlyFile metadata
CodeLlama-7b-Instruct-hf.Q8_0.gguf7.16 GB
ee087c9b…0e0d44f5ee087c9b28774b81511a66ccdb0706140572e6882c17265f25ea945f0e0d44f5
Upstream onlyFile metadata
Docs
.gitattributes2.38 KB—Upstream onlyFile metadata
README.md469 bytes—Upstream onlyFile metadata

Check a download

In the folder where you saved CodeLlama-7b-Instruct-hf.Q4_K_M.gguf, run:

macOS
shasum -a 256 -- 'CodeLlama-7b-Instruct-hf.Q4_K_M.gguf'
Linux
sha256sum -- 'CodeLlama-7b-Instruct-hf.Q4_K_M.gguf'
Windows
Get-FileHash -LiteralPath 'CodeLlama-7b-Instruct-hf.Q4_K_M.gguf' -Algorithm SHA256

Compare the result with the recorded SHA-256.