Aller au contenu principal

AI models that run on this device.

Two small chat models run in a computer’s browser here; every other model is a file you download.

bartowski

speechless-starcoder2-7b-GGUF

Try browser chat with a small demo model (a separate model; device support is checked before loading).

bartowski/speechless-starcoder2-7b-GGUF
Model details
text generationLicense: apache-2.0SHA-256 recorded for 12 of 14 filesGGUF

Content controls: not assessed.

The catalog lists this model for working with code. Catalog sources: license, cardMetadata.license, tags, task, cardMetadata.pipelineTag.

1 hosted of 14 listed

Hashes recorded. Date not recorded.

FileTailleSHA-256SourceTélécharger
Weights
speechless-starcoder2-7b-Q4_K_M.gguf Default4.4 GB
11267076…26e578fe11267076021427722572215fcc58ae9b58363b14cf6b3676ff1c0e3226e578fe
HostedTélécharger
speechless-starcoder2-7b-Q2_K.gguf2.72 GB
d955dc87…c75df9c2d955dc87a41bdd16941483d39d000c6134126b5c2a8b14f0394e6c5ec75df9c2
Upstream onlyFile metadata
speechless-starcoder2-7b-Q3_K_L.gguf3.99 GB
f114242b…23876ddef114242bd41d339c1ef6540bf385717cda799a2a3dcbccf9d2df43bb23876dde
Upstream onlyFile metadata
speechless-starcoder2-7b-Q3_K_M.gguf3.59 GB
aed9e9a0…9146d98faed9e9a092a306ee994b1d5d4643f1b229a876ab15a927c05ecce7b89146d98f
Upstream onlyFile metadata
speechless-starcoder2-7b-Q3_K_S.gguf3.09 GB
b76cba8c…77cd7aefb76cba8c684f40187e5ae24a62fbb8cf29bf56cd4f046cdb4934b75677cd7aef
Upstream onlyFile metadata
speechless-starcoder2-7b-Q4_0.gguf4.04 GB
fbd68192…1b7cf658fbd681925a6f0a758b47e461b15810ce6a6a93a101e57fc922428c5d1b7cf658
Upstream onlyFile metadata
speechless-starcoder2-7b-Q4_K_S.gguf4.13 GB
f4440a9f…887a5f06f4440a9fcf3d89cc01abbc29ea9c1e249ad7dbe6645644dc3936a3de887a5f06
Upstream onlyFile metadata
speechless-starcoder2-7b-Q5_0.gguf4.94 GB
0c12c863…a296a9ac0c12c8630ac98539eec85b4cbd155e2b158a8353ba8dd8a33c6d2ed9a296a9ac
Upstream onlyFile metadata
speechless-starcoder2-7b-Q5_K_M.gguf5.12 GB
6c60a2e4…5b79bc8a6c60a2e4648ab4262fce5aa745ec61167d334d831abb1dee446465e65b79bc8a
Upstream onlyFile metadata
speechless-starcoder2-7b-Q5_K_S.gguf4.94 GB
4c06b4f1…cee14f3d4c06b4f1365530ba3cc0be242c93f89c2bd1cbbce43b0ea2ff1249b6cee14f3d
Upstream onlyFile metadata
speechless-starcoder2-7b-Q6_K.gguf5.89 GB
269c5ac9…4df626ed269c5ac93b241ce6845f8be4121865ee1fadc0107e5c2ee3c85fc34f4df626ed
Upstream onlyFile metadata
speechless-starcoder2-7b-Q8_0.gguf7.63 GB
28138ce1…c5a0d4c428138ce1685b763539bf7273c49e1980b2b09950dc273ece5adc92a4c5a0d4c4
Upstream onlyFile metadata
Docs
.gitattributes2.38 KB—Upstream onlyFile metadata
README.md3.55 KB—Upstream onlyFile metadata

Vérifier un téléchargement

In the folder where you saved speechless-starcoder2-7b-Q4_K_M.gguf, run:

macOS
shasum -a 256 -- 'speechless-starcoder2-7b-Q4_K_M.gguf'
Linux
sha256sum -- 'speechless-starcoder2-7b-Q4_K_M.gguf'
Windows
Get-FileHash -LiteralPath 'speechless-starcoder2-7b-Q4_K_M.gguf' -Algorithm SHA256

Compare the result with the recorded SHA-256.