Aller au contenu principal

AI models that run on this device.

Two small chat models run in a computer’s browser here; every other model is a file you download.

QuantFactory

granite-3b-code-base-128k-GGUF

Try browser chat with a small demo model (a separate model; device support is checked before loading).

QuantFactory/granite-3b-code-base-128k-GGUF
Model details
text generationLicense: apache-2.0SHA-256 recorded for 14 of 16 filesGGUF

Content controls: not assessed.

The catalog lists this model for working with code. Catalog sources: license, cardMetadata.license, tags, task, cardMetadata.pipelineTag.

1 hosted of 16 listed

Hashes recorded. Date not recorded.

FileTailleSHA-256SourceTélécharger
Weights
granite-3b-code-base-128k.Q4_K_M.gguf Default2.13 GB
2804109e…3fd53d272804109e0193cc149bd0060dc387a4f3de941f43c9c2c8abd8355df63fd53d27
HostedTélécharger
granite-3b-code-base-128k.Q2_K.gguf1.34 GB
3ac9c60c…4e4b592f3ac9c60cb25bc1476f9cd942e458fbabcec0dab5b1166638b28deb9b4e4b592f
Upstream onlyFile metadata
granite-3b-code-base-128k.Q3_K_L.gguf1.88 GB
28d6de60…7cd7e19a28d6de603115d3d004bb6be54e01820fbfe09afc91755da7eca6b6ab7cd7e19a
Upstream onlyFile metadata
granite-3b-code-base-128k.Q3_K_M.gguf1.73 GB
84318777…9603342b843187778b7592e4149b7a113a0ca707dfe1b6e1aa8fcd0a59dd1ffd9603342b
Upstream onlyFile metadata
granite-3b-code-base-128k.Q3_K_S.gguf1.55 GB
8d1913a9…d68cfb518d1913a96a1d4df9699fa748ad4defb78df436c241d8345beb1c420ed68cfb51
Upstream onlyFile metadata
granite-3b-code-base-128k.Q4_0.gguf2 GB
a67fa650…635e6b7ba67fa650af2fd35738a732dd3fb29459d72e4e44296a8d48bd4de139635e6b7b
Upstream onlyFile metadata
granite-3b-code-base-128k.Q4_1.gguf2.21 GB
ae05907a…da3c121fae05907afbbcd5adbe3822b6f34f92ba69857d86b640dc9e5bf00be8da3c121f
Upstream onlyFile metadata
granite-3b-code-base-128k.Q4_K_S.gguf2.01 GB
1b67fa51…5ff31fa61b67fa5151f458210c620dfa231ef86b2125ce6a216fda3628cdfa3b5ff31fa6
Upstream onlyFile metadata
granite-3b-code-base-128k.Q5_0.gguf2.42 GB
3a0cef81…7e1e627e3a0cef8170465e1fd1e51a71fe8c610bbe54eb9a9568cc317e1045a57e1e627e
Upstream onlyFile metadata
granite-3b-code-base-128k.Q5_1.gguf2.63 GB
fd961ba1…8d42a251fd961ba11a2b3520cd9dd8e8b88ed83a6feea11f48b8a24e497aadb98d42a251
Upstream onlyFile metadata
granite-3b-code-base-128k.Q5_K_M.gguf2.49 GB
536a34fc…dea6f483536a34fc50fb880ae39f2c434c67f78dfd8c8b11cfde8f15c04913e6dea6f483
Upstream onlyFile metadata
granite-3b-code-base-128k.Q5_K_S.gguf2.42 GB
ab82cfff…2808706eab82cfff338870d540186519f8ea819cbbcd576a5ed02b20ed10bbf62808706e
Upstream onlyFile metadata
granite-3b-code-base-128k.Q6_K.gguf2.86 GB
620a1cfa…a7c1124e620a1cfa8de4ba86497f7efe01c215743ac70c94224d6cd13a4db73ba7c1124e
Upstream onlyFile metadata
granite-3b-code-base-128k.Q8_0.gguf3.71 GB
64cc4acf…d1e712c064cc4acf961315eff6d898bd56a325733c727197e9896e9dcaf18e06d1e712c0
Upstream onlyFile metadata
Docs
.gitattributes2.54 KB—Upstream onlyFile metadata
README.md9.07 KB—Upstream onlyFile metadata

Vérifier un téléchargement

In the folder where you saved granite-3b-code-base-128k.Q4_K_M.gguf, run:

macOS
shasum -a 256 -- 'granite-3b-code-base-128k.Q4_K_M.gguf'
Linux
sha256sum -- 'granite-3b-code-base-128k.Q4_K_M.gguf'
Windows
Get-FileHash -LiteralPath 'granite-3b-code-base-128k.Q4_K_M.gguf' -Algorithm SHA256

Compare the result with the recorded SHA-256.