granite-34b-code-instruct-GGUF GGUF download | Hugging Bay

Q: What is this model?

bartowski/granite-34b-code-instruct-GGUF is an open-weights language model for text generation published by bartowski, added to Hugging Bay Jun 30, 2026. Model from Hugging Face for text generation: bartowski/granite-34b-code-instruct-GGUF · transformers

Q: Can I use it commercially?

It is released under the apache-2.0 license. Commercial use is allowed. Permissive open license: commercial use, modification, and redistribution are permitted.

Q: How big is it?

bartowski/granite-34b-code-instruct-GGUF has 34B parameters. Hosted here: 1 file, 21.4 GB. Full repo upstream: 505.8 GB. The recommended download, granite-34b-code-instruct-Q4_K_M.gguf (Q4_K_M), is 21.4 GB.

Q: What can I download here?

Hosted here: 1 file, 21.4 GB. Full repo upstream: 505.8 GB. The original release is at https://huggingface.co/bartowski/granite-34b-code-instruct-GGUF.

Q: File pattern scans

Automated file-pattern scans flagged nothing; not a safety guarantee. 1 hosted file carries a published SHA-256 you can re-hash. The machine-readable verdict is at /api/artifacts/hf-model-bartowski-granite-34b-code-instruct-gguf/safety on Hugging Bay.

Q: Will bartowski/granite-34b-code-instruct-GGUF run on my computer?

We can’t check the fit; we don’t know your machine. We don’t have your machine’s specs, so no check ran and no verdict is shown. Answer two quick questions and we’ll estimate, from the memory you tell us, whether it fits your machine. Or skip it; you can still download; fit isn’t checked.

bartowski

granite-34b-code-instruct-GGUF

Try browser chat with a small demo model (a separate model; device support is checked before loading).

bartowski/granite-34b-code-instruct-GGUF

Model details

text generationLicense: apache-2.0SHA-256 recorded for 28 of 30 filesGGUF

Content controls: not assessed.

The catalog lists this model for working with code. Catalog sources: license, cardMetadata.license, baseModel, tags, task, cardMetadata.pipelineTag.

View as JSON →

Your next step

Use it from code

This Python snippet downloads the selected file. Running the model needs its own library and setup.

from urllib.request import urlretrieve

urlretrieve(
    "https://huggingbay.xyz/api/downloads/hf-model-bartowski-granite-34b-code-instruct-gguf/granite-34b-code-instruct-Q4_K_M.gguf",
    "granite-34b-code-instruct-Q4_K_M.gguf",
)

Other ways

Run it on your computerOpen in Hugging Bay appSend to a computerMac (Apple silicon) and Linux x86_64 installs are listed on the download page. Windows and Intel Mac are not yet. The app checks this model before you choose to download.

1 hosted of 30 listed · Hashes recorded. Date not recorded.

Selected downloadgranite-34b-code-instruct-Q4_K_M.gguf21.38 GB · 1 file Download · 21.38 GB (1 file)

Open-file help

Content controls: not assessed.

Check your download →

Compare your file’s SHA-256 with the recorded hash.

1 hosted of 30 listed

Hashes recorded. Date not recorded.

File	आकार	SHA-256	स्रोत	डाउनलोड करें
Weights
`granite-34b-code-instruct-Q4_K_M.gguf` Default	21.4 GB	`70747e07…8a1d8e3e` `70747e072433cebd80d939fd0b9a504836bbc6fdb5679348c8a813d08a1d8e3e`	Hosted	डाउनलोड करें
`granite-34b-code-instruct-IQ1_M.gguf`	8.04 GB	`404773e3…ab459b31` `404773e30975939cb1ba355e39c52ff601f771a246c52d0d096fa892ab459b31`	Upstream only	File metadata
`granite-34b-code-instruct-IQ1_S.gguf`	7.38 GB	`03ae22ad…1f47a4c3` `03ae22ad6a16c851f2e784ed85733505e254a34e9675e3d7ba5c98391f47a4c3`	Upstream only	File metadata
`granite-34b-code-instruct-IQ2_M.gguf`	11.7 GB	`2d1854b0…b1851bda` `2d1854b0438337b48c261f2421e59089758232f95f559b24a3011010b1851bda`	Upstream only	File metadata
`granite-34b-code-instruct-IQ2_S.gguf`	10.8 GB	`8ad07cc0…74709ccf` `8ad07cc0fdd166cd569bb3121c6748642931d8da47ce5cea9574d65b74709ccf`	Upstream only	File metadata
`granite-34b-code-instruct-IQ2_XS.gguf`	10.1 GB	`3affaa32…b3424c95` `3affaa326c6f5c3ddab1fc091115e68bb50aac31bf9e11687e39b398b3424c95`	Upstream only	File metadata
`granite-34b-code-instruct-IQ2_XXS.gguf`	9.15 GB	`31fdfd96…04b9af37` `31fdfd968c4cc24250eaebcfb8894bf1c20adba68c31797db32f828f04b9af37`	Upstream only	File metadata
`granite-34b-code-instruct-IQ3_M.gguf`	15.9 GB	`2eff1b69…d70f96bf` `2eff1b6922606c055498e904dd709fc894b9ddafe9ae56ff03f79db1d70f96bf`	Upstream only	File metadata
`granite-34b-code-instruct-IQ3_S.gguf`	14.8 GB	`78664751…6a43f5ec` `786647511c3152e7f358926a27784311d4b6a2d601d4e3b2f2c859486a43f5ec`	Upstream only	File metadata
`granite-34b-code-instruct-IQ3_XS.gguf`	14.3 GB	`5fb3e930…6f8ee13f` `5fb3e930955290e0a26f0cb5af10e6ccabb9ec1c4b16c276a0f894b16f8ee13f`	Upstream only	File metadata
`granite-34b-code-instruct-IQ3_XXS.gguf`	13.4 GB	`bf64e266…7d7c7f4a` `bf64e266bfcbcd22c77bf71231c4741ffe5e5dd94bd2297055df0dc87d7c7f4a`	Upstream only	File metadata
`granite-34b-code-instruct-IQ4_NL.gguf`	19.2 GB	`22ce4160…af7948e8` `22ce4160c655e4f986efc0fccd47c19016c39d7f1b92c71a63ca4e2aaf7948e8`	Upstream only	File metadata
`granite-34b-code-instruct-IQ4_XS.gguf`	18.2 GB	`a59926dc…6a702960` `a59926dc32979a02b7b3c111916c3a0c5a815ab60418e74252a61d456a702960`	Upstream only	File metadata
`granite-34b-code-instruct-Q2_K.gguf`	13.1 GB	`0502f286…5152641e` `0502f286f50da6e0b15d1d682f479ade1d790dfa69594dcbf680e33c5152641e`	Upstream only	File metadata
`granite-34b-code-instruct-Q3_K_L.gguf`	19.5 GB	`1993edb7…7f0bf679` `1993edb7bdf7922b5c2714ef4fbd9e7573883194df38c0100c38be7e7f0bf679`	Upstream only	File metadata
`granite-34b-code-instruct-Q3_K_M.gguf`	17.6 GB	`17d34e48…633fc2d1` `17d34e48a609bbda5c00936b34d8901d1701205c66ed3152875976a7633fc2d1`	Upstream only	File metadata
`granite-34b-code-instruct-Q3_K_S.gguf`	14.8 GB	`737914ad…f65ae32f` `737914adf333689959d27a349c1296b906cf7c2bfd005da0a81120fef65ae32f`	Upstream only	File metadata
`granite-34b-code-instruct-Q4_K_S.gguf`	19.4 GB	`63e4b84d…e26e7939` `63e4b84d750da0bf3307b1d6f0c37d3cbc43677fcda983c40f150901e26e7939`	Upstream only	File metadata
`granite-34b-code-instruct-Q5_K_M.gguf`	24.7 GB	`43fbdb10…c2fabd12` `43fbdb102884b0cc810cd3e7130042d0effc77687cfabe12f6e8c19bc2fabd12`	Upstream only	File metadata
`granite-34b-code-instruct-Q5_K_S.gguf`	23.4 GB	`5b397402…059d655e` `5b397402dc8b7374890325e3d20c17044c1ba9803902d2582ec2ebea059d655e`	Upstream only	File metadata
`granite-34b-code-instruct-Q6_K.gguf`	27.8 GB	`f0f5d5d9…dbb2b6af` `f0f5d5d9e17cda951eb9dff216ce18e1605b199b6c7eb551f3e09c9edbb2b6af`	Upstream only	File metadata
`granite-34b-code-instruct-Q8_0.gguf`	36 GB	`b6978856…cfa403de` `b697885658ae4c01aa865ef5f70c301f3c5c0219f3ae87cca486f482cfa403de`	Upstream only	File metadata
`granite-34b-code-instruct-f32.gguf/granite-34b-code-instruct-f32-00001-of-00005.gguf`	32 GB	`19388dda…5ca8bf04` `19388ddad2aa76918071b3af22d346ccbba203e42381808a550175965ca8bf04`	Upstream only	File metadata
`granite-34b-code-instruct-f32.gguf/granite-34b-code-instruct-f32-00002-of-00005.gguf`	31.8 GB	`8585d0ce…8c8510b6` `8585d0ce8063fd2bbbb30290a3359a8031ae6ac83a758eccecf344608c8510b6`	Upstream only	File metadata
`granite-34b-code-instruct-f32.gguf/granite-34b-code-instruct-f32-00003-of-00005.gguf`	31.8 GB	`7137532a…0e4d6413` `7137532a0767e60280665fe45d039d6fcf03ffcef7bef8eeef29fede0e4d6413`	Upstream only	File metadata
`granite-34b-code-instruct-f32.gguf/granite-34b-code-instruct-f32-00004-of-00005.gguf`	31.8 GB	`6260c032…cd5557e1` `6260c0326efcfd0b6b955242c7f550c246a9b136c43d60f07843f467cd5557e1`	Upstream only	File metadata
`granite-34b-code-instruct-f32.gguf/granite-34b-code-instruct-f32-00005-of-00005.gguf`	7.27 GB	`676b90e6…633649a2` `676b90e6d28ffdf311ab9d02d5238fdbaddb7d2f708eaab452916c89633649a2`	Upstream only	File metadata
Tokenizer & config
`granite-34b-code-instruct.imatrix`	15.2 MB	`98f7cff0…8967e47a` `98f7cff0d771cc5f8ab2136588cd1fbc2be304014d2e23ebeba065828967e47a`	Upstream only	File metadata
Docs
`.gitattributes`	3.81 KB	—	Upstream only	File metadata
`README.md`	12.9 KB	—	Upstream only	File metadata

डाउनलोड की जाँच करें

In the folder where you saved granite-34b-code-instruct-Q4_K_M.gguf, run:

macOS

shasum -a 256 -- 'granite-34b-code-instruct-Q4_K_M.gguf'

Linux

sha256sum -- 'granite-34b-code-instruct-Q4_K_M.gguf'

Windows

Get-FileHash -LiteralPath 'granite-34b-code-instruct-Q4_K_M.gguf' -Algorithm SHA256

Compare the result with the recorded SHA-256.

granite-34b-code-instruct-GGUF

डाउनलोड की जाँच करें

Cookies