unsloth

granite-3.3-8b-instruct-GGUF

Chat
What we checked

File: check availability in Files.

Memory: Fit unknown. File size needed to check fit.

Last recorded run: none for this selected file.

License BFiles CRuns F

Recorded checks do not guarantee safety or performance on your computer.

See file checks and sources
Chat & writeGGUFLicense label: apache-2.0

Download availability is being checked.

Hashes recorded. Date not recorded.

FileTamanhoSHA-256OrigemBaixar
Weights
granite-3.3-8b-instruct-Q4_K_M.gguf4.94 GB
7057b01e…6a910f337057b01e68af6819e5273c75cc2d948d48eeaa750962e5eebb4ecf916a910f33
Download availability is being checked.File metadata
granite-3.3-8b-instruct-BF16.gguf16.3 GB
dff1ccae…b3371a5edff1ccae274a90e83833c07ac69b4e6fa296c8d6dc38223f55de830db3371a5e
Download availability is being checked.File metadata
granite-3.3-8b-instruct-IQ4_NL.gguf4.67 GB
2a63bd52…8274b4ee2a63bd527a77d776fcbfb279dedee60ec0256128df23819629ab2d558274b4ee
Download availability is being checked.File metadata
granite-3.3-8b-instruct-IQ4_XS.gguf4.43 GB
e0f00ebb…5c52d5e3e0f00ebb63e74d2485c74b185eef4eb530aa77cd3b8109a0c3d4b9045c52d5e3
Download availability is being checked.File metadata
granite-3.3-8b-instruct-Q2_K.gguf3.1 GB
20e7873a…b62d894420e7873a30f5b4f21a006c228e6b0735f8ca6c1a96892442387cbe5bb62d8944
Download availability is being checked.File metadata
granite-3.3-8b-instruct-Q2_K_L.gguf3.1 GB
20e7873a…b62d894420e7873a30f5b4f21a006c228e6b0735f8ca6c1a96892442387cbe5bb62d8944
Download availability is being checked.File metadata
granite-3.3-8b-instruct-Q3_K_M.gguf4 GB
f659907b…bc14d431f659907b531ccf188d0d39eb7e0da529bf24ddbdaf35637ea22b4117bc14d431
Download availability is being checked.File metadata
granite-3.3-8b-instruct-Q3_K_S.gguf3.59 GB
9da0a51f…9d4284ce9da0a51f1489ea7c94cbb37d3bb648a8f14f188ff19c1072265666539d4284ce
Download availability is being checked.File metadata
granite-3.3-8b-instruct-Q4_0.gguf4.67 GB
ca876732…b24a6bc8ca876732f4378806c67350b13df8e9d542dbd958695edd1fa78a222cb24a6bc8
Download availability is being checked.File metadata
granite-3.3-8b-instruct-Q4_1.gguf5.15 GB
1992efe8…6d2dd16f1992efe8b82d03782b8bc25d181277f47e9d2e4592e8388fb33a45c66d2dd16f
Download availability is being checked.File metadata
granite-3.3-8b-instruct-Q4_K_S.gguf4.69 GB
2fa13551…304a07482fa13551d4e82f1a7a809b32953baeb7000bb7f9ee3523e3b5fcab4d304a0748
Download availability is being checked.File metadata
granite-3.3-8b-instruct-Q5_K_M.gguf5.8 GB
31c4c864…8c4fceb431c4c864faf0c0a52c3970d36729f30b83e4eb42408883f8ab7e77718c4fceb4
Download availability is being checked.File metadata
granite-3.3-8b-instruct-Q5_K_S.gguf5.65 GB
cf55a181…a98c34bbcf55a1810a8511c35c2f277960c27e3d8965aa5c1ddff2d57d1943c0a98c34bb
Download availability is being checked.File metadata
granite-3.3-8b-instruct-Q6_K.gguf6.71 GB
9be271d5…50eee9069be271d5192a0a9a017c0cb9d3890c02c0089656a8f7b36dd2c48d8450eee906
Download availability is being checked.File metadata
granite-3.3-8b-instruct-UD-IQ1_M.gguf2.07 GB
50c767fc…9564037250c767fca75ebb64d2a8e39e324be1d8e71800622a931d4b9dd5f54d95640372
Download availability is being checked.File metadata
granite-3.3-8b-instruct-UD-IQ1_S.gguf1.93 GB
773dcbca…a24f6e3d773dcbca91a530be7b34cff6af73e62da19a05ef3718562a4db87228a24f6e3d
Download availability is being checked.File metadata
granite-3.3-8b-instruct-UD-IQ2_M.gguf2.89 GB
90586f54…39d9cd3e90586f54c8b306125dbb51c324d266dde7a883fe0f42ca998ecf355539d9cd3e
Download availability is being checked.File metadata
granite-3.3-8b-instruct-UD-IQ2_XXS.gguf2.32 GB
9323ef9a…c704b3f59323ef9a3e01dafb82a78b22c49ad40331f2c2826eacd65c15611878c704b3f5
Download availability is being checked.File metadata
granite-3.3-8b-instruct-UD-IQ3_XXS.gguf3.24 GB
0d84f626…9a6e020f0d84f6263fc9bb80f9546a54f24e2711a2bda21e16385050de1f26789a6e020f
Download availability is being checked.File metadata
granite-3.3-8b-instruct-UD-Q2_K_XL.gguf3.18 GB
e5273c35…320d3164e5273c35ee4cc8e9b9ca515781065b312fbef9d4777cd74899ae5f29320d3164
Download availability is being checked.File metadata
granite-3.3-8b-instruct-UD-Q3_K_XL.gguf4.1 GB
25d9c15b…170d448225d9c15b6549ae1aab10d3365578ff73b4aaff191060a7b132b2dd58170d4482
Download availability is being checked.File metadata
granite-3.3-8b-instruct-UD-Q4_K_XL.gguf5.04 GB
34fc9c15…cf19bf7534fc9c158463ddfcbb71c54b3781735881454b7a4a306fdb2a2f4a28cf19bf75
Download availability is being checked.File metadata
granite-3.3-8b-instruct-UD-Q5_K_XL.gguf5.82 GB
1faa6297…d3de65831faa62977f46ee86d3dc1957fcdd57825bce37273d346cae15352fadd3de6583
Download availability is being checked.File metadata
granite-3.3-8b-instruct-UD-Q6_K_XL.gguf7.25 GB
b026cf01…336dca06b026cf0139d9050f6035b2e1b198b191ce52e2ecca673abbf8ad38bb336dca06
Download availability is being checked.File metadata
granite-3.3-8b-instruct-UD-Q8_K_XL.gguf9.87 GB
8e257898…508fce058e25789895723d433da635fd07f90825efb9d2982e553cb2df741640508fce05
Download availability is being checked.File metadata
Tokenizer & config
config.json820 bytes-Download availability is being checked.File metadata
imatrix_unsloth.dat5.99 MB
56f9b3d7…a4b241df56f9b3d72abab26d6073342f9283d1382008583074bbd88ef40f0a5da4b241df
Download availability is being checked.File metadata
Docs
.gitattributes3.4 KB-Download availability is being checked.File metadata
README.md27.6 KB-Download availability is being checked.File metadata

Verificar um download

In the folder where you saved granite-3.3-8b-instruct-Q4_K_M.gguf, run:

macOS
shasum -a 256 -- 'granite-3.3-8b-instruct-Q4_K_M.gguf'
Linux
sha256sum -- 'granite-3.3-8b-instruct-Q4_K_M.gguf'
Windows
Get-FileHash -LiteralPath 'granite-3.3-8b-instruct-Q4_K_M.gguf' -Algorithm SHA256

Compare the result with the recorded SHA-256.

Additional model information
Quick answer: compatibility and sources

Can I run granite-3.3-8b-instruct-GGUF on my computer?

It depends on your memory, processor, file format and runtime. A download is not confirmed by the current file evidence; inspect the file record before trying it. A file-size fit is an estimate, not a successful run or speed promise. Read the license before use.

granite-3.3-8b-instruct-GGUF is an open-weights language model for text generation. Model weights are learned parameters; a runtime loads them. A hosted file is an individual file Hugging Bay can serve. SHA-256 identifies exact file bytes. The availability date above applies to this file record, not the upstream metadata update date.

As of the recorded file availability check on .

Recorded SHA-256 for granite-3.3-8b-instruct-Q4_K_M.gguf: 7057b01e68af6819e5273c75cc2d948d48eeaa750962e5eebb4ecf916a910f33. Exact file evidence · Machine-readable source facts · Run evidence and any recorded receipts. A checksum fingerprints only the named file bytes; it does not prove safety, quality, a complete multi-file selection or a successful run.

Page text updated .

Model metadata: As of at the model source. Popularity counters are source-reported, not measured by Hugging Bay. Availability checked .

Key facts

Catalog record
Summarizes upstream metadata; it is not itself a download or run receipt.
File evidence
Lists exact filenames, availability and any recorded SHA-256 for individual files.
Run evidence
Reports measured results only when a receipt exists for named file bytes and a setup; otherwise unmeasured.
Checksum scope
SHA-256 fingerprints one file’s bytes; it does not prove safety, quality or a multi-file bundle.

Evidence you can inspect (plain text)

  • This page’s quick answer names the file record for hf-model-unsloth-granite-3-3-8b-instruct-gguf.
  • Open /artifact/hf-model-unsloth-granite-3-3-8b-instruct-gguf/files for exact filenames, availability and any recorded SHA-256 for this model.
  • Open /evidence/artifacts/hf-model-unsloth-granite-3-3-8b-instruct-gguf for run-readiness evidence tied to that record; absent receipts stay unmeasured.
  • Open /api/artifacts/hf-model-unsloth-granite-3-3-8b-instruct-gguf/card.md for machine-readable source facts (not a runtime test).
  • A matching checksum on this page fingerprints only the named bytes shown in file evidence.

Unmeasured states are stated explicitly; this page does not invent run scores or compatibility guarantees.

Which date applies to which fact

  • File availability check:
  • Committed page-copy sources:
  • Upstream model metadata: Dates on artifact records when shown; not implied by page-copy revision
  • Run receipts: Only on /evidence pages when recorded; otherwise unmeasured

Page-copy revision (Updated line above) identifies committed text sources, not upstream model edits or test outcomes.