mradermacher

granite-3.1-8b-instruct-GGUF

Text generation
GeneralGGUF

Download availability is being checked.

Hashes recorded. Date not recorded.

FileSizeSHA-256SourceDownload
Weights
granite-3.1-8b-instruct.Q4_K_M.gguf4.94 GB
9a5416eb…2927ad8d9a5416ebf0c326547bdaea4efc87e5d447f4d15b2bd9d3c0256ed5342927ad8d
Download availability is being checked.File metadata
granite-3.1-8b-instruct.IQ4_XS.gguf4.47 GB
b0dcc940…bc875c33b0dcc94049734e380a01d3e52a3f0ac23bed6543c364adcc80fa88b3bc875c33
Download availability is being checked.File metadata
granite-3.1-8b-instruct.Q2_K.gguf3.1 GB
17c8440e…a99c5d7617c8440efc82e54a08f2c6778618094eb9e0e26c3784cb3c2bd14362a99c5d76
Download availability is being checked.File metadata
granite-3.1-8b-instruct.Q3_K_L.gguf4.35 GB
c486c489…201e0cbac486c48909c8eee68cb04b64fe7573e7a7cd3ed019ccada56047559a201e0cba
Download availability is being checked.File metadata
granite-3.1-8b-instruct.Q3_K_M.gguf4 GB
7a510607…13c2bda57a51060778390d0d280f9979d7bb181b5c80551a7a7838741ef9cdd913c2bda5
Download availability is being checked.File metadata
granite-3.1-8b-instruct.Q3_K_S.gguf3.59 GB
5caab871…c24afae45caab871f19b3209b0370a81a2678adeed59d6573597544657e3723fc24afae4
Download availability is being checked.File metadata
granite-3.1-8b-instruct.Q4_K_S.gguf4.69 GB
8b5d8218…b8e04d648b5d82185d25a5225a5544593de98c0663127bd438c1aa8c01f52d34b8e04d64
Download availability is being checked.File metadata
granite-3.1-8b-instruct.Q5_K_M.gguf5.8 GB
37dbf7d9…474af49837dbf7d9d156fd5aa38baf544c959a4a53189aa0f20bfeda0219cfe1474af498
Download availability is being checked.File metadata
granite-3.1-8b-instruct.Q5_K_S.gguf5.65 GB
195041fa…e913a5f6195041facd0e9c228d8b9db3b00b71aef209ae30353bf14d3855554de913a5f6
Download availability is being checked.File metadata
granite-3.1-8b-instruct.Q6_K.gguf6.71 GB
a8397adc…d7cd5376a8397adc265fee63bb49fead80fa59cb37b216ef1870568cdb5b6003d7cd5376
Download availability is being checked.File metadata
granite-3.1-8b-instruct.Q8_0.gguf8.68 GB
39fceb3e…22cf5c5139fceb3e9cb2527c0fe7c68d129621249f42f1f22c6cdb124dfb74db22cf5c51
Download availability is being checked.File metadata
granite-3.1-8b-instruct.f16.gguf16.3 GB
7f501358…9a05f9067f501358920ae651a55d0aa0bae35ca9fcd767f1fad95f23a33e04f29a05f906
Download availability is being checked.File metadata
Docs
.gitattributes2.37 KB-Download availability is being checked.File metadata
README.md3.42 KB-Download availability is being checked.File metadata

Check a download

In the folder where you saved granite-3.1-8b-instruct.Q4_K_M.gguf, run:

macOS
shasum -a 256 -- 'granite-3.1-8b-instruct.Q4_K_M.gguf'
Linux
sha256sum -- 'granite-3.1-8b-instruct.Q4_K_M.gguf'
Windows
Get-FileHash -LiteralPath 'granite-3.1-8b-instruct.Q4_K_M.gguf' -Algorithm SHA256

Compare the result with the recorded SHA-256.

Additional model information
Quick answer: compatibility and sources

Can I run granite-3.1-8b-instruct-GGUF on my computer?

It depends on your memory, processor, file format and runtime. A download is not confirmed by the current file evidence; inspect the file record before trying it. A file-size fit is an estimate, not a successful run or speed promise. Read the license before use.

granite-3.1-8b-instruct-GGUF is an open-weights language model for general. Model weights are learned parameters; a runtime loads them. A hosted file is an individual file Hugging Bay can serve. SHA-256 identifies exact file bytes. The availability date above applies to this file record, not the upstream metadata update date.

As of the recorded file availability check on .

Recorded SHA-256 for granite-3.1-8b-instruct.Q4_K_M.gguf: 9a5416ebf0c326547bdaea4efc87e5d447f4d15b2bd9d3c0256ed5342927ad8d. Exact file evidence · Machine-readable source facts · Run evidence and any recorded receipts. A checksum fingerprints only the named file bytes; it does not prove safety, quality, a complete multi-file selection or a successful run.

Page text updated .

Model metadata: As of at the model source. Popularity counters are source-reported, not measured by Hugging Bay. Availability checked .

Key facts

Catalog record
Summarizes upstream metadata; it is not itself a download or run receipt.
File evidence
Lists exact filenames, availability and any recorded SHA-256 for individual files.
Run evidence
Reports measured results only when a receipt exists for named file bytes and a setup; otherwise unmeasured.
Checksum scope
SHA-256 fingerprints one file’s bytes; it does not prove safety, quality or a multi-file bundle.

Evidence you can inspect (plain text)

  • This page’s quick answer names the file record for hf-model-mradermacher-granite-3-1-8b-instruct-gguf.
  • Open /artifact/hf-model-mradermacher-granite-3-1-8b-instruct-gguf/files for exact filenames, availability and any recorded SHA-256 for this model.
  • Open /evidence/artifacts/hf-model-mradermacher-granite-3-1-8b-instruct-gguf for run-readiness evidence tied to that record; absent receipts stay unmeasured.
  • Open /api/artifacts/hf-model-mradermacher-granite-3-1-8b-instruct-gguf/card.md for machine-readable source facts (not a runtime test).
  • A matching checksum on this page fingerprints only the named bytes shown in file evidence.

Unmeasured states are stated explicitly; this page does not invent run scores or compatibility guarantees.

Which date applies to which fact

  • File availability check:
  • Committed page-copy sources:
  • Upstream model metadata: Dates on artifact records when shown; not implied by page-copy revision
  • Run receipts: Only on /evidence pages when recorded; otherwise unmeasured

Page-copy revision (Updated line above) identifies committed text sources, not upstream model edits or test outcomes.