granite-8b-code-instruct-4k-GGUF GGUF download | Hugging Bay

granite-8b-code-instruct-4k-GGUF

Can I run granite-8b-code-instruct-4k-GGUF on my computer?

It depends on your memory, processor, file format and runtime. Hugging Bay offers 1 hosted file; check the file list for the exact selection. A file-size fit is an estimate, not a successful run or speed promise. Read the license before use.

granite-8b-code-instruct-4k-GGUF is an open-weights language model for text generation. Model weights are learned parameters; a runtime loads them. Hosting files does not prove that a complete model runs.

As of the availability check on 2026-10-21.

Recorded SHA-256 for granite-8b-code-instruct-4k.Q4_K_M.gguf: 96afd88b55166836d575a1f95b66ab9ae69ae5aad7d7ce8c99e95d0cb10c94ab. File evidence · Machine-readable facts · Run evidence and any recorded receipts · Proof Lab measurement policy. A checksum verifies byte identity, not safety; this answer asserts no measured runtime result.

Updated 2026-10-21 · Page text: As of 2026-10-21 · Content revision

Model metadata: As of 2026-08-28 at the model source. Popularity counters are source-reported, not measured by Hugging Bay. Availability checked 2026-10-21.

Try browser chat with a small demo model (a separate model; device support is checked before loading).

QuantFactory/granite-8b-code-instruct-4k-GGUF

Model details

text generationLicense: apache-2.0SHA-256 recorded for 14 of 16 filesGGUF

Content controls: not assessed.

The catalog lists this model for working with code. Catalog sources: license, cardMetadata.license, baseModel, tags, task, cardMetadata.pipelineTag.

View as JSON →

Your next step

Use it from code

This Python snippet downloads the selected file. Running the model needs its own library and setup.

from urllib.request import urlretrieve

urlretrieve(
    "https://huggingbay.xyz/api/downloads/hf-model-quantfactory-granite-8b-code-instruct-4k-gguf/granite-8b-code-instruct-4k.Q4_K_M.gguf",
    "granite-8b-code-instruct-4k.Q4_K_M.gguf",
)

Other ways

Run it on your computerOpen in Hugging Bay appSend to a computerMac (Apple silicon) and Linux x86_64 installs are listed on the download page. Windows and Intel Mac are not yet. The app checks this model before you choose to download.

1 hosted of 16 listed · Hashes recorded. Date not recorded.

Selected downloadgranite-8b-code-instruct-4k.Q4_K_M.gguf4.88 GB · 1 file Download · 4.88 GB (1 file)

Open-file help

Content controls: not assessed.

Check your download →

Compare your file’s SHA-256 with the recorded hash.

Run this model

This model’s file is hosted here and can be downloaded, but no tested run command is published for it yet, so there is no run command to show. A model file doesn’t run on its own: open it with a free program like LM Studio, Ollama or llama.cpp.

Open the hosted files

Open the checked run record

Canonical evidence JSON Citation packet

granite-8b-code-instruct-4k-GGUF

Can I run granite-8b-code-instruct-4k-GGUF on my computer?

Run this model

Cookies