# QuantFactory/granite-7b-instruct-GGUF

Model from Hugging Face for text generation: QuantFactory/granite-7b-instruct-GGUF · unknown

## Facts

- Type: LLM
- Task: text-generation
- Framework: unknown
- License: apache-2.0 — Permissive open license: commercial use, modification, and redistribution are permitted. (https://spdx.org/licenses/Apache-2.0.html)
- Source: https://huggingface.co/QuantFactory/granite-7b-instruct-GGUF
- Hosting: unknown (no download location recorded)
- Files: 16 listed, none hosted here
- File counts: "listed" is every file in the source repository; only hosted files download from Hugging Bay, and the download plan lists the files it selects for one download, so its count can differ.
- Hosted here: availability unknown
- Full repo upstream: 60.2 GB
- Recommended file: 4.08 GB (Q4_K_M) · granite-7b-instruct.Q4_K_M.gguf
- Parameters: 7B
- Download: none recorded
- Per-file SHA-256: not available (no files hosted on Hugging Bay)
- Run-ready: no (Hugging Bay has not certified a run path for this model; hosted bytes are downloadable and hash-checkable only)
- Peer-assisted fallbacks: 0 verified, 0 pending review
- Downloads: 72
- Stars: 2
- Card completeness: 96%

## Description

External Hugging Face catalog record for QuantFactory/granite-7b-instruct-GGUF. Task: text generation. Library: unknown. Languages: en. Base model: ibm/granite-7b-base. Popularity signal at import: 614 downloads and 2 likes.

## Model Card Facts

- Declared license: apache-2.0
- Pipeline: text-generation
- Library: unknown
- Base model: ibm/granite-7b-base
- Task categories: text-generation
- Languages: en
- Paper ids: 2403.01081
- File hints: 16 upstream file samples

## Referenced Data

- Paper: 2403.01081

## File Hints

- .gitattributes (2.4 KB)
- README.md (7.7 KB)
- granite-7b-instruct.Q2_K.gguf (2.4 GB) LFS
- granite-7b-instruct.Q3_K_L.gguf (3.4 GB) LFS
- granite-7b-instruct.Q3_K_M.gguf (3.1 GB) LFS
- granite-7b-instruct.Q3_K_S.gguf (2.7 GB) LFS
- granite-7b-instruct.Q4_0.gguf (3.6 GB) LFS
- granite-7b-instruct.Q4_1.gguf (3.9 GB) LFS
- granite-7b-instruct.Q4_K_M.gguf (3.8 GB) LFS
- granite-7b-instruct.Q4_K_S.gguf (3.6 GB) LFS
- granite-7b-instruct.Q5_0.gguf (4.3 GB) LFS
- granite-7b-instruct.Q5_1.gguf (4.7 GB) LFS

## Quality Checklist

- Summary: passed
- Description: passed
- Model card metadata: passed
- License: passed
- Provenance: passed
- File inventory: passed
- Hosted bytes: passed
- Scan result: passed
- Manifest signature: pending

## Safety Notes

- External catalog metadata imported from Hugging Face public API on 2026-08-28T09:49:35.158Z.
- Open license detected as apache-2.0.
- Not locally hosted, mirrored, signed, or rescanned by Hugging Bay.
- Not a run kit: hosted, hash-checked bytes only; run readiness is not certified for this model yet.

## Actions

- Web: https://huggingbay.xyz/artifact/hf-model-quantfactory-granite-7b-instruct-gguf
- Files API: https://huggingbay.xyz/api/artifacts/hf-model-quantfactory-granite-7b-instruct-gguf/files?limit=100
- Metadata: https://huggingbay.xyz/api/artifacts/hf-model-quantfactory-granite-7b-instruct-gguf/metadata.json
- Distribution: https://huggingbay.xyz/api/artifacts/hf-model-quantfactory-granite-7b-instruct-gguf/distribution
- Manifest: not available until files are hosted and release checks pass.
- Request mirror: POST https://huggingbay.xyz/api/artifacts/hf-model-quantfactory-granite-7b-instruct-gguf/mirror-request
- Submit peer fallback for review: POST https://huggingbay.xyz/api/artifacts/hf-model-quantfactory-granite-7b-instruct-gguf/decentralized-fallbacks
