gemma-2-9b-GGUF GGUF download (5.76 GB) | Hugging Bay

gemma-2-9b-GGUF

QuantFactory/gemma-2-9b-GGUF

Model details

text generationLicense: gemmaSHA-256 recorded for 14 of 16 filesGGUF

Content controls: not assessed.

Listed for chat; for developers building conversational tools. Catalog sources: license, cardMetadata.license, baseModel, tags, task, cardMetadata.pipelineTag.

View as JSON →

Your next step

Use it from code

This Python snippet downloads the selected file. Running the model needs its own library and setup.

from urllib.request import urlretrieve

urlretrieve(
    "https://huggingbay.xyz/api/downloads/hf-model-quantfactory-gemma-2-9b-gguf/gemma-2-9b.Q4_K_M.gguf",
    "gemma-2-9b.Q4_K_M.gguf",
)

Other ways

Run it on your computerOpen in Hugging Bay appSend to a computerMac (Apple silicon) and Linux x86_64 installs are listed on the download page. Windows and Intel Mac are not yet. The app checks this model before you choose to download.

1 hosted of 16 listed · Hashes recorded. Date not recorded.

Selected downloadgemma-2-9b.Q4_K_M.gguf5.76 GB · 1 file Download · 5.76 GB (1 file)

Open-file help

Content controls: not assessed.

Check your download →

Compare your file’s SHA-256 with the recorded hash.

Informações do modelo

gemma-2-9b-GGUF is an open-weights language model for text generation. The primary file is gemma-2-9b.Q4_K_M.gguf (5.76 GB, Q4_K_M). The primary file needs about 7 GB free for the Q4 file (file plus room to run it). License: Gemma Terms of Use. The SHA-256 prefix is 4f83b63550d0. The primary Download is available now. No tested run commands for this file yet. See Files for current download availability. The size and hash details refer to the selected file, not every file in the repository. The memory figure is estimated from recorded file size with working room included.

O que está incluído

1 hosted of 16 listed

Weights

README, LICENSE & .gitattributes

Sobre este modelo

External Hugging Face catalog record for QuantFactory/gemma-2-9b-GGUF. Task: text generation. Library: transformers. Base model: google/gemma-2-9b. Popularity signal at import: 1,325 downloads and 6 likes.

Informações básicas

Parameters: 9B
Hosted here: 1 hosted of 16 listed
Full repo upstream: 84.7 GB
Recommended file: 5.76 GB (Q4_K_M) · gemma-2-9b.Q4_K_M.gguf
Format: GGUF
Downloads on Hugging Face: 1,325
File hashes: Hashes recorded. Date not recorded.

Licença e origem

License: gemma

1 hosted of 16 listed

Check the license text and keep the required notices when you use or share the files.

Upstream source →

See the JSON record →

License: Gemma Terms of Use. Custom terms, read before use
Task: text generation
Hosted here: 1 file, 5.76 GB
Full repo upstream: 84.7 GB
Recommended file: 5.76 GB (Q4_K_M) · gemma-2-9b.Q4_K_M.gguf
Parameters: 9B
Files: 1 hosted of 16 listed
Download: Download here (1 hosted file)
Added to Hugging Bay: Sep 19, 2026
Updated at source: Sep 19, 2026
Source: QuantFactory/gemma-2-9b-GGUF

FAQ

What is this model?

QuantFactory/gemma-2-9b-GGUF is an open-weights language model for text generation published by QuantFactory, added to Hugging Bay Sep 19, 2026. Model from Hugging Face for text generation: QuantFactory/gemma-2-9b-GGUF · transformers

Can I use it commercially?

It is released under the gemma license. Commercial use is allowed with conditions. Commercial use is permitted with obligations: Gemma terms: commercial use allowed subject to Google's prohibited-use policy.

How big is it?

QuantFactory/gemma-2-9b-GGUF has 9B parameters. Hosted here: 1 file, 5.76 GB. Full repo upstream: 84.7 GB. The recommended download, gemma-2-9b.Q4_K_M.gguf (Q4_K_M), is 5.76 GB.

What can I download here?

Hosted here: 1 file, 5.76 GB. Full repo upstream: 84.7 GB. The original release is at https://huggingface.co/QuantFactory/gemma-2-9b-GGUF.

File checks and computer fit

File pattern scans

Automated file-pattern scans flagged nothing; not a safety guarantee. 1 hosted file carries a published SHA-256 you can re-hash. The machine-readable verdict is at /api/artifacts/hf-model-quantfactory-gemma-2-9b-gguf/safety on Hugging Bay.

Will QuantFactory/gemma-2-9b-GGUF run on my computer?

We can’t check the fit; we don’t know your machine. We don’t have your machine’s specs, so no check ran and no verdict is shown. Answer two quick questions and we’ll estimate, from the memory you tell us, whether it fits your machine. Or skip it; you can still download; fit isn’t checked.

Repack of google/gemma-2-9b (from the publisher card on Hugging Face). This does not mean the files match the original weights.

2 other repacks declare the same base on their cards.