# bartowski/kai-os_Grug-35B-A3B-GGUF

Model from Hugging Face for text generation: bartowski/kai-os_Grug-35B-A3B-GGUF · transformers

## Facts

- Type: LLM
- Task: text-generation
- Framework: transformers
- License: apache-2.0 — Permissive open license: commercial use, modification, and redistribution are permitted. (https://spdx.org/licenses/Apache-2.0.html)
- Source: https://huggingface.co/bartowski/kai-os_Grug-35B-A3B-GGUF
- Hosting: hosted (1 file)
- Files: 1 hosted of 31 listed
- File counts: "listed" is every file in the source repository; only hosted files download from Hugging Bay, and the download plan lists the files it selects for one download, so its count can differ.
- Hosted here: 1 file, 21.4 GB
- Full repo upstream: 569 GB
- Recommended file: 21.4 GB (Q4_K_M) · kai-os_Grug-35B-A3B-Q4_K_M.gguf
- Parameters: 35B (3B active)
- Download: https://huggingbay.xyz/artifact/hf-model-bartowski-kai-os-grug-35b-a3b-gguf/files (download plan: https://huggingbay.xyz/api/artifacts/hf-model-bartowski-kai-os-grug-35b-a3b-gguf/download-plan)
- Per-file SHA-256: available for 1 of 1 hosted file via https://huggingbay.xyz/api/artifacts/hf-model-bartowski-kai-os-grug-35b-a3b-gguf/files?limit=100
- Run-ready: no (Hugging Bay has not certified a run path for this model; hosted bytes are downloadable and hash-checkable only)
- Peer-assisted fallbacks: 0 verified, 0 pending review
- Downloads: 2138
- Stars: 2
- Card completeness: 96%

## Description

External Hugging Face catalog record for bartowski/kai-os_Grug-35B-A3B-GGUF. Task: text generation. Library: transformers. Datasets referenced by card metadata: hotdogs/uka-glm-5.2, Scale-or-Reason/general-reasoning-ift-pairs, samcheng0/lumia-reasoning-sft-v1, HSH-Intelligence/verified-math-reasoning-3k, kd13/CodeDebug-Instruct-v2-Reasoning, Madarabr/cortex-adaptive-thinking. Base model: kai-os/Grug-35B-A3B. Includes 1 model-card evaluation signal. Popularity signal at import: 2,138 downloads and 2 likes.

## Model Card Facts

- Declared license: apache-2.0
- Pipeline: text-generation
- Library: transformers
- Base model: kai-os/Grug-35B-A3B
- Task categories: text-generation
- Referenced datasets: hotdogs/uka-glm-5.2, Scale-or-Reason/general-reasoning-ift-pairs, samcheng0/lumia-reasoning-sft-v1, HSH-Intelligence/verified-math-reasoning-3k, kd13/CodeDebug-Instruct-v2-Reasoning, Madarabr/cortex-adaptive-thinking, CL-From-Nothing/code_rose_initial_1_7B_SFT_10K_rollouts_Qwen3-4B-Thinking-2507_k12_t0.7_maxtok12288
- Model-index entries: Grug-35B-A3B
- Evaluation signals: 1 model-card eval result
- File hints: 16 upstream file samples

## Evaluation Signals

- Local compact reasoning smoke prompts: Final validation loss at step 100 = 1.0398826599121094 (Compact-reasoning smoke test)

## Referenced Data

- Dataset: hotdogs/uka-glm-5.2
- Dataset: Scale-or-Reason/general-reasoning-ift-pairs
- Dataset: samcheng0/lumia-reasoning-sft-v1
- Dataset: HSH-Intelligence/verified-math-reasoning-3k
- Dataset: kd13/CodeDebug-Instruct-v2-Reasoning
- Dataset: Madarabr/cortex-adaptive-thinking
- Dataset: CL-From-Nothing/code_rose_initial_1_7B_SFT_10K_rollouts_Qwen3-4B-Thinking-2507_k12_t0.7_maxtok12288

## File Hints

- .gitattributes (3.5 KB)
- README.md (15 KB)
- kai-os_Grug-35B-A3B-IQ2_M.gguf (11 GB) LFS
- kai-os_Grug-35B-A3B-IQ2_S.gguf (10 GB) LFS
- kai-os_Grug-35B-A3B-IQ2_XS.gguf (10 GB) LFS
- kai-os_Grug-35B-A3B-IQ2_XXS.gguf (9.1 GB) LFS
- kai-os_Grug-35B-A3B-IQ3_M.gguf (16 GB) LFS
- kai-os_Grug-35B-A3B-IQ3_XS.gguf (15 GB) LFS
- kai-os_Grug-35B-A3B-IQ3_XXS.gguf (14 GB) LFS
- kai-os_Grug-35B-A3B-IQ4_NL.gguf (18 GB) LFS
- kai-os_Grug-35B-A3B-IQ4_XS.gguf (18 GB) LFS
- kai-os_Grug-35B-A3B-Q2_K.gguf (12 GB) LFS

## Quality Checklist

- Summary: passed
- Description: passed
- Model card metadata: passed
- License: passed
- Provenance: passed
- File inventory: passed
- Hosted bytes: passed
- Scan result: passed
- Manifest signature: passed

## Safety Notes

- External catalog metadata imported from Hugging Face public API on 2026-09-22T11:44:56.240Z.
- Open license detected as apache-2.0.
- Model-index metadata found for Grug-35B-A3B.
- Model card references dataset context: hotdogs/uka-glm-5.2, Scale-or-Reason/general-reasoning-ift-pairs, samcheng0/lumia-reasoning-sft-v1, HSH-Intelligence/verified-math-reasoning-3k.
- Not a run kit: hosted, hash-checked bytes only; run readiness is not certified for this model yet.

## Actions

- Web: https://huggingbay.xyz/artifact/hf-model-bartowski-kai-os-grug-35b-a3b-gguf
- Files API: https://huggingbay.xyz/api/artifacts/hf-model-bartowski-kai-os-grug-35b-a3b-gguf/files?limit=100
- Metadata: https://huggingbay.xyz/api/artifacts/hf-model-bartowski-kai-os-grug-35b-a3b-gguf/metadata.json
- Distribution: https://huggingbay.xyz/api/artifacts/hf-model-bartowski-kai-os-grug-35b-a3b-gguf/distribution
- Manifest: https://huggingbay.xyz/api/manifests/hf-model-bartowski-kai-os-grug-35b-a3b-gguf
- Download plan (per-file SHA-256 + signed download URLs): https://huggingbay.xyz/api/artifacts/hf-model-bartowski-kai-os-grug-35b-a3b-gguf/download-plan
- Hosted download rows: https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-bartowski-kai-os-grug-35b-a3b-gguf&limit=100
- Request mirror: not applicable.
- Submit peer fallback for review: POST https://huggingbay.xyz/api/artifacts/hf-model-bartowski-kai-os-grug-35b-a3b-gguf/decentralized-fallbacks