# KoboldAI/Mixtral-8x7B-Holodeck-v1-GGUF

Model from Hugging Face for text generation: KoboldAI/Mixtral-8x7B-Holodeck-v1-GGUF · pytorch

## Facts

- Type: LLM
- Task: text-generation
- Framework: pytorch
- License: apache-2.0 — Permissive open license: commercial use, modification, and redistribution are permitted. (https://spdx.org/licenses/Apache-2.0.html)
- Source: https://huggingface.co/KoboldAI/Mixtral-8x7B-Holodeck-v1-GGUF
- Hosting: hosted (1 file)
- Files: 1 hosted of 16 listed
- File counts: "listed" is every file in the source repository; only hosted files download from Hugging Bay, and the download plan lists the files it selects for one download, so its count can differ.
- Hosted here: 1 file, 28.4 GB
- Full repo upstream: 416.2 GB
- Recommended file: 28.4 GB (Q4_K_M) · Mixtral-8x7B-holodeck-v1.Q4_K_M.gguf
- Parameters: 56B (14B active)
- Download: https://huggingbay.xyz/artifact/hf-model-koboldai-mixtral-8x7b-holodeck-v1-gguf/files (download plan: https://huggingbay.xyz/api/artifacts/hf-model-koboldai-mixtral-8x7b-holodeck-v1-gguf/download-plan)
- Per-file SHA-256: available for 1 of 1 hosted file via https://huggingbay.xyz/api/artifacts/hf-model-koboldai-mixtral-8x7b-holodeck-v1-gguf/files?limit=100
- Run-ready: no (Hugging Bay has not certified a run path for this model; hosted bytes are downloadable and hash-checkable only)
- Peer-assisted fallbacks: 0 verified, 0 pending review
- Downloads: 59
- Stars: 15
- Card completeness: 92%

## Description

External Hugging Face catalog record for KoboldAI/Mixtral-8x7B-Holodeck-v1-GGUF. Task: text generation. Library: pytorch. Languages: en. Popularity signal at import: 3,019 downloads and 15 likes.

## Model Card Facts

- Declared license: apache-2.0
- Pipeline: text-generation
- Library: pytorch
- Task categories: text-generation
- Languages: en
- File hints: 16 upstream file samples

## File Hints

- .gitattributes (1.5 KB)
- Mixtral-8x7B-holodeck-v1.Q2_K.gguf (16 GB) LFS
- Mixtral-8x7B-holodeck-v1.Q3_K_L.gguf (23 GB) LFS
- Mixtral-8x7B-holodeck-v1.Q3_K_M.gguf (21 GB) LFS
- Mixtral-8x7B-holodeck-v1.Q3_K_S.gguf (19 GB) LFS
- Mixtral-8x7B-holodeck-v1.Q4_0.gguf (25 GB) LFS
- Mixtral-8x7B-holodeck-v1.Q4_1.gguf (27 GB) LFS
- Mixtral-8x7B-holodeck-v1.Q4_K_M.gguf (26 GB) LFS
- Mixtral-8x7B-holodeck-v1.Q4_K_S.gguf (25 GB) LFS
- Mixtral-8x7B-holodeck-v1.Q5_0.gguf (30 GB) LFS
- Mixtral-8x7B-holodeck-v1.Q5_1.gguf (33 GB) LFS
- Mixtral-8x7B-holodeck-v1.Q5_K_M.gguf (31 GB) LFS

## Quality Checklist

- Summary: passed
- Description: passed
- Model card metadata: passed
- License: passed
- Provenance: passed
- File inventory: passed
- Hosted bytes: passed
- Scan result: passed
- Manifest signature: passed

## Safety Notes

- External catalog metadata imported from Hugging Face public API on 2026-09-22T05:59:17.406Z.
- Open license detected as apache-2.0.
- Not a run kit: hosted, hash-checked bytes only; run readiness is not certified for this model yet.

## Actions

- Web: https://huggingbay.xyz/artifact/hf-model-koboldai-mixtral-8x7b-holodeck-v1-gguf
- Files API: https://huggingbay.xyz/api/artifacts/hf-model-koboldai-mixtral-8x7b-holodeck-v1-gguf/files?limit=100
- Metadata: https://huggingbay.xyz/api/artifacts/hf-model-koboldai-mixtral-8x7b-holodeck-v1-gguf/metadata.json
- Distribution: https://huggingbay.xyz/api/artifacts/hf-model-koboldai-mixtral-8x7b-holodeck-v1-gguf/distribution
- Manifest: https://huggingbay.xyz/api/manifests/hf-model-koboldai-mixtral-8x7b-holodeck-v1-gguf
- Download plan (per-file SHA-256 + signed download URLs): https://huggingbay.xyz/api/artifacts/hf-model-koboldai-mixtral-8x7b-holodeck-v1-gguf/download-plan
- Hosted download rows: https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-koboldai-mixtral-8x7b-holodeck-v1-gguf&limit=100
- Request mirror: not applicable.
- Submit peer fallback for review: POST https://huggingbay.xyz/api/artifacts/hf-model-koboldai-mixtral-8x7b-holodeck-v1-gguf/decentralized-fallbacks