# mradermacher/Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF

Model from Hugging Face for llm: mradermacher/Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF · transformers

## Facts

- Type: LLM
- Task: general
- Framework: transformers
- License: apache-2.0 — Permissive open license: commercial use, modification, and redistribution are permitted. (https://spdx.org/licenses/Apache-2.0.html)
- Source: https://huggingface.co/mradermacher/Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF
- Hosting: hosted (1 file)
- Files: 1 hosted of 16 listed
- File counts: "listed" is every file in the source repository; only hosted files download from Hugging Bay, and the download plan lists the files it selects for one download, so its count can differ.
- Hosted here: 1 file, 28.4 GB
- Full repo upstream: 379.7 GB
- Recommended file: 28.4 GB (Q4_K_M) · Nous-Hermes-2-Mixtral-8x7B-SFT.Q4_K_M.gguf
- Parameters: 56B (14B active)
- Download: https://huggingbay.xyz/artifact/hf-model-mradermacher-nous-hermes-2-mixtral-8x7b-sft-gguf/files (download plan: https://huggingbay.xyz/api/artifacts/hf-model-mradermacher-nous-hermes-2-mixtral-8x7b-sft-gguf/download-plan)
- Per-file SHA-256: available for 1 of 1 hosted file via https://huggingbay.xyz/api/artifacts/hf-model-mradermacher-nous-hermes-2-mixtral-8x7b-sft-gguf/files?limit=100
- Run-ready: no (Hugging Bay has not certified a run path for this model; hosted bytes are downloadable and hash-checkable only)
- Peer-assisted fallbacks: 0 verified, 0 pending review
- Downloads: 38
- Stars: 1
- Card completeness: 95%

## Description

External Hugging Face catalog record for mradermacher/Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF. Library: transformers. Languages: en. Datasets referenced by card metadata: teknium/OpenHermes-2.5. Base model: NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT. Popularity signal at import: 2,257 downloads and 1 likes.

## Model Card Facts

- Declared license: apache-2.0
- Pipeline: general
- Library: transformers
- Base model: NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT
- Task categories: general
- Languages: en
- Referenced datasets: teknium/OpenHermes-2.5
- File hints: 16 upstream file samples

## Referenced Data

- Dataset: teknium/OpenHermes-2.5

## File Hints

- .gitattributes (2.6 KB)
- Nous-Hermes-2-Mixtral-8x7B-SFT.IQ3_M.gguf (20 GB) LFS
- Nous-Hermes-2-Mixtral-8x7B-SFT.IQ3_S.gguf (19 GB) LFS
- Nous-Hermes-2-Mixtral-8x7B-SFT.IQ3_XS.gguf (18 GB) LFS
- Nous-Hermes-2-Mixtral-8x7B-SFT.IQ4_XS.gguf (24 GB) LFS
- Nous-Hermes-2-Mixtral-8x7B-SFT.Q2_K.gguf (16 GB) LFS
- Nous-Hermes-2-Mixtral-8x7B-SFT.Q3_K_L.gguf (23 GB) LFS
- Nous-Hermes-2-Mixtral-8x7B-SFT.Q3_K_M.gguf (21 GB) LFS
- Nous-Hermes-2-Mixtral-8x7B-SFT.Q3_K_S.gguf (19 GB) LFS
- Nous-Hermes-2-Mixtral-8x7B-SFT.Q4_K_M.gguf (26 GB) LFS
- Nous-Hermes-2-Mixtral-8x7B-SFT.Q4_K_S.gguf (25 GB) LFS
- Nous-Hermes-2-Mixtral-8x7B-SFT.Q5_K_M.gguf (31 GB) LFS

## Quality Checklist

- Summary: passed
- Description: passed
- Model card metadata: passed
- License: passed
- Provenance: passed
- File inventory: passed
- Hosted bytes: passed
- Scan result: passed
- Manifest signature: passed

## Safety Notes

- External catalog metadata imported from Hugging Face public API on 2026-09-17T00:46:54.488Z.
- Upstream license: apache-2.0. Mirror admission policy: permissive (owner policy; no license rights inferred).
- Model card references dataset context: teknium/OpenHermes-2.5.
- Not a run kit: hosted, hash-checked bytes only; run readiness is not certified for this model yet.

## Actions

- Web: https://huggingbay.xyz/artifact/hf-model-mradermacher-nous-hermes-2-mixtral-8x7b-sft-gguf
- Files API: https://huggingbay.xyz/api/artifacts/hf-model-mradermacher-nous-hermes-2-mixtral-8x7b-sft-gguf/files?limit=100
- Metadata: https://huggingbay.xyz/api/artifacts/hf-model-mradermacher-nous-hermes-2-mixtral-8x7b-sft-gguf/metadata.json
- Distribution: https://huggingbay.xyz/api/artifacts/hf-model-mradermacher-nous-hermes-2-mixtral-8x7b-sft-gguf/distribution
- Manifest: https://huggingbay.xyz/api/manifests/hf-model-mradermacher-nous-hermes-2-mixtral-8x7b-sft-gguf
- Download plan (per-file SHA-256 + signed download URLs): https://huggingbay.xyz/api/artifacts/hf-model-mradermacher-nous-hermes-2-mixtral-8x7b-sft-gguf/download-plan
- Hosted download rows: https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-mradermacher-nous-hermes-2-mixtral-8x7b-sft-gguf&limit=100
- Request mirror: not applicable.
- Submit peer fallback for review: POST https://huggingbay.xyz/api/artifacts/hf-model-mradermacher-nous-hermes-2-mixtral-8x7b-sft-gguf/decentralized-fallbacks