# TheBloke/openchat-3.5-0106-GGUF

Model from Hugging Face for text generation: TheBloke/openchat-3.5-0106-GGUF · transformers

## Facts

- Type: LLM
- Task: text-generation
- Framework: transformers
- License: apache-2.0 — Permissive open license: commercial use, modification, and redistribution are permitted. (https://spdx.org/licenses/Apache-2.0.html)
- Source: https://huggingface.co/TheBloke/openchat-3.5-0106-GGUF
- Hosting: hosted (5 files)
- Files: 5 hosted of 19 listed
- File counts: "listed" is every file in the source repository; only hosted files download from Hugging Bay, and the download plan lists the files it selects for one download, so its count can differ.
- Hosted here: at least 5 listed files; full count and size unknown
- Full repo upstream: 55 GB
- Recommended file: 4.37 GB (Q4_K_M) · openchat-3.5-0106.Q4_K_M.gguf
- Download: https://huggingbay.xyz/artifact/hf-model-thebloke-openchat-3-5-0106-gguf/files (download plan: https://huggingbay.xyz/api/artifacts/hf-model-thebloke-openchat-3-5-0106-gguf/download-plan)
- Per-file SHA-256: available for 5 of 5 hosted files via https://huggingbay.xyz/api/artifacts/hf-model-thebloke-openchat-3-5-0106-gguf/files?limit=100
- Run-ready: no (Hugging Bay has not certified a run path for this model; hosted bytes are downloadable and hash-checkable only)
- Peer-assisted fallbacks: 0 verified, 0 pending review
- Downloads: 765
- Stars: 75
- Card completeness: 93%

## Description

External Hugging Face catalog record for TheBloke/openchat-3.5-0106-GGUF. Task: text generation. Library: transformers. Base model: openchat/openchat-3.5-0106. Popularity signal at import: 1,446 downloads and 75 likes.

## Model Card Facts

- Declared license: apache-2.0
- Pipeline: text-generation
- Library: transformers
- Base model: openchat/openchat-3.5-0106
- Task categories: text-generation
- Paper ids: 2309.11235, 2303.08774
- File hints: 15 upstream file samples

## Referenced Data

- Paper: 2309.11235
- Paper: 2303.08774

## File Hints

- .gitattributes (2.2 KB)
- README.md (33 KB)
- config.json (31 B)
- openchat-3.5-0106.Q2_K.gguf (2.9 GB) LFS
- openchat-3.5-0106.Q3_K_L.gguf (3.6 GB) LFS
- openchat-3.5-0106.Q3_K_M.gguf (3.3 GB) LFS
- openchat-3.5-0106.Q3_K_S.gguf (2.9 GB) LFS
- openchat-3.5-0106.Q4_0.gguf (3.8 GB) LFS
- openchat-3.5-0106.Q4_K_M.gguf (4.1 GB) LFS
- openchat-3.5-0106.Q4_K_S.gguf (3.9 GB) LFS
- openchat-3.5-0106.Q5_0.gguf (4.7 GB) LFS
- openchat-3.5-0106.Q5_K_M.gguf (4.8 GB) LFS

## Quality Checklist

- Summary: passed
- Description: passed
- Model card metadata: passed
- License: passed
- Provenance: passed
- File inventory: passed
- Hosted bytes: passed
- Scan result: passed
- Manifest signature: passed

## Safety Notes

- External catalog metadata imported from Hugging Face public API on 2026-09-24T07:45:58.516Z.
- Open license detected as apache-2.0.
- Not a run kit: hosted, hash-checked bytes only; run readiness is not certified for this model yet.

## Actions

- Web: https://huggingbay.xyz/artifact/hf-model-thebloke-openchat-3-5-0106-gguf
- Files API: https://huggingbay.xyz/api/artifacts/hf-model-thebloke-openchat-3-5-0106-gguf/files?limit=100
- Metadata: https://huggingbay.xyz/api/artifacts/hf-model-thebloke-openchat-3-5-0106-gguf/metadata.json
- Distribution: https://huggingbay.xyz/api/artifacts/hf-model-thebloke-openchat-3-5-0106-gguf/distribution
- Manifest: https://huggingbay.xyz/api/manifests/hf-model-thebloke-openchat-3-5-0106-gguf
- Download plan (per-file SHA-256 + signed download URLs): https://huggingbay.xyz/api/artifacts/hf-model-thebloke-openchat-3-5-0106-gguf/download-plan
- Hosted download rows: https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-thebloke-openchat-3-5-0106-gguf&limit=100
- Request mirror: not applicable.
- Submit peer fallback for review: POST https://huggingbay.xyz/api/artifacts/hf-model-thebloke-openchat-3-5-0106-gguf/decentralized-fallbacks