# Qwen/Qwen2.5-3B-Instruct-GGUF

Model from Hugging Face for text generation: Qwen/Qwen2.5-3B-Instruct-GGUF · unknown

## Facts

- Type: LLM
- Task: text-generation
- Framework: unknown
- License: qwen-research-non-commercial — License carries a non-commercial restriction (non-commercial). Commercial use is not permitted. (https://huggingface.co/Qwen/Qwen2.5-3B-Instruct-GGUF/blob/main/LICENSE)
- Source: https://huggingface.co/Qwen/Qwen2.5-3B-Instruct-GGUF
- Hosting: hosted (1 file)
- Files: 1 hosted of 13 listed
- File counts: "listed" is every file in the source repository; only hosted files download from Hugging Bay, and the download plan lists the files it selects for one download, so its count can differ.
- Hosted here: 1 file, 2.1 GB
- Full repo upstream: 25.2 GB
- Recommended file: 2.1 GB (Q4_K_M) · qwen2.5-3b-instruct-q4_k_m.gguf
- Parameters: 3B
- Download: https://huggingbay.xyz/artifact/hf-model-qwen-qwen2-5-3b-instruct-gguf/files (download plan: https://huggingbay.xyz/api/artifacts/hf-model-qwen-qwen2-5-3b-instruct-gguf/download-plan)
- Per-file SHA-256: available for 1 of 1 hosted file via https://huggingbay.xyz/api/artifacts/hf-model-qwen-qwen2-5-3b-instruct-gguf/files?limit=100
- Run-ready: no (Hugging Bay has not certified a run path for this model; hosted bytes are downloadable and hash-checkable only)
- Peer-assisted fallbacks: 0 verified, 0 pending review
- Downloads: 324592
- Stars: 186
- Card completeness: 96%

## Description

External Hugging Face catalog record for Qwen/Qwen2.5-3B-Instruct-GGUF. Task: text generation. Library: unknown. Languages: en. Base model: Qwen/Qwen2.5-3B-Instruct. Popularity signal at import: 324,592 downloads and 186 likes.

## Model Card Facts

- Declared license: other
- Pipeline: text-generation
- Library: unknown
- Base model: Qwen/Qwen2.5-3B-Instruct
- Task categories: text-generation
- Languages: en
- Paper ids: 2407.10671
- File hints: 13 upstream file samples

## Referenced Data

- Paper: 2407.10671

## File Hints

- .gitattributes (1.5 KB)
- LICENSE (7.2 KB)
- README.md (4.8 KB)
- qwen2.5-3b-instruct-fp16-00001-of-00002.gguf (3.7 GB) LFS
- qwen2.5-3b-instruct-fp16-00002-of-00002.gguf (2.6 GB) LFS
- qwen2.5-3b-instruct-q2_k.gguf (1.3 GB) LFS
- qwen2.5-3b-instruct-q3_k_m.gguf (1.6 GB) LFS
- qwen2.5-3b-instruct-q4_0.gguf (1.9 GB) LFS
- qwen2.5-3b-instruct-q4_k_m.gguf (2.0 GB) LFS
- qwen2.5-3b-instruct-q5_0.gguf (2.2 GB) LFS
- qwen2.5-3b-instruct-q5_k_m.gguf (2.3 GB) LFS
- qwen2.5-3b-instruct-q6_k.gguf (2.6 GB) LFS

## Quality Checklist

- Summary: passed
- Description: passed
- Model card metadata: passed
- License: review
- Provenance: passed
- File inventory: passed
- Hosted bytes: passed
- Scan result: passed
- Manifest signature: passed

## Safety Notes

- External catalog metadata imported from Hugging Face public API on 2026-09-18T05:00:54.220Z.
- Upstream license: other. Mirror admission policy: permissive (owner policy; no license rights inferred).
- Not a run kit: hosted, hash-checked bytes only; run readiness is not certified for this model yet.

## Actions

- Web: https://huggingbay.xyz/artifact/hf-model-qwen-qwen2-5-3b-instruct-gguf
- Files API: https://huggingbay.xyz/api/artifacts/hf-model-qwen-qwen2-5-3b-instruct-gguf/files?limit=100
- Metadata: https://huggingbay.xyz/api/artifacts/hf-model-qwen-qwen2-5-3b-instruct-gguf/metadata.json
- Distribution: https://huggingbay.xyz/api/artifacts/hf-model-qwen-qwen2-5-3b-instruct-gguf/distribution
- Manifest: https://huggingbay.xyz/api/manifests/hf-model-qwen-qwen2-5-3b-instruct-gguf
- Download plan (per-file SHA-256 + signed download URLs): https://huggingbay.xyz/api/artifacts/hf-model-qwen-qwen2-5-3b-instruct-gguf/download-plan
- Hosted download rows: https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-qwen-qwen2-5-3b-instruct-gguf&limit=100
- Request mirror: not applicable.
- Submit peer fallback for review: POST https://huggingbay.xyz/api/artifacts/hf-model-qwen-qwen2-5-3b-instruct-gguf/decentralized-fallbacks