Skip to main content

AI models that run on this device.

Two small chat models run in a computer’s browser here; every other model is a file you download.

mradermacher

DistillQwen-ThoughtY-8B-i1-GGUF

mradermacher/DistillQwen-ThoughtY-8B-i1-GGUF
generalLicense: apache-2.0Hashes recordedGGUF

Content controls: not assessed.

Model from Hugging Face for llm: mradermacher/DistillQwen-ThoughtY-8B-i1-GGUF · transformers

Model facts

DistillQwen-ThoughtY-8B-i1-GGUF is an open-weights language model for general. The primary file is DistillQwen-ThoughtY-8B.i1-Q4_K_M.gguf (5.03 GB, Q4_K_M). The primary file needs about 7 GB free for the Q4 file. License: Apache 2.0. The SHA-256 prefix is 593e3d1535fc. The primary Download is available now. No tested run commands for this file yet. Some listed files are available here. The size and hash details refer to the selected file, not every file in the repository. The memory figure is estimated from recorded file size with working room included. The size line uses recorded file bytes when they are present in this model record.

What's included

Weights24 files
README, LICENSE & .gitattributes2 files

About this model

External Hugging Face catalog record for mradermacher/DistillQwen-ThoughtY-8B-i1-GGUF. Library: transformers. Languages: en. Base model: alibaba-pai/DistillQwen-ThoughtY-8B. Popularity signal at import: 88 downloads and 0 likes.

Quick facts

Parameters
8B
Hosted here
1 file, 5.03 GB
Full repo upstream
96.4 GB
Recommended file
5.03 GB (Q4_K_M) · DistillQwen-ThoughtY-8B.i1-Q4_K_M.gguf
Languages
en
Format
GGUF
Files hosted
1 of 27
Downloads on Hugging Face
52
File hashes
Hashes recorded. Date not recorded.

License & source

License: apache-2.0

Check the license text and keep the required notices when you use or share the files.

Upstream source →

See the JSON record →

Task
general
Hosted here
1 file, 5.03 GB
Full repo upstream
96.4 GB
Recommended file
5.03 GB (Q4_K_M) · DistillQwen-ThoughtY-8B.i1-Q4_K_M.gguf
Parameters
8B
Files
1 hosted of 27 listed
Added to Hugging Bay
Updated at source

FAQ

What is this model?

mradermacher/DistillQwen-ThoughtY-8B-i1-GGUF is an open-weights language model for general published by mradermacher, added to Hugging Bay Jun 30, 2026. Model from Hugging Face for llm: mradermacher/DistillQwen-ThoughtY-8B-i1-GGUF · transformers

Can I use it commercially?

It is released under the apache-2.0 license. Commercial use is allowed. Permissive open license: commercial use, modification, and redistribution are permitted.

How big is it?

mradermacher/DistillQwen-ThoughtY-8B-i1-GGUF has 8B parameters. Hosted here: 1 file, 5.03 GB. Full repo upstream: 96.4 GB. The recommended download, DistillQwen-ThoughtY-8B.i1-Q4_K_M.gguf (Q4_K_M), is 5.03 GB.

What can I download here?

Hosted here: 1 file, 5.03 GB. Full repo upstream: 96.4 GB. The original release is at https://huggingface.co/mradermacher/DistillQwen-ThoughtY-8B-i1-GGUF.

File checks and computer fit
File pattern scans

Automated file-pattern scans flagged nothing; not a safety guarantee. 1 hosted file carries a published SHA-256 you can re-hash. The machine-readable verdict is at /api/artifacts/hf-model-mradermacher-distillqwen-thoughty-8b-i1-gguf/safety on Hugging Bay.

Will mradermacher/DistillQwen-ThoughtY-8B-i1-GGUF run on my computer?

We can’t check the fit; we don’t know your machine. We don’t have your machine’s specs, so no check ran and no verdict is shown. Answer two quick questions and we’ll estimate, from the memory you tell us, whether it fits your machine. Or skip it; you can still download; fit isn’t checked.

Repack of alibaba-pai/distillqwen-thoughty-8b (from the publisher card on Hugging Face). This does not mean the files match the original weights.