# ISTA-DASLab/Llama-3.1-70B-Instruct-2Bit-GSQ

Model from Hugging Face for text generation: ISTA-DASLab/Llama-3.1-70B-Instruct-2Bit-GSQ · transformers

## Facts

- Type: LLM
- Task: text-generation
- Framework: transformers
- License: llama3.1 — Commercial use is permitted with obligations: Llama community license: commercial use allowed; if your products/services exceeded 700 million monthly active users (Section 2, Additional Commercial Terms) you must request a license from Meta first; the acceptable-use policy and attribution notice apply.
- Source: https://huggingface.co/ISTA-DASLab/Llama-3.1-70B-Instruct-2Bit-GSQ
- Hosting: hosted (14 files)
- Files: 14 hosted of 16 listed
- File counts: "listed" is every file in the source repository; only hosted files download from Hugging Bay, and the download plan lists the files it selects for one download, so its count can differ.
- Hosted here: 14 files, 22.4 GB
- Full repo upstream: 22.4 GB
- Recommended file: 22.4 GB (8 files)
- Parameters: 70B
- Download: https://huggingbay.xyz/artifact/hf-model-ista-daslab-llama-3-1-70b-instruct-2bit-gsq/files (download plan: https://huggingbay.xyz/api/artifacts/hf-model-ista-daslab-llama-3-1-70b-instruct-2bit-gsq/download-plan)
- Per-file SHA-256: available for 14 of 14 hosted files via https://huggingbay.xyz/api/artifacts/hf-model-ista-daslab-llama-3-1-70b-instruct-2bit-gsq/files?limit=100
- Run-ready: no (Hugging Bay has not certified a run path for this model; hosted bytes are downloadable and hash-checkable only)
- Peer-assisted fallbacks: 0 verified, 0 pending review
- Downloads: 63
- Stars: 1
- Card completeness: 93%

## Description

External Hugging Face catalog record for ISTA-DASLab/Llama-3.1-70B-Instruct-2Bit-GSQ. Task: text generation. Library: transformers. Base model: meta-llama/Llama-3.1-70B-Instruct. Popularity signal at import: 63 downloads and 1 likes.

## Model Card Facts

- Declared license: llama3.1
- Pipeline: text-generation
- Library: transformers
- Base model: meta-llama/Llama-3.1-70B-Instruct
- Task categories: text-generation
- Paper ids: 2604.18556
- File hints: 16 upstream file samples

## Referenced Data

- Paper: 2604.18556

## File Hints

- .gitattributes (1.5 KB)
- README.md (4.8 KB)
- config.json (1.1 KB)
- generation_config.json (184 B)
- model-00001-of-00008.safetensors (2.4 GB) LFS
- model-00002-of-00008.safetensors (2.4 GB) LFS
- model-00003-of-00008.safetensors (2.4 GB) LFS
- model-00004-of-00008.safetensors (2.4 GB) LFS
- model-00005-of-00008.safetensors (2.4 GB) LFS
- model-00006-of-00008.safetensors (2.4 GB) LFS
- model-00007-of-00008.safetensors (2.4 GB) LFS
- model-00008-of-00008.safetensors (4.2 GB) LFS

## Quality Checklist

- Summary: passed
- Description: passed
- Model card metadata: passed
- License: review
- Provenance: passed
- File inventory: passed
- Hosted bytes: passed
- Scan result: passed
- Manifest signature: passed

## Safety Notes

- External catalog metadata imported from Hugging Face public API on 2026-09-19T11:59:55.302Z.
- Upstream license: llama3.1. Mirror admission policy: permissive (owner policy; no license rights inferred).
- Not a run kit: hosted, hash-checked bytes only; run readiness is not certified for this model yet.

## Actions

- Web: https://huggingbay.xyz/artifact/hf-model-ista-daslab-llama-3-1-70b-instruct-2bit-gsq
- Files API: https://huggingbay.xyz/api/artifacts/hf-model-ista-daslab-llama-3-1-70b-instruct-2bit-gsq/files?limit=100
- Metadata: https://huggingbay.xyz/api/artifacts/hf-model-ista-daslab-llama-3-1-70b-instruct-2bit-gsq/metadata.json
- Distribution: https://huggingbay.xyz/api/artifacts/hf-model-ista-daslab-llama-3-1-70b-instruct-2bit-gsq/distribution
- Manifest: https://huggingbay.xyz/api/manifests/hf-model-ista-daslab-llama-3-1-70b-instruct-2bit-gsq
- Download plan (per-file SHA-256 + signed download URLs): https://huggingbay.xyz/api/artifacts/hf-model-ista-daslab-llama-3-1-70b-instruct-2bit-gsq/download-plan
- Hosted download rows: https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-ista-daslab-llama-3-1-70b-instruct-2bit-gsq&limit=100
- Request mirror: not applicable.
- Submit peer fallback for review: POST https://huggingbay.xyz/api/artifacts/hf-model-ista-daslab-llama-3-1-70b-instruct-2bit-gsq/decentralized-fallbacks