# polyglot-tagger/language-identification

Model from Hugging Face for token classification: polyglot-tagger/language-identification · transformers

## Facts

- Type: LLM
- Task: token-classification
- Framework: transformers
- License: mit — Permissive open license: commercial use, modification, and redistribution are permitted. (https://spdx.org/licenses/MIT.html)
- Source: https://huggingface.co/polyglot-tagger/language-identification
- Hosting: hosted (4 files)
- Files: 4 hosted of 10 listed
- File counts: "listed" is every file in the source repository; only hosted files download from Hugging Bay, and the download plan lists the files it selects for one download, so its count can differ.
- Hosted here: 4 files, 1.13 GB
- Full repo upstream: 1.13 GB
- Recommended file: 1.11 GB · model.safetensors
- Download: https://huggingbay.xyz/artifact/hf-model-polyglot-tagger-language-identification/files (download plan: https://huggingbay.xyz/api/artifacts/hf-model-polyglot-tagger-language-identification/download-plan)
- Per-file SHA-256: available for 4 of 4 hosted files via https://huggingbay.xyz/api/artifacts/hf-model-polyglot-tagger-language-identification/files?limit=100
- Run-ready: no (Hugging Bay has not certified a run path for this model; hosted bytes are downloadable and hash-checkable only)
- Peer-assisted fallbacks: 0 verified, 0 pending review
- Downloads: 58
- Stars: 0
- Card completeness: 96%

## Description

External Hugging Face catalog record for polyglot-tagger/language-identification. Task: token classification. Library: transformers. Languages: multilingual, af, am, ar, as, ba, be, bg. Datasets referenced by card metadata: wikimedia/wikipedia, HuggingFaceFW/finetranslations, google/smol, polyglot-tagger/nlp-noise-snippets, polyglot-tagger/wikipedia-language-snippets-filtered, polyglot-tagger/finetranslations-filtered. Base model: xlm-roberta-base. Popularity signal at import: 58 downloads and 0 likes.

## Model Card Facts

- Declared license: mit
- Pipeline: token-classification
- Library: transformers
- Base model: xlm-roberta-base
- Task categories: token-classification
- Languages: multilingual, af, am, ar, as, ba, be, bg
- Referenced datasets: wikimedia/wikipedia, HuggingFaceFW/finetranslations, google/smol, polyglot-tagger/nlp-noise-snippets, polyglot-tagger/wikipedia-language-snippets-filtered, polyglot-tagger/finetranslations-filtered, polyglot-tagger/tatoeba-filtered
- Metrics: precision, recall, f1, accuracy
- Model-index entries: polyglot-tagger
- File hints: 10 upstream file samples

## Referenced Data

- Dataset: wikimedia/wikipedia
- Dataset: HuggingFaceFW/finetranslations
- Dataset: google/smol
- Dataset: polyglot-tagger/nlp-noise-snippets
- Dataset: polyglot-tagger/wikipedia-language-snippets-filtered
- Dataset: polyglot-tagger/finetranslations-filtered
- Dataset: polyglot-tagger/tatoeba-filtered

## File Hints

- .gitattributes (1.5 KB)
- README.md (19 KB)
- config.json (8.0 KB)
- model.safetensors (1.0 GB) LFS
- runs/Apr18_07-28-03_eb1a4e9ac74e/events.out.tfevents.1776497283.eb1a4e9ac74e.8611.1 (153 KB) LFS
- runs/Apr18_23-31-44_8a990ec18c22/events.out.tfevents.1776555104.8a990ec18c22.4420.0 (179 KB) LFS
- tokenizer.json (16 MB) LFS
- tokenizer_config.json (314 B)
- trainer_state.json (124 KB)
- training_args.bin (5.1 KB) LFS

## Quality Checklist

- Summary: passed
- Description: passed
- Model card metadata: passed
- License: passed
- Provenance: passed
- File inventory: passed
- Hosted bytes: passed
- Scan result: passed
- Manifest signature: passed

## Safety Notes

- External catalog metadata imported from Hugging Face public API on 2026-09-24T20:43:54.913Z.
- Open license detected as mit.
- Model-index metadata found for polyglot-tagger.
- Model card references dataset context: wikimedia/wikipedia, HuggingFaceFW/finetranslations, google/smol, polyglot-tagger/nlp-noise-snippets.
- Not a run kit: hosted, hash-checked bytes only; run readiness is not certified for this model yet.

## Actions

- Web: https://huggingbay.xyz/artifact/hf-model-polyglot-tagger-language-identification
- Files API: https://huggingbay.xyz/api/artifacts/hf-model-polyglot-tagger-language-identification/files?limit=100
- Metadata: https://huggingbay.xyz/api/artifacts/hf-model-polyglot-tagger-language-identification/metadata.json
- Distribution: https://huggingbay.xyz/api/artifacts/hf-model-polyglot-tagger-language-identification/distribution
- Manifest: https://huggingbay.xyz/api/manifests/hf-model-polyglot-tagger-language-identification
- Download plan (per-file SHA-256 + signed download URLs): https://huggingbay.xyz/api/artifacts/hf-model-polyglot-tagger-language-identification/download-plan
- Hosted download rows: https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-polyglot-tagger-language-identification&limit=100
- Request mirror: not applicable.
- Submit peer fallback for review: POST https://huggingbay.xyz/api/artifacts/hf-model-polyglot-tagger-language-identification/decentralized-fallbacks