# mjbommar/magic-bert-50m-roformer-mlm

Model from Hugging Face for fill mask: mjbommar/magic-bert-50m-roformer-mlm · transformers

## Facts

- Type: LLM
- Task: fill-mask
- Framework: transformers
- License: apache-2.0 — Permissive open license: commercial use, modification, and redistribution are permitted. (https://spdx.org/licenses/Apache-2.0.html)
- Source: https://huggingface.co/mjbommar/magic-bert-50m-roformer-mlm
- Hosting: hosted (4 files)
- Files: 4 hosted of 7 listed
- File counts: "listed" is every file in the source repository; only hosted files download from Hugging Bay, and the download plan lists the files it selects for one download, so its count can differ.
- Hosted here: 4 files, 171.6 MB
- Full repo upstream: 171.6 MB
- Recommended file: 169.3 MB · model.safetensors
- Parameters: 50M
- Download: https://huggingbay.xyz/artifact/hf-model-mjbommar-magic-bert-50m-roformer-mlm/files (download plan: https://huggingbay.xyz/api/artifacts/hf-model-mjbommar-magic-bert-50m-roformer-mlm/download-plan)
- Per-file SHA-256: available for 4 of 4 hosted files via https://huggingbay.xyz/api/artifacts/hf-model-mjbommar-magic-bert-50m-roformer-mlm/files?limit=100
- Run-ready: no (Hugging Bay has not certified a run path for this model; hosted bytes are downloadable and hash-checkable only)
- Peer-assisted fallbacks: 0 verified, 0 pending review
- Downloads: 39
- Stars: 0
- Card completeness: 96%

## Description

External Hugging Face catalog record for mjbommar/magic-bert-50m-roformer-mlm. Task: fill mask. Library: transformers. Languages: en. Includes 4 model-card evaluation signals. Files we host have a published SHA-256.

## Model Card Facts

- Declared license: apache-2.0
- Pipeline: fill-mask
- Library: transformers
- Task categories: fill-mask
- Languages: en
- Paper ids: 2511.17573
- Model-index entries: magic-bert-50m-roformer-mlm
- Evaluation signals: 4 model-card eval results
- File hints: 7 upstream file samples

## Evaluation Signals

- magic-bert-50m-roformer-mlm: Perplexity = 1.13 (Masked Language Modeling)
- magic-bert-50m-roformer-mlm: Fill-mask Top-1 Accuracy = 61.8 (Masked Language Modeling)
- magic-bert-50m-roformer-mlm: Fill-mask Top-5 Accuracy = 75.1 (Masked Language Modeling)
- magic-bert-50m-roformer-mlm: Probing Classification Accuracy = 85 (Masked Language Modeling)

## Referenced Data

- Paper: 2511.17573

## File Hints

- .gitattributes (1.5 KB)
- README.md (11 KB)
- config.json (545 B)
- mime_type_mapping.json (3.1 KB)
- model.safetensors (161 MB) LFS
- tokenizer.json (2.1 MB)
- tokenizer_config.json (264 B)

## Quality Checklist

- Summary: passed
- Description: passed
- Model card metadata: passed
- License: passed
- Provenance: passed
- File inventory: passed
- Hosted bytes: passed
- Scan result: passed
- Manifest signature: passed

## Safety Notes

- External catalog metadata imported from Hugging Face public API on 2026-10-01T08:59:39.285Z.
- Open license detected as apache-2.0.
- Model-index metadata found for magic-bert-50m-roformer-mlm.
- Not a run kit: hosted, hash-checked bytes only; run readiness is not certified for this model yet.

## Actions

- Web: https://huggingbay.xyz/artifact/hf-model-mjbommar-magic-bert-50m-roformer-mlm
- Files API: https://huggingbay.xyz/api/artifacts/hf-model-mjbommar-magic-bert-50m-roformer-mlm/files?limit=100
- Metadata: https://huggingbay.xyz/api/artifacts/hf-model-mjbommar-magic-bert-50m-roformer-mlm/metadata.json
- Distribution: https://huggingbay.xyz/api/artifacts/hf-model-mjbommar-magic-bert-50m-roformer-mlm/distribution
- Manifest: https://huggingbay.xyz/api/manifests/hf-model-mjbommar-magic-bert-50m-roformer-mlm
- Download plan (per-file SHA-256 + signed download URLs): https://huggingbay.xyz/api/artifacts/hf-model-mjbommar-magic-bert-50m-roformer-mlm/download-plan
- Hosted download rows: https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-mjbommar-magic-bert-50m-roformer-mlm&limit=100
- Request mirror: not applicable.
- Submit peer fallback for review: POST https://huggingbay.xyz/api/artifacts/hf-model-mjbommar-magic-bert-50m-roformer-mlm/decentralized-fallbacks