hotchpotch/fineweb-2-japanese-text-cleaner file inventory
Browse hosted and upstream file records for hotchpotch/fineweb-2-japanese-text-cleaner. Check its Run page for complete-kit status.
- Hosting
- hosted
- Hosted files
- 5
- Tool
- any
Run status: unknown. These file records do not make a complete run kit.
- .gitattributes
- README.md
- config.json - sha256
57d09053f70dbbf6325ee1f8190902c72e0b5c010f95d8d995dae8a6e8a87bd9- download this file - model.safetensors - sha256
fe29aadeb1bea93865a2ed4f00eb5f62c906a58c81fd9b46145dcf7da286c28b- download this file - scripts/noise_detecter.py
- scripts/trainer-fineweb-2-japanese-text-cleaner.py
- sentencepiece.bpe.model - sha256
cfc8146abe2a0488e9e2a0c56de7952f7c11ab059eca145a0a727afce0db2865 - special_tokens_map.json - sha256
8c785abebea9ae3257b61681b4e6fd8365ceafde980c21970d001e834cf10835- download this file - tokenizer.json - sha256
8bf8afbfd11306bd872018c53bfdf2e160a56f8edbcf49933324404791c148d3- download this file - tokenizer_config.json - sha256
1f1da705376a51b242d5c48221c0cfa30a398e2bb247a487dee750a25a9e42cb- download this file - training_args.bin - sha256
c94ab776e6c2feedcb07e9ca42f845aab1cb2c41ac0996b6817d4cc9a82d4f95