Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
ByteSpanTokenisers
/
fineweb-models
like
0
Follow
ByteSpan Tokenisers
4
Safetensors
Model card
Files
Files and versions
xet
Community
main
fineweb-models
2.76 GB
2 contributors
History:
4 commits
Zebulon Goriely
Upload model
da49dff
6 months ago
BPEWP_64000
Upload model
6 months ago
BPE_64000
Upload models
6 months ago
ByteSpanSurprisalCombinedFrequency_64000
Upload models
6 months ago
ByteSpanSurprisalCombinedSeeding_64000
Upload models
6 months ago
ByteSpanSurprisalGlobalIncrement_64000
Upload model
6 months ago
ByteSpanSurprisalMonotonicFrequency_64000
Upload models
6 months ago
ByteSpanSurprisalMonotonicSeeding_64000
Upload models
6 months ago
.gitattributes
1.52 kB
initial commit
6 months ago
