The Functionalizer: Lossless Functional Decomposition for Subword Tokenization
Paper • 2609.15991 • Published • 18
Functionalizer-100M
-
-
mrkwanzaa/functionalizer-100M-fineweb-edu-seed1
Text Generation • 97.7M • Updated • 238 -
mrkwanzaa/functionalizer-100M-fineweb-edu-seed2
Text Generation • 97.7M • Updated • 239 -
mrkwanzaa/functionalizer-100M-fineweb-edu-seed3
Text Generation • 97.7M • Updated • 242 -
mrkwanzaa/functionalizer-100M-fineweb-edu-seed4
Text Generation • 97.7M • Updated • 252 -
mrkwanzaa/functionalizer-100M-fineweb-edu-seed5
Text Generation • 97.7M • Updated • 242 -
mrkwanzaa/functionalizer-100M-github-code-python-seed1
Text Generation • 97.7M • Updated • 313 -
mrkwanzaa/functionalizer-100M-github-code-python-seed2
Text Generation • 97.7M • Updated • 339 -
mrkwanzaa/functionalizer-100M-github-code-python-seed3
Text Generation • 97.7M • Updated • 338 -
mrkwanzaa/functionalizer-100M-github-code-python-seed4
Text Generation • 97.7M • Updated • 313 -
mrkwanzaa/functionalizer-100M-github-code-python-seed5
Text Generation • 97.7M • Updated • 320