Models

hillfieldhonest/aozoranemo292m

Text Generation • 0.3B • Updated Sep 26, 2025

Sai5480/monolingual-tokenizer-iso-asm-vocab-128000

Updated Sep 26, 2025

Sai5480/monolingual-tokenizer-iso-ben-vocab-128000

Updated Sep 26, 2025

Sai5480/monolingual-tokenizer-iso-gom-vocab-128000

Updated Sep 26, 2025

Sai5480/monolingual-tokenizer-iso-guj-vocab-128000

Updated Sep 26, 2025

Sai5480/monolingual-tokenizer-iso-hin-vocab-128000

Updated Sep 26, 2025 • 1

Sai5480/monolingual-tokenizer-iso-kan-vocab-128000

Updated Sep 26, 2025

Sai5480/monolingual-tokenizer-iso-mai-vocab-128000

Updated Sep 26, 2025

Sai5480/monolingual-tokenizer-iso-mal-vocab-128000

Updated Sep 26, 2025

Msok99/km-improved-22k

Updated Oct 9, 2025

Msok99/km-improved-32k

Updated Oct 9, 2025

Msok99/km-improved-22k-v4

Updated Oct 9, 2025

Msok99/km-bpe-md-v3-spm

Updated Oct 8, 2025

phmd/TinyStories-SRL-5M

Text Generation • Updated Oct 12, 2025 • 6

mavietduc/ViTay-translation

Translation • Updated Nov 13, 2025 • 1

arabovs-ai-lab/TatarTokenizers

Updated Nov 20, 2025

ryanscottbarrett/braille256-v3

Text Generation • Updated Dec 21, 2025 • 1

ryanscottbarrett/braille256-v4

Text Generation • Updated Dec 21, 2025 • 2

dovcharenko/veda-1b-uk16k-pretrain

Text Generation • Updated Jan 24 • 2

dovcharenko/spm_uk_64k

Updated Jan 27

somu9/gbm-tokenizer

Updated Jan 30 • 1

Tianqin-Meng/sentencepiece-code-logs-32k

Updated Feb 1

Bapynshngain/enkha-hybrid-tokenizer

Text Generation • Updated Feb 6 • 5

mncai/hunmin-13B-A2B-v0.11-base

0.3B • Updated 29 days ago • 51 • 3

stukenov/sozkz-vocab-sp-32k-kk-t5-v1

Updated 26 days ago

BrandenTung/t5-zh-en-opus

Translation • 37.6M • Updated 23 days ago • 19

openpecha/BoSentencePiece

Updated 4 days ago

jeshw/nmt-transformer-nl-en-ted-iwslt

Translation • Updated 18 days ago

stukenov/kzcalm-sp-tokenizer-4k-kk-v1

Updated 18 days ago

openeurollm/tokenizer-256k

Updated 15 days ago • 1