Rx_Codex_Tokenizer / token_count_comparison.png
rxmha125's picture
Upload token_count_comparison.png with huggingface_hub
65af7d4 verified
token_count_comparison.png

Large File Pointer Details

( Raw pointer file )
SHA256:
01aeaf7b4ebc07e1509c77963a88a56c0343c01498c6df173112d609d4d2c361
Pointer size:
131 Bytes
·
Size of remote file:
378 kB
·
Xet hash:
e5073322740ce2dade2ed5b53dec96d3c4817e96b920c9a177953fca8fc2af90

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.