avey-ai/avey1-dpa-0.1B-100BT
Text Generation • 0.2B • Updated • 31
Don't Pay Attention
All model checkpoints trained for the Don't Pay Attention paper.
-
-
avey-ai/avey1-dpa-0.1B-95BT
Text Generation • 0.2B • Updated • 13 -
avey-ai/avey1-dpa-0.1B-90BT
Text Generation • 0.2B • Updated • 15 -
avey-ai/avey1-dpa-0.5B-100BT
Text Generation • 0.5B • Updated • 17 -
avey-ai/avey1-dpa-0.5B-95BT
0.5B • Updated • 3 -
avey-ai/avey1-dpa-0.5B-90BT
Text Generation • 0.5B • Updated • 16 -
avey-ai/avey1-dpa-1.5B-100BT
Text Generation • 2B • Updated • 14 -
avey-ai/avey1-dpa-1.5B-95BT
Text Generation • 2B • Updated • 19 -
avey-ai/avey1-dpa-1.5B-90BT
Text Generation • 2B • Updated • 16 -
avey-ai/mamba-dpa-0.1B-100BT
Text Generation • Updated • 15 -
avey-ai/mamba-dpa-0.1B-95BT
Text Generation • Updated • 13 -
avey-ai/mamba-dpa-0.1B-90BT
Text Generation • Updated • 18 -
avey-ai/mamba-dpa-0.5B-100BT
Text Generation • Updated • 16 -
avey-ai/mamba-dpa-0.5B-95BT
Text Generation • Updated • 24 -
avey-ai/mamba-dpa-0.5B-90BT
Text Generation • Updated • 18 -
avey-ai/mamba-dpa-1.5B-100BT
Text Generation • Updated • 17 -
avey-ai/mamba-dpa-1.5B-95BT
Text Generation • Updated • 23 -
avey-ai/mamba-dpa-1.5B-90BT
Text Generation • Updated • 41 -
avey-ai/rwkv7-dpa-0.1B-100BT
Text Generation • 0.2B • Updated • 24 -
avey-ai/rwkv7-dpa-0.1B-95BT
Text Generation • 0.2B • Updated • 17 -
avey-ai/rwkv7-dpa-0.1B-90BT
Text Generation • 0.2B • Updated • 23 -
avey-ai/rwkv7-dpa-0.5B-100BT
Text Generation • 0.5B • Updated • 21 -
avey-ai/rwkv7-dpa-0.5B-95BT
Text Generation • 0.5B • Updated • 24 -
avey-ai/rwkv7-dpa-0.5B-90BT
Text Generation • 0.5B • Updated • 23 -
avey-ai/rwkv7-dpa-1.5B-100BT
Text Generation • 1B • Updated • 19 -
avey-ai/rwkv7-dpa-1.5B-95BT
Text Generation • Updated -
avey-ai/rwkv7-dpa-1.5B-90BT
Text Generation • 1B • Updated • 16 -
avey-ai/tpp-dpa-0.1B-100BT
Text Generation • 0.2B • Updated • 19 -
avey-ai/tpp-dpa-0.1B-95BT
Text Generation • 0.2B • Updated • 16 -
avey-ai/tpp-dpa-0.1B-90BT
Text Generation • 0.2B • Updated • 16 -
avey-ai/tpp-dpa-0.5B-100BT
Text Generation • 0.5B • Updated • 14 -
avey-ai/tpp-dpa-0.5B-95BT
Text Generation • 0.5B • Updated • 18 -
avey-ai/tpp-dpa-0.5B-90BT
Text Generation • 0.5B • Updated • 21 -
avey-ai/tpp-dpa-1.5B-100BT
Text Generation • 2B • Updated • 13 -
avey-ai/tpp-dpa-1.5B-95BT
Text Generation • 2B • Updated • 18 -
avey-ai/tpp-dpa-1.5B-90BT
Text Generation • 2B • Updated • 12 -
Don't Pay Attention
Paper • 2506.11305 • Published • 8