Pre-computed Q-Filters for efficient KV cache compression.
Nathan Godey
nthngdy
AI & ML interests
None yet
Recent Activity
updated a model about 15 hours ago
nthngdy/matryoshka-200M updated a model 4 days ago
nthngdy/matryoshka-baselines published a model 4 days ago
nthngdy/matryoshka-200MOrganizations
models 62
nthngdy/matryoshka-200M
Text Generation • 0.3B • Updated • 1.69k
nthngdy/matryoshka-3B
Text Generation • 3B • Updated • 1.86k
nthngdy/matryoshka-1B
Text Generation • 1B • Updated • 1.89k
nthngdy/matryoshka-baselines
Updated • 1.02k
nthngdy/matritest_1B
Text Generation • 0.6B • Updated • 9
nthngdy/matritest_600M
Text Generation • 0.4B • Updated • 6
nthngdy/matritest_300M
Text Generation • 0.2B • Updated • 8
nthngdy/matritest_van_1B
Text Generation • 1B • Updated • 6
nthngdy/matritest_van_600M
Text Generation • 0.6B • Updated • 7
nthngdy/matritest_van_300M
Text Generation • 0.3B • Updated • 6
datasets 30
nthngdy/mmlu_olmo3_contamination
Viewer • Updated • 15.9k • 249
nthngdy/hellaswag_wikihow_olmo_contamination
Viewer • Updated • 1.28k • 18
nthngdy/hellaswag_activitynet
Viewer • Updated • 21.5k • 14
nthngdy/hellaswag_wikihow
Viewer • Updated • 38.4k • 14
nthngdy/mmlu_olmo_contaminated
Viewer • Updated • 3.33k • 942
nthngdy/mmlu_olmo_decontaminated
Viewer • Updated • 10.7k • 204
nthngdy/pile_small_deduped_tokenized
Viewer • Updated • 100k • 7
nthngdy/mmlu_olmo_contamination
Viewer • Updated • 15.9k • 157
nthngdy/mmlu_shuffled
Viewer • Updated • 31.7k • 160
nthngdy/mmlu
Viewer • Updated • 116k • 15