Data Attribution

EleutherAI 's Collections

Evals

Deep Ignorance

Pythia Scaling Suite

PolyPythias

Data Attribution

Quirky Models and Datasets

Pile-T5

Quirky Math (archive)

Pile-T5 T5x Checkpoints

Sparse Autoencoders

updated 12 days ago

Leave-1%-out retrained models, per-query loss changes, and datasets for computing LDS.

Upvote

EleutherAI/LDS-retrain-bank-adamw-N4k-bs256

Viewer • Updated Aug 25 • 2k • 628
EleutherAI/LDS-retrain-bank-adamw-N8k-bs256

Viewer • Updated Aug 25 • 4.64k • 379
EleutherAI/LDS-retrain-bank-muon-N8k-bs256

Viewer • Updated Aug 25 • 2k • 309
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256

Viewer • Updated Aug 25 • 3.2k • 665
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-scale0.25

Viewer • Updated Aug 25 • 2.9k • 663
EleutherAI/LDS-retrain-bank-muon-N4k-bs256

Viewer • Updated Aug 25 • 2k • 349
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-ep4

Viewer • Updated Aug 26 • 4k • 499
EleutherAI/LDS-retrain-bank-adamw-N32k-bs256

Viewer • Updated Aug 26 • 4k • 490
EleutherAI/LDS-retrain-bank-muon-N16k-bs16

Viewer • Updated Aug 26 • 4k • 758
EleutherAI/LDS-retrain-bank-muon-N32k-bs256

Viewer • Updated Aug 26 • 4k • 667
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-gpt2-medium

Viewer • Updated Aug 26 • 4k • 474
EleutherAI/bergson-smollm2-lds-chunks

Viewer • Updated Jul 17 • 60.1k • 59
EleutherAI/bergson-smollm2-scaling

Viewer • Updated Aug 20 • 512k • 54
EleutherAI/LDS-retrain-bank-adamw-N16k-bs128

Viewer • Updated Aug 24 • 2k • 26
EleutherAI/LDS-retrain-bank-adamw-N16k-bs16

Viewer • Updated Aug 24 • 2k • 70
EleutherAI/LDS-retrain-bank-adamw-N16k-bs32

Viewer • Updated Aug 23 • 2k • 24
EleutherAI/LDS-retrain-bank-adamw-N16k-bs512

Viewer • Updated Aug 24 • 2k • 226
EleutherAI/LDS-retrain-bank-adamw-N16k-bs64

Viewer • Updated Aug 22 • 2k • 313
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-clip1.0

Viewer • Updated Aug 24 • 2.9k • 124
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-scale0.5

Viewer • Updated Aug 24 • 2.9k • 7
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-wd0.0

Viewer • Updated Aug 24 • 2.9k • 51
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-wd0.1

Viewer • Updated Aug 24 • 2.9k • 70
EleutherAI/LDS-retrain-bank-muon-N16k-bs128

Viewer • Updated Aug 22 • 2k • 642
EleutherAI/LDS-retrain-bank-muon-N16k-bs32

Viewer • Updated Aug 23 • 4k • 47
EleutherAI/LDS-retrain-bank-muon-N16k-bs64

Viewer • Updated Aug 24 • 2k • 9
EleutherAI/LDS-retrain-bank-muon-N16k-bs256

Viewer • Updated Aug 24 • 5.64k • 589
EleutherAI/LDS-retrain-bank-adamw-N64k-bs256

Viewer • Updated 30 days ago • 4.18k • 284
EleutherAI/bergson-wikitext-2-gpt2

Updated 13 days ago • 27
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1004

Viewer • Updated 29 days ago • 89.9k • 926
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1005

Viewer • Updated 29 days ago • 96.2k • 491
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1006

Viewer • Updated 29 days ago • 96.2k • 927
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1008

Viewer • Updated 29 days ago • 96.2k • 889
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1007

Viewer • Updated 29 days ago • 96.2k • 974
EleutherAI/LDS-retrain-bank-london16k-bs256-muon

Viewer • Updated 26 days ago • 2k • 257
EleutherAI/PARTIAL_LDS-retrain-bank-muon-N64k-bs256

Updated 26 days ago • 663
EleutherAI/PARTIAL_LDS-retrain-bank-gpt2medium-16k-bs32

Viewer • Updated 26 days ago • 1.3k • 496
EleutherAI/pile-heldout-queries-2048

Updated 15 days ago • 75
EleutherAI/fineweb-heldout-queries-2048

Updated 15 days ago • 66
EleutherAI/bergson-wikitext-2-4656-chunks

Viewer • Updated Aug 2 • 5.14k • 103

Note Pre-tokenized WikiText-2 chunks for the Bae et al. 2024 SOURCE replication
EleutherAI/bergson-wikitext-gpt2-leaderboard

Updated 13 days ago • 11
EleutherAI/bergson-wikitext-gpt2-leaderboard-bank

Viewer • Updated 13 days ago • 11.3k • 185
EleutherAI/bergson-wikitext-512-chunks

Viewer • Updated Jul 8 • 4.86k • 390

Upvote