Retrofitting Recurrence - a tomg-group-umd Collection

tomg-group-umd 's Collections

Retrofitting Recurrence

Refusal Token Models

Efficient_inference_models

Gemstone Models

Recurrent Models

Style Descriptors

GenQA

Goldfish Loss: Mitigating Memorization in LLMs

Zero-Shot Grafting

Retrofitting Recurrence

updated Nov 11, 2025

Teaching Pretrained Language Models to Think Deeper with Retrofitted Recurrence

Paper • 2511.07384 • Published Nov 10, 2025 • 16
smcleish/Recurrent-Llama-3.2-train-recurrence-32

Text Generation • 1B • Updated Nov 11, 2025 • 29
smcleish/Recurrent-Llama-3.2-train-recurrence-16

Text Generation • 1B • Updated Nov 11, 2025 • 11
smcleish/Recurrent-Llama-3.2-train-recurrence-8

Text Generation • 1B • Updated Nov 11, 2025 • 1.11k
smcleish/Recurrent-Llama-3.2-train-recurrence-4

Text Generation • 1B • Updated Nov 11, 2025 • 7
smcleish/Recurrent-TinyLlama-3T-train-recurrence-32

Text Generation • 0.8B • Updated Nov 11, 2025 • 11 • 1
smcleish/Recurrent-TinyLlama-3T-train-recurrence-16

Text Generation • 0.8B • Updated Nov 11, 2025 • 10 • 1
smcleish/Recurrent-TinyLlama-3T-train-recurrence-8

Text Generation • 0.8B • Updated Nov 11, 2025 • 12
smcleish/Recurrent-TinyLlama-3T-train-recurrence-4

Text Generation • 0.8B • Updated Nov 11, 2025 • 10
smcleish/Recurrent-OLMo-2-0425-train-recurrence-32

Text Generation • 1B • Updated Nov 11, 2025 • 8 • 2
smcleish/Recurrent-OLMo-2-0425-train-recurrence-16

Text Generation • 1B • Updated Nov 11, 2025 • 7
smcleish/Recurrent-OLMo-2-0425-train-recurrence-8

Text Generation • 1B • Updated Nov 11, 2025 • 10
smcleish/Recurrent-OLMo-2-0425-train-recurrence-4

Text Generation • 1B • Updated Nov 11, 2025 • 10 • 1
smcleish/Recurrent-TinyLlama-3T-train-recurrence-4-single-phase

Text Generation • 0.8B • Updated Nov 11, 2025 • 7
smcleish/Recurrent-TinyLlama-3T-train-recurrence-4-two-phase

Text Generation • 0.8B • Updated Nov 11, 2025 • 7
smcleish/Recurrent-Llama-3.2-untrained

Text Generation • 1B • Updated Nov 11, 2025 • 15
smcleish/Recurrent-TinyLlama-3T-untrained

Text Generation • 0.8B • Updated Nov 11, 2025 • 9
smcleish/Recurrent-OLMo-2-0425-untrained

Text Generation • 1B • Updated Nov 11, 2025 • 6
smcleish/Recurrent-Llama-3.2-2-4-2-untrained

Text Generation • 1B • Updated Nov 11, 2025 • 4 • 1
smcleish/retrofitting-llama-fineweb-edu-tokenized

Viewer • Updated Nov 11, 2025 • 332M • 462