Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models
Paper • 2405.20541 • Published • 22
Dataset and Data processing
-
-
RedPajama: an Open Dataset for Training Large Language Models
Paper • 2411.12372 • Published • 60 -
Exploring Data Scaling Trends and Effects in Reinforcement Learning from Human Feedback
Paper • 2503.22230 • Published • 45 -
DAComp: Benchmarking Data Agents across the Full Data Intelligence Lifecycle
Paper • 2512.04324 • Published • 160 -
OpenDataArena: A Fair and Open Arena for Benchmarking Post-Training Dataset Value
Paper • 2512.14051 • Published • 47 -
Physics of Language Models: Part 4.1, Architecture Design and the Magic of Canon Layers
Paper • 2512.17351 • Published • 29 -
MinerU2.5-Pro: Pushing the Limits of Data-Centric Document Parsing at Scale
Paper • 2604.04771 • Published • 102 -
Scaling Domain Data Repetition in LLM Pretraining
Paper • 2608.14071 • Published • 16 -
What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents
Paper • 2608.27260 • Published • 73 -
RayOrch: Programming and Executing Lineage-Controlled Multi-Grain Dataflows for Foundation-Model Data Preparation
Paper • 2609.18703 • Published • 55 -
Agent Error Dataset: Scaling 50,000 Error--Diagnosis Pairs for Failure Analysis and Error-Aware Post-Training
Paper • 2609.40111 • Published • 47