ModernBERT pre-trained from scratch on various obfuscated representations of the same 10B tokens.
🔄 In a Training Loop
Daniel Gallagher
DanielGallagherIRE
AI & ML interests
I like encoders because they don't talk back.
Recent Activity
liked a Space 2 days ago
infini-gram-mini/infini-gram-mini liked a model 5 days ago
convaiinnovations/laya