David Mezzetti
AI & ML interests
None yet
Recent Activity
posted an update 19 minutes ago
NeuML is excited to introduce Atto, a new family of compact encoder models!
This is one of our largest model releases to date, with more than 30 new models ranging from just 840 parameters to 28 million parameters.
One of the most interesting findings is how well extremely small models can perform, particularly when leveraging late-interaction techniques. Even an 840-parameter model can deliver surprisingly strong results.
Atto also explores how late-interaction principles can be incorporated directly into model training, bringing some of those benefits to dense embedding models.
The goal is to explore what's possible when we rethink how encoder models are designed, trained, and optimized.
We're excited to share this work!
Read more: https://huggingface.co/blog/NeuML/introducing-atto published an article about 2 hours ago
Atto: Rethinking Compact Embedding Models updated a collection about 2 hours ago
ColBERT