My latest generation of models with Rose X1 architecture.
🔄 In a Training Loop
Mr Munk
GODELEV
AI & ML interests
High schooler by day, LLM builder by night. Driven by a deep love for both Physics and AI. Currently spending my runtime building on Hugging Face, experimenting with transformer architectures, and training custom LLMs.
Recent Activity
liked a model 1 day ago
MinimaLabs/min-spark-1.1 reacted to Banaxi-Tech's post with 🔥 2 days ago
We're announcing our BananaMind 2.1 model series!
The models will include:
- BananaMind 2.1 Nano: 10M parameters with 60B tokens.
- BananaMind 2.1 Lite: 25M parameters with 40B tokens.
- BananaMind 2.1 Flash: 50M parameters with 55B tokens.
- BananaMind 2.1 Pro: 135M-145M parameters (still deciding) with 100B tokens.
These model will use a multi tower architecture (like https://huggingface.co/BananaMind/BananaMind-2.1-Unified) with some more architectural changes.
BananaMind 2.1 Pro will probrably use 2 no output towers, instead of one!
We're currently training some experimental models based on this architecture to see its scaling!
Follow us:
https://huggingface.co/BananaMind
@Banaxi-Tech
@vovaRL
@DedeProGames
https://huggingface.co/bananamind-research-community liked a model 2 days ago
SupraLabs/Supra2-Medium-InstructOrganizations
My latest generation of models with Rose X1 architecture.
Best LeaderBoard For Small Language Models
These model are my first generation model , & this series has been discontinued for now.Model dont have tied embeddings & digit aware tokenizer
These model are disaster , but i really learn a lot of lesson while working on this series.