Cenedril/Gullfaxi-9B-Q4_K_M-GGUF
Text Generation • 9B • Updated • 84 • 2
TokenRhythmAdmin
TokenRhythmAdmin
·
AI & ML interests
None yet
Recent Activity
liked a model about 16 hours ago
Cenedril/Gullfaxi-9B-Q4_K_M-GGUF liked a Space 1 day ago
localellm/WebGPU-neohorse-1-9b-i1-gguf updated a Space 6 days ago
TokenRhythm/READMEOrganizations
liked a
model about 16 hours ago
liked a
Space 1 day ago
updated a
Space 6 days ago
reacted to OppaAI's post with 🔥 6 days ago
Post
3154
Another small 4B model comes out yesterday.
NeoHorse 1 4B
TokenRhythm/NeoHorse-1-4B
There are quite a few good smaller parameter models that are capable for Agentic tasks:
The ones from the chart, I have tried a few already in my Jetson Orin Nano,
❌Gemma4 E2B IT - cannot fit my RAM usage if use with TTS and embedder
❓Qwen3.5 4B - just barely fit my RAM usage, need to add think/no_think
❌Spark X2.5 4B - need to build the forked llama.cpp; no vision
➡️Nanbeige 4.2 3B - need to build the forked llama.cpp; slower than Ministral3-3B by 25%; no vision but good for coding; maybe run this is separate server for doing coding tasks
➡️Agents A1 4B - This one is quite interesting. Another Qwen3.5 4B base. I just learnt this right now. This model may surpassed the Ministral3-3B that I'm currently running.
➡️NeoHorse 1 4B - wait for GGUF version comes out; Qwen 3.5 4B base with vision striped
➡️Needle2 45M - need to use separately from llama.cpp server; currently testing to see if it can be used as spawning sub-agents to do parallel tasks
NeoHorse 1 4B
TokenRhythm/NeoHorse-1-4B
There are quite a few good smaller parameter models that are capable for Agentic tasks:
The ones from the chart, I have tried a few already in my Jetson Orin Nano,
❌Gemma4 E2B IT - cannot fit my RAM usage if use with TTS and embedder
❓Qwen3.5 4B - just barely fit my RAM usage, need to add think/no_think
❌Spark X2.5 4B - need to build the forked llama.cpp; no vision
➡️Nanbeige 4.2 3B - need to build the forked llama.cpp; slower than Ministral3-3B by 25%; no vision but good for coding; maybe run this is separate server for doing coding tasks
➡️Agents A1 4B - This one is quite interesting. Another Qwen3.5 4B base. I just learnt this right now. This model may surpassed the Ministral3-3B that I'm currently running.
➡️NeoHorse 1 4B - wait for GGUF version comes out; Qwen 3.5 4B base with vision striped
➡️Needle2 45M - need to use separately from llama.cpp server; currently testing to see if it can be used as spawning sub-agents to do parallel tasks
- 7 replies
upvoted 2
collections 6 days ago
commented a
paper 7 days ago
updated 2
collections 7 days ago
liked a
Space 7 days ago
updated a
collection 7 days ago
upvoted a paper 7 days ago
liked 2
models 7 days ago
