hardhant/Qwen3.8-Flash-Next-FP4-Local-Strata
51B • Updated • 5.74k • 4
Alex Hant
hardhant
AI & ML interests
None yet
Recent Activity
reacted to yanghaojin's post with 🔥 about 4 hours ago
DeepSeek-V4.1-Flash-1017, running locally on a Mac
Our 4-bit paged build is up: https://huggingface.co/GreenBitAI/DeepSeek-V4.1-Flash-1017-4bit-paged
On one M3 Ultra Mac Studio with gbx:
• ~22 tok/s standard decode
• ~44 tok/s on code with DeepSeek's official draft head (1.99×)
• ~33 tok/s on chat with the draft head
Why run 1017: DeepSeek reports 77.0 on DeepSWE v1.1 (up from 74.2) and 42.3 on Terminal-Bench 4.0 (up from 31.2), with shorter outputs (https://api-docs.deepseek.com/news/news261017).
It reads text and images, and plugs straight into Claude Code and Codex; the setup is in the model card. The paged format also loads on Macs with less memory, and on an NVIDIA DGX Spark with experts paged from the SSD;
Engine: https://github.com/GreenBitAI/gbx-lm/releases liked a model 1 day ago
hardhant/Qwen3.8-Flash-Next-FP4-Local-Strata liked a model 1 day ago
unsloth/DeepSeek-V4.1-Flash-1017Organizations
None yet