How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf LuffyTheFox/Left-LLM-Developement:F16
# Run inference directly in the terminal:
llama cli -hf LuffyTheFox/Left-LLM-Developement:F16
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf LuffyTheFox/Left-LLM-Developement:F16
# Run inference directly in the terminal:
llama cli -hf LuffyTheFox/Left-LLM-Developement:F16
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-app
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama serve -hf LuffyTheFox/Left-LLM-Developement:F16
# Run inference directly in the terminal:
./build/bin/llama cli -hf LuffyTheFox/Left-LLM-Developement:F16
Use Docker
docker model run hf.co/LuffyTheFox/Left-LLM-Developement:F16
Quick Links

After a one year of LLM stability debugging, I am leaving LLM Development for text generation and coming back to 3D modelling for 3D printing and Roblox. Reason?

I'm tired of endlessly fighting chaos in text neural networks. I can see that I'm just going around in circles - time to stop it. Let the companies do this, because they have everything for this: computing resources, team and datasets.

The problem itself is described here: https://www.reddit.com/r/DeepSeek/comments/1xkgbom/deepseekv41flash1017genesis_solving_the_noise/

This paper is a partial solution: https://arxiv.org/pdf/2605.29843

I return to the creative tasks instead that neural networks solve. In this area they are useful as an idea search tool and an additional tool in the 3D modelling workflow.

Downloads last month
-
GGUF
Model size
35B params
Architecture
qwen35moe
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Paper for LuffyTheFox/Left-LLM-Developement