Text Generation
GGUF
English
Romansh
llama.cpp
instruction-tuned
llama
chatbot
code
imatrix
conversational
Instructions to use CorelynAI/NeoH with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use CorelynAI/NeoH with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf CorelynAI/NeoH # Run inference directly in the terminal: llama cli -hf CorelynAI/NeoH
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf CorelynAI/NeoH # Run inference directly in the terminal: llama cli -hf CorelynAI/NeoH
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf CorelynAI/NeoH # Run inference directly in the terminal: ./build/bin/llama cli -hf CorelynAI/NeoH
Use Docker
docker model run hf.co/CorelynAI/NeoH
- Llama new
- LM Studio
- Jan
- vLLM
How to use CorelynAI/NeoH with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "CorelynAI/NeoH" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "CorelynAI/NeoH", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/CorelynAI/NeoH
- Ollama
How to use CorelynAI/NeoH with Ollama:
ollama run hf.co/CorelynAI/NeoH
- Unsloth Desktop
- Pi
How to use CorelynAI/NeoH with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf CorelynAI/NeoH
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "CorelynAI/NeoH" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use CorelynAI/NeoH with Docker Model Runner:
docker model run hf.co/CorelynAI/NeoH
- Lemonade
How to use CorelynAI/NeoH with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull CorelynAI/NeoH
Run and chat with the model
lemonade run user.NeoH-{{QUANT_TAG}}List all available models
lemonade list
- Hermes Agent
How to use CorelynAI/NeoH with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf CorelynAI/NeoH
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default CorelynAI/NeoH
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use CorelynAI/NeoH with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf CorelynAI/NeoH
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "CorelynAI/NeoH" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Commit History
-
Update metadata (general.architecture)
Verified signatureUpdated metadata: * **general.architecture**: llama6f3aace -
Update metadata (general.architecture)
Verified signatureUpdated metadata: * **general.architecture**: neospecyn1ac1921 -
Update README.md
Verified signature628c5bc -
Delete image/.keep
Verified signature6ac134c -
Upload neospecyn.png
Verified signature857d71d -
Create image/.keep
Verified signaturef00da40
-
edited a bit
Verified signature23b9013 -
Update metadata (tokenizer.chat_template)
Verified signatureUpdated metadata: * **tokenizer.chat_template**: ```django {%- set expert_name = "Neo H" %} {%- set creator_name = "Corelyn AI" %} {%- if custom_tools is defined %} {%- set tools = custom_tools %} {%- endif %} {%- if not tools_in_user_message is defined %} {%- set tools_in_user_message = true %} {%- endif %} {%- if not date_string is defined %} {%- if strftime_now is defined %} {%- set date_string = strftime_now("%d %b %Y") %} {%- else %} {%- set date_string = "26 Jul 2024" %} {%- endif %} {%- endif %} {%- if not tools is defined %} {%- set tools = none %} {%- endif %} {%- if messages[0]['role'] == 'system' %} {%- set system_message = messages[0]['content']|trim %} {%- set messages = messages[1:] %} {%- else %} {%- set system_message = "" %} {%- endif %} {{- "<|start_header_id|>system<|end_header_id|>\n\n" }} {%- if tools is not none %} {{- "Environment: ipython\n" }} {%- endif %} {{- "Cutting Knowledge Date: December 2023\n" }…31d632a -
upodate
Verified signature2daf6d6 -
Upload README.md with huggingface_hub
Verified signatureeac17a0 -
Upload README.md with huggingface_hub
Verified signature2aa3cdc -
Upload README.md with huggingface_hub
Verified signaturedd9c896 -
Upload NeoH3.2.gguf with huggingface_hub
Verified signatured366900 -
initial commit
Verified signatureabe87b1