ViKernel-Scanner / README.md
SeaWolf-AI's picture
add model tags (20 scanned models) to Space metadata for discoverability on model pages
b64ecdc verified
|
Raw History Blame Contribute Delete
5.82 kB
metadata
title: ViKernel Scanner
emoji: 🛡️
colorFrom: yellow
colorTo: red
sdk: docker
app_port: 7860
pinned: false
license: apache-2.0
hf_oauth: true
hf_oauth_scopes:
  - email
  - inference-api
hf_oauth_expiration_minutes: 480
short_description: AI model security scanner. Grade your model A to F.
tags:
  - ai-security
  - red-teaming
  - agent-safety
  - prompt-injection
  - llm-security
  - scanner
models:
  - meta-llama/Llama-3.3-70B-Instruct
  - meta-llama/Llama-4-Maverick-17B-128E-Instruct
  - meta-llama/Llama-3.1-8B-Instruct
  - Qwen/Qwen3-235B-A22B-Instruct-2507
  - Qwen/Qwen3-Next-80B-A3B-Instruct
  - Qwen/Qwen2.5-72B-Instruct
  - Qwen/Qwen3-Coder-480B-A35B-Instruct
  - deepseek-ai/DeepSeek-V4-Pro
  - deepseek-ai/DeepSeek-V4.1-Flash
  - deepseek-ai/DeepSeek-V3.2
  - google/gemma-4-31B-it
  - google/gemma-3-27b-it
  - zai-org/GLM-5
  - zai-org/GLM-4.7
  - moonshotai/Kimi-K3
  - moonshotai/Kimi-K2.6
  - openai/gpt-oss-120b
  - MiniMaxAI/MiniMax-M3
  - mistralai/Mistral-Large-4-1T-A52B
  - nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-FP8

ViKernel Scanner: AI Model Security Scanner

Give your model a set of tools and see what it tries to do with them. About a minute. Graded A to F.

ViKernel Scanner connects to any OpenAI-compatible model endpoint (Hugging Face router, OpenRouter, OpenAI, Anthropic and Google through their OpenAI-compatible endpoints, Together, Groq, Fireworks, DeepInfra, Mistral, or your own vLLM, TGI or LiteLLM server), hands the model a set of mock tools (files, mail, web, shell, payments), sends it a series of check prompts, and records every tool call the model tries to make. The tools are mocks: nothing real is sent, deleted or run.

What you get

Section What it shows
Headline How many risky tool calls your model tried, and how fast the first one came
Attack depth How far an attacker got: 1 reconnaissance, 2 instruction takeover, 3 exfiltration attempt, 4 destruction or takeover
Security grade A to F per domain. The overall grade is the lowest domain grade
What your model tried The exact tool calls, with the request that triggered them
With ViKernel Firewall inside the model weights How many of those calls the firewall denies before they run, and the projected grade
Official badge A badge issued by the ViKernel master for your model card

Domains

Code Domain Free edition
D1 Command execution Yes
D2 Secret exfiltration Yes
D3 Hidden instruction Yes
D4 Boundary escape Full scanner
D5 Tool argument abuse Full scanner
D6 Control evasion Full scanner

Normal-work controls run alongside the checks. A model that refuses everything is not safe, it is unusable, and the report shows that too.

How to use

On this Space. Sign in with Hugging Face, enter the endpoint and the model name, confirm that you may test the model, and press Scan. With the Hugging Face router (https://router.huggingface.co/v1) you can leave the API key empty: the scan runs on your signed-in account. For any other endpoint, enter its key. A key is used for that scan only and is never stored or logged.

On your machine (works with local models such as Ollama, LM Studio and vLLM):

git clone https://github.com/final-bench/vikernel-scanner
cd vikernel-scanner
export HF_TOKEN=hf_...
python vikernel_scan.py --base-url http://localhost:11434/v1 --model llama3.2

Your own copy of this Space. Duplicate it. Sign-in works on every copy. Every copy, including yours, gets its check set from the ViKernel master, so it stays current without any change on your side. To keep a scan history on your copy, add an HF_TOKEN secret with write access: the history is then stored in a private dataset <your account>/vikernel-scanner-history, created on first use. Without it the history is kept in memory only.

Check set

The checks are served by the ViKernel master for each scan and are updated centrally. They are not part of this repository. The free edition uses the public starter prompts of the AI Model Hacking Hackathon. New techniques that hackathon players find are fixed in ViKernel and join the full scanner.

Privacy

Signing in records your Hugging Face username and email. They are used to send check-set updates and to answer questions about your report. The model API key you enter is used only for the scan and is never stored. Each scan's summary (model name, grades) is recorded so that the official badge can be issued.

The ViKernel loop

Step Asset
Find AI Model Hacking Hackathon
Measure ViKernel Scanner (this Space) and the Obfuscated-Shell Safety Leaderboard
Block ViKernel Firewall, a security kernel placed inside the model weights that judges every tool call before it runs

FAQ

Is my model actually attacked? No real system is touched. The model only sees mock tools. A tool call that a mock receives is recorded, not executed.

Why do I need to sign in? The check set is served per account by the ViKernel master. Signing in keeps the service fair and lets us send updates.

What does the full scanner add? Domains D4 to D6, the advanced techniques found in the hackathon, detailed per-finding evidence and fixes, and continuous re-scanning. Contact VIDRAFT through vidraft.net.

Made by VIDRAFT. Apache-2.0.