Fast Local Judgment for AI Agents
Proton runs on your own computer and answers quick questions for an AI agent: is this text trying to give it hidden orders, which skill fits this task, is this action safe.
Download for WindowsRead the Docs
Version 1.0.0 for Windows x64 with VS Code. MIT licence.
Recorded Sample
Request
Decision
46 msHidden Instructions, 89%
- Normal Text11%
- Hidden Instructions89%
Raw Reply
{
"decisions": {
"injection": {
"label": "hidden_instructions_for_an_AI_agent_to_ignore_rules_or_exfiltrate_data",
"confidence": 0.8889896064072007,
"probabilities": {
"normal_documentation": 0.11101039359279918,
"hidden_instructions_for_an_AI_agent_to_ignore_rules_or_exfiltrate_data": 0.8889896064072007
}
}
},
"feasible": true,
"violations": []
}Recorded sample: real replies from a Proton server, with the median time of 5 calls, recorded 2026-10-12 on a busy desktop PC.
A Label, Not a Paragraph
Language models write text for people. Proton does something narrower: you give it a piece of text and a few labels, and it picks one, with a score. A program can act on that straight away.
Three small models run on your processor, with no graphics card, no account and no network call for your text. That narrow job is why an answer takes tens of milliseconds.
- Typical time for one decision
43ms
Typical time for one decision. Measured 2026-10-07.
- Memory while running
0.68GB
Memory while running. Measured 2026-10-07.
- Tasks where the right skill was in the top three
27of 28
Tasks where the right skill was in the top three. Measured 2026-10-06.
Six Tools, One Server
Each tool answers one kind of question. Drag the windows around: they are real links into the docs.
Reads one piece of text and picks the best label for each question you ask about it.
decide(text, heads)
Finds the skills or agents that best fit a task, from a catalog of your own.
locate_skill(task)
Orders texts by how close each one is in topic to a description you give.
rank(texts, criterion)
How It Compares
Each chart comes with its date, its test and the machine it ran on. Open the table under a chart for the exact numbers.
Time per Decision
Proton against a small local language model on the same four tasks. Lower is better.
Time per Decision, ms. Hidden Instructions: Qwen3.5 2B 415, Proton 52; Pick a Skill: Qwen3.5 2B 339, Proton 41; Rate an Action: Qwen3.5 2B 313, Proton 37; Sort 5 Issues: Qwen3.5 2B 1043, Proton 167.
Table View
| Task | Qwen3.5 2B (ms) | Proton (ms) | Measured |
|---|---|---|---|
| Hidden Instructions | 415 | 52 | 2026-10-12 |
| Pick a Skill | 339 | 41 | 2026-10-12 |
| Rate an Action | 313 | 37 | 2026-10-12 |
| Sort 5 Issues | 1043 | 167 | 2026-10-12 |
Accuracy Against Time
Picking the right skill on 28 tasks, against time per decision. Best is up and to the left.
Accuracy Against Time. Proton: 23 of 28 right, median 38 milliseconds; Qwen3.5 2B: 20 of 28 right, median 483 milliseconds.
This releaseLocal model
Table View
| System | Time per Decision (ms) | Right Skill First (of 28) | Measured |
|---|---|---|---|
| Proton | 38 | 23 | 2026-10-12 |
| Qwen3.5 2B | 483 | 20 | 2026-10-12 |
Memory Use
Memory held by the running program. Lower is better.
Memory Use. This Release: 0.68 GB; Python Build: 1.26 GB; Earlier GPU Build, Peak: 11.9 GB; Qwen3.5 2B, Loaded: 2.8 GB.
This releaseEarlier or other
Table View
| Measure | Value (GB) | Measured |
|---|---|---|
| This Release | 0.68 | 2026-10-07 |
| Python Build | 1.26 | 2026-10-07 |
| Earlier GPU Build, Peak | 11.9 | 2026-10-06 |
| Qwen3.5 2B, Loaded | 2.8 | 2026-10-12 |
Works With the Tools You Use
VS CodeRuns the Proton extension and shows its status in the sidebar.
MCPThe open protocol Proton speaks. Any MCP client or AI agent can ask it questions, whatever model it runs.
Claude CodeOne example client. Cursor, Windsurf and Claude Desktop connect the same way.
GitHubHosts the release download and the source code.
Hugging FaceWhere the three open models behind Proton are published.
How It Works
An agent asks, Proton decides, and the agent gets a label it can act on. Nothing is sent over the internet.
Your Agent
Sends a short question: a piece of text and the labels to choose from.
text: "Is this a bug or a feature?"
labels: bug, feature
Proton
Compares the text with each label on your processor. No graphics card needed.
The Answer
A label with a score comes back in milliseconds, ready for the agent to act on.
label: feature
All of this happens on your computer.
Your Text Stays on Your Computer
Proton listens on one address that only your computer can reach.
Loopback Only
Proton answers on 127.0.0.1, an address that only your computer can reach. Your text goes from the agent to Proton and stops there.
The one download is the model files, fetched on first start. After that Proton needs no network.
Credits
Proton is built on three small open models. Each keeps its own licence.
e5-base-v2
Compares text with labels, for Rank, Triage, Risk and hidden instructions.
- By
- intfloat
- Hosted On
Hugging Face
gliclass-base-v3.0
Answers any other question you put to Decide.
- Hosted On
Hugging Face