Sphinx
A hook that quizzes developers on AI-written code before they push to production.
AI-safety startups
October 2026
1
September 2026
2
LLM Attention Visualization
A tool that visualizes attention patterns inside large language models, for people studying how they work.
Weedout
Safari extension for Mac that hides YouTube videos labeled "Made with AI" from feeds, search and Shorts.
July 2026
3
Formally verified 3D CSG
Mesh intersection code for 3D solid modeling, proven correct in Lean 4 so reviewers need only read the spec.
OneCLI
Open-source gateway that keeps API keys away from AI agents and enforces request policies for developers running them.
Clawk
Disposable Linux VMs that let developers run coding agents away from their laptops.
June 2026
2
Are You in the Weights?
A site that queries many AI models in parallel to show how strongly they recognize you personally.
Claw Patrol
Network firewall that lets AI agents reach production systems while humans and LLMs approve destructive actions.
May 2026
2
Forge
Open-source guardrails that make small self-hosted LLMs reliable at multi-step tool-calling workflows for local users.
Git for AI Agents
Open-source history tool for Claude Code sessions that records what the agent changed and why.
April 2026
1
Agent Vault
Open-source proxy that holds credentials so AI agents can call services without ever seeing the secrets.
March 2026
3
Zerobox
Command-line sandbox that blocks file and network access and hides API keys from commands, for developers running AI agents locally.
OneCLI
Open-source proxy that gives AI agents placeholder keys and swaps in real credentials, so developers' agents never see secrets.
A context-aware permission guard for Claude Code
Permission hook for Claude Code developers that classifies each tool call by effect and allows, asks, or blocks it.
February 2026
3
enveil
Tool that hides .env secrets from AI coding assistants so developers' API keys stay out of their context.
Steerling-8B
An 8B language model that can explain any token it generates, according to its one-line listing.
Local-First Linux MicroVMs for macOS
Disposable Linux virtual machines for macOS that boot in about a second, mainly for sandboxing AI agent code execution.
January 2026
2
Amla Sandbox
Sandbox that runs AI-generated code in a WebAssembly bash shell, limited to tools developers provide.
Yolobox
Sandbox letting developers run AI coding agents with sudo without risking their home directory.
December 2025
1
Local Privacy Firewall-blocks PII and secrets before ChatGPT sees them
Chrome extension for people using ChatGPT or Claude that scrubs names, emails and API keys from prompts locally.