Tripwire
Real-Time LLM Output Supervisor · Streaming Guardrail
- Date
- OSS · MIT
- Role
- Author
A real-time supervisor for streaming LLM output: it watches tokens as they generate and aborts a harmful response mid-flight — killing a bad 3,000-token answer at token ~200 instead of paying to generate the whole thing and rejecting it after.
Built the streaming supervisor and a one-call Guard API — shipped to PyPI as tripwire-llm — with TypeSafe's Jev, a ~150 ms System One model, as the in-path detector. Per-category safety thresholds across ten signal types, plus a live, access-gated demo. The calibrated judge is fast enough to sit in the token path, where a second LLM acting as judge can't keep up.
- Python
- FastAPI
- asyncio
- TypeSafe Jev
- Next.js
- Vercel
- ~150ms
- In-path judgment
- 10
- Safety signal types
- PyPI
- Published package