Agent tooling
Claude Code / Codex / pi plugin that hands agent steps needing no text output to Jev (TypeSafe's judgment model) — measured p50 ~230 ms and ~$0.02 per 1,000 judgments, with typed escalation back to the LLM
* POST https://api.typesafe.ai/v1/systemone, Bearer TYPESAFE_API_KEY.The link points at the commit we read, so the line number still holds.
These question sets are lifted from this project's source exactly as written.
is_bugtrue/falseIs the customer reporting a software defect?
teamchoiceWhich team should own this ticket?
frontend — Rendering issuespayments — Checkout issuesurgencyscoreHow urgent is this ticket?
0 — Can wait1 — This week2 — Blocking revenueimport { experimental_evaluate as evaluate } from 'ai';
const { answers } = await evaluate({
model: 'typesafe-ai/jev',
state,
questions: {
is_bug: { type: 'boolean', instructions: 'Is the customer reporting a software defect?' },
team: { type: 'choice', instructions: 'Which team should own this ticket?',
criteria: { frontend: 'Rendering issues', payments: 'Checkout issues' } },
urgency: { type: 'score', instructions: 'How urgent is this ticket?',
criteria: ['Can wait', 'This week', 'Blocking revenue'] },
},
});