Agent tooling

jev-use

@shitianfang8JavaScriptMITupdated 2026-09-19runnable

Claude Code / Codex / pi plugin that hands agent steps needing no text output to Jev (TypeSafe's judgment model) — measured p50 ~230 ms and ~$0.02 per 1,000 judgments, with typed escalation back to the LLM

shitianfang/jev-use

Where it calls Jev

* POST https://api.typesafe.ai/v1/systemone, Bearer TYPESAFE_API_KEY.

src/backends/typesafe.ts:3

The link points at the commit we read, so the line number still holds.

What it asks Jev

These question sets are lifted from this project's source exactly as written.

from test/backends.test.ts:94

  1. is_bugtrue/false

    Is the customer reporting a software defect?

  2. teamchoice

    Which team should own this ticket?

    • frontendRendering issues
    • paymentsCheckout issues
  3. urgencyscore

    How urgent is this ticket?

    • 0Can wait
    • 1This week
    • 2Blocking revenue

Run it on your own text

The code
import { experimental_evaluate as evaluate } from 'ai';

const { answers } = await evaluate({
  model: 'typesafe-ai/jev',
  state,
  questions: {
    is_bug: { type: 'boolean', instructions: 'Is the customer reporting a software defect?' },
    team: { type: 'choice', instructions: 'Which team should own this ticket?',
      criteria: { frontend: 'Rendering issues', payments: 'Checkout issues' } },
    urgency: { type: 'score', instructions: 'How urgent is this ticket?',
      criteria: ['Can wait', 'This week', 'Blocking revenue'] },
  },
});

Other projects in this category