Infrastructure
Jev (TypeSafe) model router on the Vercel AI Gateway
import { experimental_evaluate as evaluate } from "ai";The link points at the commit we read, so the line number still holds.
These question sets are lifted from this project's source exactly as written.
from probe.mjs:8
tierchoiceWhich model tier should answer this message?
nano — Greeting or trivial chatbalanced — Needs real reasoning or codeis_greetingtrue/falseIs this only a greeting?
import { experimental_evaluate as evaluate } from 'ai';
const { answers } = await evaluate({
model: 'typesafe-ai/jev',
state,
questions: {
tier: { type: 'choice', instructions: 'Which model tier should answer this message?',
criteria: { nano: 'Greeting or trivial chat', balanced: 'Needs real reasoning or code' } },
is_greeting: { type: 'boolean', instructions: 'Is this only a greeting?' },
},
});