评测与研究
比较 GPT 生成的语言与 JEV 结构化 Noul 决策在相同输入下的表现。
Compare GPT generated language with JEV structured Noul decisions on the same input.
import { noul, TypeSafeClient } from "@typesafe-ai/sdk";链接指向我们抓取当天的那个 commit,行号是准的。
下面是从这个项目源码里原样取出来的 question 组合。
is_urgent是/否Does this convey urgency?
needs_human是/否Should a human support agent review this?
is_financial是/否Is this about a financial transaction?
import { experimental_evaluate as evaluate } from 'ai';
const { answers } = await evaluate({
model: 'typesafe-ai/jev',
state,
questions: {
is_urgent: { type: 'boolean', instructions: 'Does this convey urgency?' },
needs_human: { type: 'boolean', instructions: 'Should a human support agent review this?' },
is_financial: { type: 'boolean', instructions: 'Is this about a financial transaction?' },
},
});