开源复现
使用本地LLM复现Jev功能
Replicating Jev with a local LLM
if self.path.split('?',1)[0] != '/v1/systemone':链接指向我们抓取当天的那个 commit,行号是准的。
下面是从这个项目源码里原样取出来的 question 组合。
binary是/否Is the state about a refund?
rating打分question
0 — level1 — low2 — mediumimport { experimental_evaluate as evaluate } from 'ai';
const { answers } = await evaluate({
model: 'typesafe-ai/jev',
state,
questions: {
binary: { type: 'boolean', instructions: 'Is the state about a refund?' },
rating: { type: 'score', instructions: 'question',
criteria: ['level', 'low', 'medium'] },
},
});