基础设施
这是一个模拟 typesafe ai 结构化输出的 LLM 网关,类似一个冒牌 Jev。
This is a LLM Gateway that mimics typesafe ai structured output. Like an imposter Jev.
const isChat = (request: FastifyRequest) => request.url.split('?')[0] !== '/v1/systemone';链接指向我们抓取当天的那个 commit,行号是准的。
下面是从这个项目源码里原样取出来的 question 组合。
取自 packages/api/examples/benchmark.ts:24
refund是/否Does the customer request money back?
import { experimental_evaluate as evaluate } from 'ai';
const { answers } = await evaluate({
model: 'typesafe-ai/jev',
state,
questions: {
refund: { type: 'boolean', instructions: 'Does the customer request money back?' },
},
});取自 packages/api/src/logging.test.ts:21
CANARY_QUESTION_ID是/否CANARY_RUBRIC
import { experimental_evaluate as evaluate } from 'ai';
const { answers } = await evaluate({
model: 'typesafe-ai/jev',
state,
questions: {
CANARY_QUESTION_ID: { type: 'boolean', instructions: 'CANARY_RUBRIC' },
},
});取自 packages/api/src/test-support.ts:8
refund是/否Does the customer request a refund?
import { experimental_evaluate as evaluate } from 'ai';
const { answers } = await evaluate({
model: 'typesafe-ai/jev',
state,
questions: {
refund: { type: 'boolean', instructions: 'Does the customer request a refund?' },
},
});