SDKs & clients
Adapt local language models into Jev-compatible structured decision engines with Choice, Score, and Noul outputs powered by prefill-only binary inference.
if any(getattr(route, "path", None) == "/v1/systemone" for route in app.routes):src/llm2jev/sglang_server.py:122
The link points at the commit we read, so the line number still holds.
These question sets are lifted from this project's source exactly as written.
from examples/sglang_inference.py:14
deliverytrue/false这是否是一个物流配送问题？
departmentchoice哪个部门应该处理这个请求？
shipping — 物流配送billing — 付款账单technical — 产品故障urgencyscore这个请求有多紧急？
0 — 不紧急1 — 比较紧急2 — 非常紧急import { experimental_evaluate as evaluate } from 'ai';
const { answers } = await evaluate({
model: 'typesafe-ai/jev',
state,
questions: {
delivery: { type: 'boolean', instructions: '这是否是一个物流配送问题？' },
department: { type: 'choice', instructions: '哪个部门应该处理这个请求？',
criteria: { shipping: '物流配送', billing: '付款账单', technical: '产品故障' } },
urgency: { type: 'score', instructions: '这个请求有多紧急？',
criteria: ['不紧急', '比较紧急', '非常紧急'] },
},
});from examples/transformers_inference.py:30
is_delivery_issuetrue/false这是否是一个物流配送问题？
departmentchoice这个请求应该交给哪个部门处理？
billing — 付款、账单或退款问题shipping — 物流、配送或包裹丢失问题technical — 产品故障或技术支持问题urgencyscore评估这个客户请求的紧急程度。
0 — 不紧急1 — 比较紧急2 — 非常紧急import { experimental_evaluate as evaluate } from 'ai';
const { answers } = await evaluate({
model: 'typesafe-ai/jev',
state,
questions: {
is_delivery_issue: { type: 'boolean', instructions: '这是否是一个物流配送问题？' },
department: { type: 'choice', instructions: '这个请求应该交给哪个部门处理？',
criteria: { billing: '付款、账单或退款问题', shipping: '物流、配送或包裹丢失问题', technical: '产品故障或技术支持问题' } },
urgency: { type: 'score', instructions: '评估这个客户请求的紧急程度。',
criteria: ['不紧急', '比较紧急', '非常紧急'] },
},
});refundtrue/falseIs a refund requested?
import { experimental_evaluate as evaluate } from 'ai';
const { answers } = await evaluate({
model: 'typesafe-ai/jev',
state,
questions: {
refund: { type: 'boolean', instructions: 'Is a refund requested?' },
},
});