评测与研究
一个包含多个小实验的车库,用于用 System One 和 Jev 构建关键系统。
A garage full of tiny experiments for building critical systems with System One & Jev 🔧🧠⚡
from typesafe_sdk import (链接指向我们抓取当天的那个 commit,行号是准的。
下面是从这个项目源码里原样取出来的 question 组合。
取自 berserk/global-payment-incident/demo.py:54
failure_domain选项Identify the dominant failure domain supported by the complete incident snapshot.
application_release — The active application release is the primary causal factor.payment_provider — An external payment provider is the primary causal factor.routing_configuration — Routing or timeout configuration is the primary causal factor.capacity — Internal capacity exhaustion is the primary causal factor.multi_factor — Several coupled causes prevent a single dominant attribution.unknown — Evidence is insufficient for stable attribution.customer_impact打分Score current customer and financial impact.
0 — contained1 — minor2 — material3 — major4 — systemicsystemic_outage是/否Is this a multi-region, customer-visible payment outage requiring incident command?
import { experimental_evaluate as evaluate } from 'ai';
const { answers } = await evaluate({
model: 'typesafe-ai/jev',
state,
questions: {
failure_domain: { type: 'choice', instructions: 'Identify the dominant failure domain supported by the complete incident snapshot.',
criteria: { application_release: 'The active application release is the primary causal factor.', payment_provider: 'An external payment provider is the primary causal factor.', routing_configuration: 'Routing or timeout configuration is the primary causal factor.', capacity: 'Internal capacity exhaustion is the primary causal factor.', multi_factor: 'Several coupled causes prevent a single dominant attribution.', unknown: 'Evidence is insufficient for stable attribution.' } },
customer_impact: { type: 'score', instructions: 'Score current customer and financial impact.',
criteria: ['contained', 'minor', 'material', 'major', 'systemic'] },
systemic_outage: { type: 'boolean', instructions: 'Is this a multi-region, customer-visible payment outage requiring incident command?' },
},
});取自 berserk/global-payment-incident/demo.py:86
change_risk打分Score the blast radius and reversibility risk of the selected intervention.
0 — minimal1 — low2 — moderate3 — high4 — unacceptableevidence_sufficient是/否Is the evidence sufficient for operators to consider the selected intervention now?
import { experimental_evaluate as evaluate } from 'ai';
const { answers } = await evaluate({
model: 'typesafe-ai/jev',
state,
questions: {
change_risk: { type: 'score', instructions: 'Score the blast radius and reversibility risk of the selected intervention.',
criteria: ['minimal', 'low', 'moderate', 'high', 'unacceptable'] },
evidence_sufficient: { type: 'boolean', instructions: 'Is the evidence sufficient for operators to consider the selected intervention now?' },
},
});取自 berserk/infinity-of-jevs/demo.py:58
position选项Choose the seismic hazard interpretation best supported by the source and prior consensus.
background — Activity is consistent with ordinary global background seismicity.elevated_cluster — A meaningful cluster or sequence warrants focused monitoring.major_event — A major event creates credible disruption potential.unclear — The evidence cannot support a stable hazard interpretation.strength打分Score the operational strength of the seismic hazard signal.
0 — negligible1 — weak2 — moderate3 — strong4 — extremesupported是/否Is this hazard interpretation directly supported by the supplied events?
import { experimental_evaluate as evaluate } from 'ai';
const { answers } = await evaluate({
model: 'typesafe-ai/jev',
state,
questions: {
position: { type: 'choice', instructions: 'Choose the seismic hazard interpretation best supported by the source and prior consensus.',
criteria: { background: 'Activity is consistent with ordinary global background seismicity.', elevated_cluster: 'A meaningful cluster or sequence warrants focused monitoring.', major_event: 'A major event creates credible disruption potential.', unclear: 'The evidence cannot support a stable hazard interpretation.' } },
strength: { type: 'score', instructions: 'Score the operational strength of the seismic hazard signal.',
criteria: ['negligible', 'weak', 'moderate', 'strong', 'extreme'] },
supported: { type: 'boolean', instructions: 'Is this hazard interpretation directly supported by the supplied events?' },
},
});取自 berserk/infinity-of-jevs/demo.py:77
position选项Choose the plausible exposure pattern after considering hazard and prior-round evidence.
remote — Events are unlikely to disrupt significant infrastructure or population centers.regional — One region could face meaningful disruption.multi_region — Several regions or global networks could be affected.unclear — Locations and impact context do not support a stable exposure judgment.strength打分Score plausible infrastructure and population exposure.
0 — negligible1 — low2 — moderate3 — high4 — extremesupported是/否Is this exposure judgment supported without inventing missing asset data?
import { experimental_evaluate as evaluate } from 'ai';
const { answers } = await evaluate({
model: 'typesafe-ai/jev',
state,
questions: {
position: { type: 'choice', instructions: 'Choose the plausible exposure pattern after considering hazard and prior-round evidence.',
criteria: { remote: 'Events are unlikely to disrupt significant infrastructure or population centers.', regional: 'One region could face meaningful disruption.', multi_region: 'Several regions or global networks could be affected.', unclear: 'Locations and impact context do not support a stable exposure judgment.' } },
strength: { type: 'score', instructions: 'Score plausible infrastructure and population exposure.',
criteria: ['negligible', 'low', 'moderate', 'high', 'extreme'] },
supported: { type: 'boolean', instructions: 'Is this exposure judgment supported without inventing missing asset data?' },
},
});