Open reproductions

reflex

@kshetrajna1280PythonMITupdated 2026-09-20runnable

A small open decision model: state + typed questions -> calibrated probabilities. A Jev / System One re-creation on Qwen3.5.

kshetrajna12/reflex

Where it calls Jev

"/v1/systemone", json={"model": model, "state": state, "questions": questions, **extra}

src/reflex/client.py:18

The link points at the commit we read, so the line number still holds.

What it asks Jev

These question sets are lifted from this project's source exactly as written.

from docs/app.js:18

  1. queuechoice

    Which team should handle this ticket?

    • paymentsPayouts, refunds, invoices, failed charges
    • accountLogin, profile, permissions, 2FA
    • otherAnything else
  2. escalatetrue/false

    Should this ticket be escalated to a human manager right away?

  3. urgencyscore

    How urgent is this ticket?

    • 0Low: can wait several days
    • 1Medium: should be handled today
    • 2High: money or access is blocked right now
  4. refund_requestedtrue/false

    Does the customer explicitly ask for a refund?

Run it on your own text

The code
import { experimental_evaluate as evaluate } from 'ai';

const { answers } = await evaluate({
  model: 'typesafe-ai/jev',
  state,
  questions: {
    queue: { type: 'choice', instructions: 'Which team should handle this ticket?',
      criteria: { payments: 'Payouts, refunds, invoices, failed charges', account: 'Login, profile, permissions, 2FA', other: 'Anything else' } },
    escalate: { type: 'boolean', instructions: 'Should this ticket be escalated to a human manager right away?' },
    urgency: { type: 'score', instructions: 'How urgent is this ticket?',
      criteria: ['Low: can wait several days', 'Medium: should be handled today', 'High: money or access is blocked right now'] },
    refund_requested: { type: 'boolean', instructions: 'Does the customer explicitly ask for a refund?' },
  },
});

from docs/app.js:28

  1. subjectchoice

    What is the main subject of the photo?

    • landscapeoutdoor scenery, nature, cityscape
    • documenttext, screenshot, receipt
    • productan object for sale, packaging
  2. contains_texttrue/false

    Does the image contain readable text?

  3. matches_captiontrue/false

    Does the `caption` in the state accurately describe the photo?

  4. qualityscore

    How good is the technical image quality?

    • 0Unusable: extremely blurry, dark, or corrupted
    • 1Poor: noticeable blur, noise, or bad exposure
    • 2Acceptable: minor flaws
    • 3Good: sharp and well exposed

Run it on your own text

The code
import { experimental_evaluate as evaluate } from 'ai';

const { answers } = await evaluate({
  model: 'typesafe-ai/jev',
  state,
  questions: {
    subject: { type: 'choice', instructions: 'What is the main subject of the photo?',
      criteria: { landscape: 'outdoor scenery, nature, cityscape', document: 'text, screenshot, receipt', product: 'an object for sale, packaging' } },
    contains_text: { type: 'boolean', instructions: 'Does the image contain readable text?' },
    matches_caption: { type: 'boolean', instructions: 'Does the `caption` in the state accurately describe the photo?' },
    quality: { type: 'score', instructions: 'How good is the technical image quality?',
      criteria: ['Unusable: extremely blurry, dark, or corrupted', 'Poor: noticeable blur, noise, or bad exposure', 'Acceptable: minor flaws', 'Good: sharp and well exposed'] },
  },
});

from docs/app.js:38

  1. has_bluetrue/false

    Is there a blue shape in the photo?

  2. clutterscore

    How cluttered is the photo?

    • 0empty or one or two simple shapes
    • 1several objects
    • 2very busy scene

Run it on your own text

The code
import { experimental_evaluate as evaluate } from 'ai';

const { answers } = await evaluate({
  model: 'typesafe-ai/jev',
  state,
  questions: {
    has_blue: { type: 'boolean', instructions: 'Is there a blue shape in the photo?' },
    clutter: { type: 'score', instructions: 'How cluttered is the photo?',
      criteria: ['empty or one or two simple shapes', 'several objects', 'very busy scene'] },
  },
});

from docs/pr.js:5

  1. kindchoice

    What kind of change is this pull request, judging from the title, description and the files touched?

    • featureadds new user-facing behaviour or capability
    • bugfixcorrects incorrect behaviour
    • refactorrestructures code without changing behaviour
    • docsdocumentation, comments, changelog only
    • testsadds or changes tests only
    • chorebuild, CI, dependencies, formatting, release plumbing
  2. description_matchestrue/false

    Does the `body` accurately describe what the changed `files` and `stats` suggest the PR does?

  3. breaking_changetrue/false

    Is this likely a breaking change for users of this project (public API, config format, CLI flags, behaviour that callers rely on)?

  4. needs_migrationtrue/false

    Does this change need a data or schema migration, or a coordinated rollout (e.g. database, stored formats, protocol versions)?

  5. riskscore

    How risky is merging this PR, considering scope, the areas touched and how easy it is to reason about?

    • 0trivial: docs, comments, formatting, isolated tests
    • 1low: small, local, easy to reason about
    • 2medium: touches shared logic or several files; a careful review is warranted
    • 3high: core behaviour, data handling, security, or concurrency; could break users

Run it on your own text

The code
import { experimental_evaluate as evaluate } from 'ai';

const { answers } = await evaluate({
  model: 'typesafe-ai/jev',
  state,
  questions: {
    kind: { type: 'choice', instructions: 'What kind of change is this pull request, judging from the title, description and the files touched?',
      criteria: { feature: 'adds new user-facing behaviour or capability', bugfix: 'corrects incorrect behaviour', refactor: 'restructures code without changing behaviour', docs: 'documentation, comments, changelog only', tests: 'adds or changes tests only', chore: 'build, CI, dependencies, formatting, release plumbing' } },
    description_matches: { type: 'boolean', instructions: 'Does the `body` accurately describe what the changed `files` and `stats` suggest the PR does?' },
    breaking_change: { type: 'boolean', instructions: 'Is this likely a breaking change for users of this project (public API, config format, CLI flags, behaviour that callers rely on)?' },
    needs_migration: { type: 'boolean', instructions: 'Does this change need a data or schema migration, or a coordinated rollout (e.g. database, stored formats, protocol versions)?' },
    risk: { type: 'score', instructions: 'How risky is merging this PR, considering scope, the areas touched and how easy it is to reason about?',
      criteria: ['trivial: docs, comments, formatting, isolated tests', 'low: small, local, easy to reason about', 'medium: touches shared logic or several files; a careful review is warranted', 'high: core behaviour, data handling, security, or concurrency; could break users'] },
  },
});

Other projects in this category