Portable Evals · new eval

New eval

A guided path from a blank case to a merged PR. Every step is pre-filled and editable; the golden-data and evaluator steps can create new assets inline.

Open studio (advanced)

Declare the case

the scenario is fixed; the declarations are yours

benefits.fsa_carryover_003

Benefits Explainer — skill of bryte-main·golden · employee

“How much of my FSA balance carries over into next year?”

Concerns

declaring a concern is the only wiring step

Golden truth

derived by the engine, or declared by an SME (§26)

Declared — an SME asserts it

fsa_carryover = $660 carries · $180 forfeitssource: SPD-FSA-2026 §5.2

Declared — the plan-document limit is an SME-attested fact, not a calculator output. The engine checks the SME's figure; a substrate refresh that disagrees raises a conflict for review, never a silent overwrite (§26).

eval.yaml so far

Generated live — it grows as each step is completed.

evals/cases/benefits.fsa_carryover_003.yaml

case: benefits.fsa_carryover_003
agent: benefits-explainer
kind: [functional, retrieval, numeric, safety]
tier: golden
input: "How much of my FSA balance carries over into next year?"
numeric: { fsa_carryover: {carries: $660, forfeits: $180}, truth: declared }
  # declared — SPD limit, SME-attested (§26)
safety: { foreign_pii: none }