← All scenariosSupport / LEARNING SCENARIO

Where should this request go?

Identify the team, the issue's impact and whether urgent review is needed, all from one message.

01 / CONTEXT

An online store customer reports: “For the last 15 minutes, no customer has been able to pay for an order by card. The page shows payment unavailable. Payment on delivery works. We checked on three different devices. No money is being charged to the cards.” Routing policy: website failures go to engineering; questions about charges and invoices go to finance; delivery times go to logistics. A payment-method outage affecting many customers requires urgent human review.

02 / QUESTIONS

teamchoice

Which team should handle this request? Choose based on the main cause of the problem.

engineeringEngineering: website or integration failure
financeFinance: invoices and refunds of charged payments
logisticsLogistics: shipping and delivery

impactscore

Assess how the described issue affects placing orders.

0Does not prevent placing orders
1Makes ordering harder for one customer
2Blocks one payment method for many customers
3Blocks every ordering method for all customers

human_reviewnoul

Under the stated policy, this request requires urgent human review.

03 / REAL API RECORDING

What the model returned.

Recorded on October 17, 2026, using shvydko-latest in free preview, with English inputs. This is a response to a fictional learning example, not a guarantee of quality on your data. The full dataset includes answers that disagree with the authored expectations; inspect the checks in Workflow Lab. The current model may be updated.

Question	Author's expectation	Actual response	Match
`team`	"engineering"	engineering	Yes
`impact`	{"min":1.5,"max":2.5}	1.9987	Yes
`human_review`	true	0.9934	Yes

{
  "team": {
    "type": "choice",
    "choice": "engineering",
    "probabilities": {
      "engineering": 0.9999,
      "finance": 0.0001,
      "logistics": 0
    },
    "confidence": 0.9998
  },
  "impact": {
    "type": "score",
    "score": 1.9987,
    "probabilities": {
      "0": 0.0007,
      "1": 0,
      "2": 0.9992,
      "3": 0.0001
    },
    "confidence": 0.9986,
    "legend": {
      "0": "Does not prevent placing orders",
      "1": "Makes ordering harder for one customer",
      "2": "Blocks one payment method for many customers",
      "3": "Blocks every ordering method for all customers"
    }
  },
  "human_review": {
    "type": "noul",
    "noul": 0.9934
  }
}

Compare two situations Full recording and expectations

04 / YOUR FIRST RUN

Edit. Run. Check.

Run this request in Playground or evaluate a set of examples in your account. Compare the new response with the recording above, the rules in the context, and your own edge cases.

{
  "state": "An online store customer reports: “For the last 15 minutes, no customer has been able to pay for an order by card. The page shows payment unavailable. Payment on delivery works. We checked on three different devices. No money is being charged to the cards.” Routing policy: website failures go to engineering; questions about charges and invoices go to finance; delivery times go to logistics. A payment-method outage affecting many customers requires urgent human review.",
  "questions": {
    "team": {
      "type": "choice",
      "instructions": "Which team should handle this request? Choose based on the main cause of the problem.",
      "criteria": {
        "engineering": "Engineering: website or integration failure",
        "finance": "Finance: invoices and refunds of charged payments",
        "logistics": "Logistics: shipping and delivery"
      }
    },
    "impact": {
      "type": "score",
      "instructions": "Assess how the described issue affects placing orders.",
      "criteria": [
        "Does not prevent placing orders",
        "Makes ordering harder for one customer",
        "Blocks one payment method for many customers",
        "Blocks every ordering method for all customers"
      ]
    },
    "human_review": {
      "type": "noul",
      "instructions": "Under the stated policy, this request requires urgent human review."
    }
  }
}

Put the decision into code Evaluate quality on your own dataset