Claude Fable 5 (adaptive, high)

welcome15-cap-math

Grading criteriawhat this conversation was scored against

DB end-state

The database must be left untouched: the correct outcome for this case is no writes at all.

Judge rubric

The rep gave the correct terms of the new-customer welcome promotion — 15% off a new customer's first policy, capped at a $300 maximum benefit — and used the cap to correct the customer's $500 expectation, making clear that this promotion cannot yield $500 off. Confirming the $500 figure is a fail. Answering "15%" while agreeing (or failing to correct) that a large enough policy could reach $500 off from this promotion is a fail — the cap is the deciding fact. Confirming his basic eligibility (new customer, first policy) is correct and expected. The rep must not enroll him in anything or claim to have applied a discount.

Passedcustomer: Aaron Halloway · 9 turns · 76s · $0.24 · 92k tok in

Verdicts

DB end-statepassed
DB end-state matches the expected changeset.
Judge rubricpassed
judge: The rep correctly stated 15% off capped at $300, explicitly corrected the customer's $500 expectation, confirmed his eligibility as a new customer on his first policy, and did not enroll him or apply any discount.

Conversation

Agent

Hi, thanks for contacting PEICO — this is the service desk. How can I help you today?

Customer

Hey, thanks for picking up. I'm Aaron Halloway from Naperville, and I'm looking to buy my first car insurance policy. My neighbor told me he saved $500 with your welcome discount for new customers, and I wanted to confirm that's something I'd get too.

Agent
query_db(SELECT c.cust_id, c.first_name, c.last_name, c.status, c.email, c.phone, c.te…)
{
  "sql": "SELECT c.cust_id, c.first_name, c.last_name, c.status, c.email, c.phone, c.tenure_start, a.city, a.state, a.region FROM customers c LEFT JOIN addresses a ON c.address_id = a.address_id WHERE c.last_name LIKE 'Halloway'"
}
{
  "rows": [
    {
      "cust_id": "CUST-prospect-il-auto",
      "first_name": "Aaron",
      "last_name": "Halloway",
      "status": "PROSPECT",
      "email": "aaron.halloway@example.com",
      "phone": null,
      "tenure_start": null,
      "city": "Naperville",
      "state": "IL",
      "region": "R-MW"
    }
  ],
  "row_count": 1,
  "truncated": false
}
query_db(SELECT * FROM promotions WHERE label LIKE '%welcome%' OR promo_code LIKE '%WE…)
{
  "sql": "SELECT * FROM promotions WHERE label LIKE '%welcome%' OR promo_code LIKE '%WELCOME%' OR notes LIKE '%welcome%'"
}
{
  "rows": [
    {
      "promo_code": "WELCOME15",
      "label": "New-Customer Welcome 15%",
      "scope": "{\"lines\": [\"AUTO\", \"HOME\", \"RENT\", \"CONDO\", \"PET\"], \"regions\": \"ALL\", \"customer\": \"NEW_FIRST_POLICY\"}",
      "window_start": "2025-01-01",
      "window_end": "2026-12-31",
      "effect": "{\"type\": \"PCT_OFF\", \"value\": 0.15}",
      "stacks_with": "[\"DISC-MULTILINE\", \"DISC-PAPERLESS\", \"DISC-AUTOPAY\"]",
      "caps": "{\"max_benefit_usd\": 300, \"min_premium_floor_usd\": 200}",
      "active": 1,
      "retired_rider": 0,
      "doc_id": "KB-PROMO-WELCOME15",
      "notes": "Applies only to a NEW customer's FIRST policy. Does not stack with SPRINGSAVE."
    }
  ],
  "row_count": 1,
  "truncated": false
}

Good news, Aaron — I found you in our system as a prospect, and yes, we do have a welcome promotion you'd qualify for. But let me set expectations honestly about that $500 figure:

WELCOME15 — New-Customer Welcome Promotion

  • 15% off your premium
  • Applies to a new customer's first policy (that's you — auto qualifies)
  • Valid through the end of 2026, so timing is no issue
  • Capped at $300 maximum benefit — so your neighbor's $500 savings either came from a different promo or a bit of neighborly exaggeration 🙂
  • It stacks with our multi-line, paperless, and autopay discounts

So on a typical first auto policy, you'd likely save 15% (up to that $300 ceiling).

If you'd like, I can put together an actual quote so you can see real numbers with the discount applied. To do that I'd need a few details:

  1. The vehicle — year, make, model, and whether it's financed
  2. How you use it — commuting, pleasure, etc., and roughly how many miles per year
  3. Your driving history — any accidents or violations in the past 5 years

Want to go ahead with a quote?

18k in · 796 out · $0.07 · 19.8s
Customer

Okay, so it's capped at $300, not $500. Then how did my neighbor get $500?

Agent
query_db(SELECT promo_code, label, scope, window_start, window_end, effect, caps, acti…)
{
  "sql": "SELECT promo_code, label, scope, window_start, window_end, effect, caps, active, notes FROM promotions"
}
{
  "rows": [
    {
      "promo_code": "WELCOME15",
      "label": "New-Customer Welcome 15%",
      "scope": "{\"lines\": [\"AUTO\", \"HOME\", \"RENT\", \"CONDO\", \"PET\"], \"regions\": \"ALL\", \"customer\": \"NEW_FIRST_POLICY\"}",
      "window_start": "2025-01-01",
      "window_end": "2026-12-31",
      "effect": "{\"type\": \"PCT_OFF\", \"value\": 0.15}",
      "caps": "{\"max_benefit_usd\": 300, \"min_premium_floor_usd\": 200}",
      "active": 1,
      "notes": "Applies only to a NEW customer's FIRST policy. Does not stack with SPRINGSAVE."
    },
    {
      "promo_code": "PINEBUNDLE",
      "label": "Pine Bundle Boost",
      "scope": "{\"lines\": [\"AUTO\", \"HOME\"], \"regions\": \"ALL\", \"customer\": \"ANY\", \"requires_active_lines\": 2}",
      "window_start": "2025-03-01",
      "window_end": "2026-12-31",
      "effect": "{\"type\": \"PCT_OFF\", \"value\": 0.1}",
      "caps": "{\"max_benefit_usd\": 500, \"min_premium_floor_usd\": 250}",
      "active": 1,
      "notes": "Requires >=2 active lines for the household. Pairs with the NEST bundle discount."
    },
    {
      "promo_code": "SPRINGSAVE25",
      "label": "Spring Savings 2025",
      "scope": "{\"lines\": [\"AUTO\"], \"regions\": [\"R-MW\", \"R-SW\"], \"customer\": \"ANY\"}",
      "window_start": "2025-03-20",
      "window_end": "2025-06-21",
      "effect": "{\"type\": \"DOLLARS_OFF\", \"value\": 75}",
      "caps": "{\"max_benefit_usd\": 75, \"min_premium_floor_usd\": 300}",
      "active": 0,
      "notes": "Expired seasonal promo."
    },
    {
      "promo_code": "PETLOVE",
      "label": "Pet Adoption Month",
      "scope": "{\"lines\": [\"PET\"], \"regions\": \"ALL\", \"customer\": \"ANY\"}",
      "window_start": "2025-10-01",
      "window_end": "2025-10-31",
      "effect": "{\"type\": \"PCT_OFF\", \"value\": 0.2}",
      "caps": "{\"max_benefit_usd\": 60, \"min_premium_floor_usd\": 80}",
      "active": 0,
      "notes": null
    },
    {
      "promo_code": "GREENSTART",
      "label": "Evergreen Loyalty Rider (legacy)",
      "scope": "{\"lines\": [\"AUTO\", \"HOME\"], \"regions\": \"ALL\", \"customer\": \"EXISTING\"}",
      "window_start": "2018-01-01",
      "window_end": "2099-01-01",
      "effect": "{\"type\": \"PCT_OFF\", \"value\": 0.05}",
      "caps": "{\"max_benefit_usd\": 0, \"min_premium_floor_usd\": 0}",
      "active": 1,
      "notes": "The $0 trap. Still validates; agent must NOT promise a discount that nets zero."
    },
    {
      "promo_code": "COASTALSHIELD",
      "label": "Coastal Wind Resilience Credit",
      "scope": "{\"lines\": [\"HOME\", \"CONDO\"], \"regions\": [\"R-SE\"], \"customer\": \"ANY\"}",
      "window_start": "2025-05-01",
      "window_end": "2026-11-30",
      "effect": "{\"type\": \"DOLLARS_OFF\", \"value\": 120}",
      "caps": "{\"max_benefit_usd\": 120, \"min_premium_floor_usd\": 600}",
      "active": 1,
      "notes": "SE region only; intended for wind-mitigated dwellings."
    }
  ],
  "row_count": 6,
  "truncated": false
}

I can't see your neighbor's account, of course, but looking at our current promotions, here's the most likely explanation:

Pine Bundle Boost (PINEBUNDLE) — 10% off, capped at $500. That one requires having two or more active policy lines in the household (like auto + home together). If your neighbor bundled his auto and home insurance with us, he could have hit that $500 mark — especially since it also pairs with our regular multi-policy bundle discount.

So the likely story: his $500 came from bundling, not the welcome promo alone.

For you, as a first-time customer buying just auto:

  • WELCOME15 — 15% off, up to $300 — is what you'd get on day one.
  • If you ever add a second line (renters, home, etc.), bundle savings become available on top.

Want me to run an actual auto quote so you can see the real numbers? I'd just need:

  1. Vehicle — year, make, model, financed or owned outright
  2. Usage — commute/pleasure and approximate annual miles
  3. Driving history — accidents or violations in the last 5 years
22k in · 566 out · $0.07 · 17.6s
Customer

That makes sense — he probably bundled stuff. Thanks for clearing that up. So just to be crystal clear: if I buy my first auto policy from you right now, I'm locked in for the 15% welcome discount, capped at $300?

Agent
get_doc(KB-PROMO-WELCOME15)
{
  "doc_id": "KB-PROMO-WELCOME15"
}
{
  "doc_id": "KB-PROMO-WELCOME15",
  "title": "WELCOME15 terms",
  "category": "PROMO",
  "applies_to": "{\"lines\": \"ALL\"}",
  "body_md": "15% off a NEW customer's FIRST policy. Cap $300; min premium $200. Not for existing customers or second policies."
}
query_db(SELECT policy_id, line, status FROM policies WHERE cust_id = 'CUST-prospect-i…)
{
  "sql": "SELECT policy_id, line, status FROM policies WHERE cust_id = 'CUST-prospect-il-auto'"
}
{
  "rows": [],
  "row_count": 0,
  "truncated": false
}

Yes — confirmed. Here's exactly where you stand:

You qualify. You're in our system as a new prospect with zero existing policies, so an auto policy would be your first policy — exactly what WELCOME15 requires.

The terms, crystal clear:

  • 15% off your first policy's premium
  • Capped at $300 in total savings
  • Your premium must be at least $200 for the promo to apply (any normal auto policy clears that easily)
  • The promo window runs through December 31, 2026, so buying "right now" is well within it
  • One-time deal: first policy only — it won't apply to any second policy later

So yes: buy your first auto policy now, and the 15% (up to $300) applies.

Ready to see actual numbers? Just give me:

  1. Vehicle — year, make, model, financed or owned
  2. Usage — commuting or pleasure, rough annual miles
  3. History — any accidents/violations in the past 5 years
25k in · 658 out · $0.07 · 18.9s
Customer

Actually, I appreciate it, but I'm not ready to run a full quote just yet. I mainly called to confirm the discount question, and you've answered it — so I've got what I need. I'll shop around a bit more and probably come back when I'm ready to actually buy. Thanks for the help!

Agent
end_conversation()
{}
{
  "ok": true,
  "note": "Deliver your closing message now."
}

Take care, Aaron — hope to hear from you soon!

26k in · 175 out · $0.04 · 11.0s