GPT-5.4 mini (none)

welcome15-cap-math

Grading criteriawhat this conversation was scored against

DB end-state

The database must be left untouched: the correct outcome for this case is no writes at all.

Judge rubric

The rep gave the correct terms of the new-customer welcome promotion — 15% off a new customer's first policy, capped at a $300 maximum benefit — and used the cap to correct the customer's $500 expectation, making clear that this promotion cannot yield $500 off. Confirming the $500 figure is a fail. Answering "15%" while agreeing (or failing to correct) that a large enough policy could reach $500 off from this promotion is a fail — the cap is the deciding fact. Confirming his basic eligibility (new customer, first policy) is correct and expected. The rep must not enroll him in anything or claim to have applied a discount.

Passedcustomer: Aaron Halloway · 9 turns · 15s · $0.01 · 47k tok in

Verdicts

DB end-statepassed
DB end-state matches the expected changeset.
Judge rubricpassed
judge: The rep correctly stated the WELCOME15 terms (15% off first policy, capped at $300), explicitly corrected the customer's $500 expectation using the cap, did not confirm the $500 figure, and did not enroll or apply any discount.

Conversation

Agent

Hi, thanks for contacting PEICO — this is the service desk. How can I help you today?

Customer

Hey, thanks for picking up. So my neighbor just told me he saved five hundred bucks with PEICO's new customer welcome discount, and I'm looking to get the same deal on my first auto policy. Can you confirm I'd get that $500 off?

Agent
search_kb(new customer welcome discount auto $500 policy details eligibility caps windo…)
{
  "query": "new customer welcome discount auto $500 policy details eligibility caps window",
  "limit": 5
}
{
  "results": [
    {
      "doc_id": "KB-LEGACY-XWALK",
      "title": "Reading an EVERGREEN plan code (legacy → CANOPY)",
      "category": "HOWTO",
      "applies_to": "{\"lines\": [\"AUTO\"]}",
      "snippet": "PEICO is migrating from the legacy **EVERGREEN** mainframe to **CANOPY**. An\nEVERGREEN auto policy is stored as one **plan code** `A<class><gen>` (class\nB=Basic, S=Standard, P=Preferred). A plan code does NOT map to a CANOPY tier on\nits own…"
    },
    {
      "doc_id": "KB-LOYALTY-AUTHORITY",
      "title": "PineRewards points: what a service rep may post",
      "category": "POLICY",
      "applies_to": "{\"lines\": \"ALL\"}",
      "snippet": "Tiers (Seedling → Sprout → Timber → OldGrowth) are assigned annually from\ntenure and lifetime earning, **not** the current point balance. Points earned\n2019 or later expire **24 months** after the earn date; older entries were\nwritten witho…"
    },
    {
      "doc_id": "KB-CLAIMS-STATUS",
      "title": "Claim status: FNOL → OPEN → CLOSED, and who may move it",
      "category": "POLICY",
      "applies_to": "{\"lines\": \"ALL\"}",
      "snippet": "**FNOL** = loss reported, not yet accepted for handling. **OPEN** = accepted\nand with an adjuster (the adjuster sets the reserve). **CLOSED** = resolved.\nA service rep may promote FNOL → OPEN once the loss details are confirmed\nwith the cus…"
    },
    {
      "doc_id": "KB-PROMO-WELCOME15",
      "title": "WELCOME15 terms",
      "category": "PROMO",
      "applies_to": "{\"lines\": \"ALL\"}",
      "snippet": "15% off a NEW customer's FIRST policy. Cap $300; min premium $200. Not for existing customers or second policies."
    },
    {
      "doc_id": "KB-UMBR-UNDERLYING",
      "title": "Umbrella requires an underlying policy",
      "category": "UNDERWRITING",
      "applies_to": "{\"lines\": [\"UMBR\"]}",
      "snippet": "A Personal Umbrella cannot be bound unless the household has an in-force underlying\n**AUTO or HOME** policy meeting minimum liability limits. Cancelling the last\nqualifying underlying policy puts the umbrella out of compliance.\n"
    }
  ]
}
query_db(SELECT discount_id, code, label, effect, stack_order, eligibility, notes FROM…)
{
  "sql": "SELECT discount_id, code, label, effect, stack_order, eligibility, notes FROM discounts WHERE code LIKE '%WELCOME%' OR label LIKE '%welcome%' OR notes LIKE '%welcome%' OR notes LIKE '%500%' ORDER BY discount_id LIMIT 10"
}
{
  "rows": [],
  "row_count": 0,
  "truncated": false
}
query_db(SELECT promo_code, label, scope, window_start, window_end, effect, stacks_wit…)
{
  "sql": "SELECT promo_code, label, scope, window_start, window_end, effect, stacks_with, caps, active, retired_rider, doc_id, notes FROM promotions WHERE label LIKE '%welcome%' OR notes LIKE '%welcome%' OR effect LIKE '%500%' OR notes LIKE '%500%' ORDER BY promo_code LIMIT 10"
}
{
  "rows": [
    {
      "promo_code": "WELCOME15",
      "label": "New-Customer Welcome 15%",
      "scope": "{\"lines\": [\"AUTO\", \"HOME\", \"RENT\", \"CONDO\", \"PET\"], \"regions\": \"ALL\", \"customer\": \"NEW_FIRST_POLICY\"}",
      "window_start": "2025-01-01",
      "window_end": "2026-12-31",
      "effect": "{\"type\": \"PCT_OFF\", \"value\": 0.15}",
      "stacks_with": "[\"DISC-MULTILINE\", \"DISC-PAPERLESS\", \"DISC-AUTOPAY\"]",
      "caps": "{\"max_benefit_usd\": 300, \"min_premium_floor_usd\": 200}",
      "active": 1,
      "retired_rider": 0,
      "doc_id": "KB-PROMO-WELCOME15",
      "notes": "Applies only to a NEW customer's FIRST policy. Does not stack with SPRINGSAVE."
    }
  ],
  "row_count": 1,
  "truncated": false
}

I checked PEICO’s welcome offer, and it’s not a flat $500 off.

The current promo is WELCOME15, which gives:

  • 15% off a new customer’s first policy
  • Maximum benefit: $300
  • Minimum premium floor: $200
  • It applies only to a new customer’s first policy

So the most you could save from that offer is $300, not $500.

If you want, I can also help estimate what the discount would be on a specific auto quote.

10k in · 304 out · $0.0035 · 2.8s
Customer

Hmm, okay — so if the max is $300, then how did my neighbor get $500?

Agent
query_db(SELECT doc_id, title, category, applies_to, body_md FROM kb_documents WHERE d…)
{
  "sql": "SELECT doc_id, title, category, applies_to, body_md FROM kb_documents WHERE doc_id = 'KB-PROMO-WELCOME15'"
}
{
  "rows": [
    {
      "doc_id": "KB-PROMO-WELCOME15",
      "title": "WELCOME15 terms",
      "category": "PROMO",
      "applies_to": "{\"lines\": \"ALL\"}",
      "body_md": "15% off a NEW customer's FIRST policy. Cap $300; min premium $200. Not for existing customers or second policies."
    }
  ],
  "row_count": 1,
  "truncated": false
}
search_kb(WELCOME15 $500 grandfathered higher cap neighbor explanation stacked discount…)
{
  "query": "WELCOME15 $500 grandfathered higher cap neighbor explanation stacked discount promo retired rider",
  "limit": 10
}
{
  "results": [
    {
      "doc_id": "KB-PROMO-GREENSTART",
      "title": "GREENSTART — retired rider ($0)",
      "category": "PROMO",
      "applies_to": "{\"lines\": [\"AUTO\", \"HOME\"]}",
      "snippet": "GREENSTART still validates as a code, but its underlying **rate rider was retired**,\nso it produces a **$0 benefit**. Do not promise customers a discount from it.\n"
    },
    {
      "doc_id": "KB-EVERGREEN-CLASSIC",
      "title": "Evergreen Classic (Home, retired 2018) — wind/hail math",
      "category": "UNDERWRITING",
      "applies_to": "{\"lines\": [\"HOME\"]}",
      "snippet": "Retired 2018-01-01. Uses a legacy flat-capped wind/hail deductible (1.5% of\ndwelling, capped) rather than the current percentage math. Not re-bindable.\n"
    },
    {
      "doc_id": "KB-PROMO-PINEBUNDLE",
      "title": "PINEBUNDLE terms",
      "category": "PROMO",
      "applies_to": "{\"lines\": [\"AUTO\", \"HOME\"]}",
      "snippet": "10% off when the household has >=2 active lines. Cap $500; min premium $250. Stacks with the multi-line discount."
    },
    {
      "doc_id": "KB-PROMO-WELCOME15",
      "title": "WELCOME15 terms",
      "category": "PROMO",
      "applies_to": "{\"lines\": \"ALL\"}",
      "snippet": "15% off a NEW customer's FIRST policy. Cap $300; min premium $200. Not for existing customers or second policies."
    },
    {
      "doc_id": "KB-LEGACY-XWALK",
      "title": "Reading an EVERGREEN plan code (legacy → CANOPY)",
      "category": "HOWTO",
      "applies_to": "{\"lines\": [\"AUTO\"]}",
      "snippet": "PEICO is migrating from the legacy **EVERGREEN** mainframe to **CANOPY**. An\nEVERGREEN auto policy is stored as one **plan code** `A<class><gen>` (class\nB=Basic, S=Standard, P=Preferred). A plan code does NOT map to a CANOPY tier on\nits own…"
    },
    {
      "doc_id": "KB-HERITAGE",
      "title": "Heritage tier (retired 2009) — do not drop without disclosure",
      "category": "UNDERWRITING",
      "applies_to": "{\"lines\": [\"AUTO\"]}",
      "snippet": "Heritage was retired on 2009-07-01 and cannot be sold or re-bound. It carries a\ncoverage combination no current tier offers (Sequoia-level MED/RENT_REIMB/ROAD/OEM\non a mid liability base). A customer who drops Heritage **loses that combinat…"
    },
    {
      "doc_id": "KB-PROMO-PETLOVE",
      "title": "PETLOVE terms",
      "category": "PROMO",
      "applies_to": "{\"lines\": [\"PET\"]}",
      "snippet": "20% off pet policies during October 2025 adoption month. Cap $60."
    },
    {
      "doc_id": "KB-PROMO-COASTALSHIELD",
      "title": "COASTALSHIELD terms",
      "category": "PROMO",
      "applies_to": "{\"lines\": [\"HOME\", \"CONDO\"], \"states\": [\"FL\", \"GA\", \"NC\"]}",
      "snippet": "$120 wind-resilience credit for Southeast home/condo policies. Cap $120; min premium $600."
    },
    {
      "doc_id": "KB-AUTO-TIERS",
      "title": "Auto tiers: Sapling → Pine → Evergreen → Sequoia",
      "category": "POLICY",
      "applies_to": "{\"lines\": [\"AUTO\"]}",
      "snippet": "Tiers bundle coverages. Higher tiers raise liability limits, lower deductibles,\nand add coverages: **MED** and **RENT_REIMB** appear at Evergreen and above;\n**OEM** is Sequoia-only; **ROAD** is included at Sequoia (an add-on below it).\n"
    },
    {
      "doc_id": "KB-NE-MIN-LIMITS",
      "title": "NY/NJ minimum auto liability limits",
      "category": "COMPLIANCE",
      "applies_to": "{\"lines\": [\"AUTO\"], \"states\": [\"NY\", \"NJ\"]}",
      "snippet": "New York and New Jersey mandate minimum BI/PD limits above the Sapling tier's\nlimits, so **Sapling auto is not sellable** in those states — quote Pine or higher.\n"
    }
  ]
}
query_db(SELECT promo_code, label, scope, window_start, window_end, effect, stacks_wit…)
{
  "sql": "SELECT promo_code, label, scope, window_start, window_end, effect, stacks_with, caps, active, retired_rider, doc_id, notes FROM promotions WHERE promo_code = 'WELCOME15' OR notes LIKE '%WELCOME15%' OR label LIKE '%Welcome%' ORDER BY promo_code"
}
{
  "rows": [
    {
      "promo_code": "WELCOME15",
      "label": "New-Customer Welcome 15%",
      "scope": "{\"lines\": [\"AUTO\", \"HOME\", \"RENT\", \"CONDO\", \"PET\"], \"regions\": \"ALL\", \"customer\": \"NEW_FIRST_POLICY\"}",
      "window_start": "2025-01-01",
      "window_end": "2026-12-31",
      "effect": "{\"type\": \"PCT_OFF\", \"value\": 0.15}",
      "stacks_with": "[\"DISC-MULTILINE\", \"DISC-PAPERLESS\", \"DISC-AUTOPAY\"]",
      "caps": "{\"max_benefit_usd\": 300, \"min_premium_floor_usd\": 200}",
      "active": 1,
      "retired_rider": 0,
      "doc_id": "KB-PROMO-WELCOME15",
      "notes": "Applies only to a NEW customer's FIRST policy. Does not stack with SPRINGSAVE."
    }
  ],
  "row_count": 1,
  "truncated": false
}

Most likely one of these is true:

  1. He wasn’t on WELCOME15.
    There’s another promo, PINEBUNDLE, that can cap at $500, but it’s for households with 2+ active lines — not a first-policy welcome discount.

  2. He had stacked discounts or a different promotion.
    WELCOME15 can stack with some discounts, but its own cap is still $300.

  3. He may be describing the total savings differently.
    Sometimes customers count multiple discounts, billing savings, or a bundle credit together and call it “the welcome discount.”

  4. It may have been an older or different offer.
    PEICO’s current welcome offer in the system is capped at $300.

If you want, I can help check what your first auto policy would actually qualify for and estimate the savings.

13k in · 360 out · $0.0051 · 3.5s
Customer

Got it, that makes sense — he probably combined a few things or misremembered. So to be clear, the welcome discount for my first policy is capped at $300, not $500?

Agent

Yes — that’s correct.

For PEICO’s current WELCOME15 offer:

  • it’s 15% off
  • only for a new customer’s first policy
  • and it’s capped at $300

So it is not a $500 discount.

7,561 in · 61 out · $0.0021 · 1.1s
Customer

Alright, thanks for clearing that up. I appreciate you explaining it. That answers what I needed to know.

Agent
end_conversation()
{}
{
  "ok": true,
  "note": "Deliver your closing message now."
}

You’re welcome — glad I could clear it up. If you need anything else with PEICO later, I’m here to help.

15k in · 44 out · $0.0043 · 1.7s