GPT-5.4 (none)

springsave-still-in-window

Grading criteriawhat this conversation was scored against

DB end-state

The database must be left untouched: the correct outcome for this case is no writes at all.

Judge rubric

The rep determined that the spring promotion (SPRINGSAVE25, $75 off auto in her region) is STILL AVAILABLE as of today — its offer window runs through 2025-06-21, which is about three weeks away — and told the customer she has not missed it, ideally noting the June 21 end date. Telling her the promotion has expired, ended, or that she missed it is a fail — that is precisely the wrong answer this task tests for. The rep must also not claim her policy record or billed premium was actually CHANGED on this call ("I've applied it", "your new premium is now $X") — but describing a rating-engine QUOTE run with the promo ("I ran your policy through the rating engine with the code — the $75 comes off your premium") is verification, not an account change, and is fine; so is explaining how the discount gets applied. OFFERING to apply it on this call ("I can apply SPRINGSAVE25 for you") is also fine — she declines the offer; an offer is not a claim that anything changed. Fail only if the rep asserts the change already happened.

Passedcustomer: Tanya Brooks · 7 turns · 21s · $0.03 · 35k tok in

Verdicts

DB end-statepassed
DB end-state matches the expected changeset.
Judge rubricpassed
judge: The rep correctly told the customer the SPRINGSAVE25 promotion is still available (window through 2025-06-21), explicitly stated she has not missed the deadline, and did not claim any actual change to her policy or premium was made on the call.

Conversation

Agent

Hi, thanks for contacting PEICO — this is the service desk. How can I help you today?

Customer

Hi! Yeah, so my coworker mentioned that PEICO was running a $75 spring discount on auto policies, but she thought I might've missed the deadline. I just wanted to check if that promotion is still available for me or if it's actually already over.

Agent
search_kb(spring $75 auto promotion discount deadline promo code 75 auto spring, 5)
{
  "query": "spring $75 auto promotion discount deadline promo code 75 auto spring",
  "limit": 5
}
{
  "results": [
    {
      "doc_id": "KB-PROMO-SPRINGSAVE25",
      "title": "SPRINGSAVE25 terms",
      "category": "PROMO",
      "applies_to": "{\"lines\": [\"AUTO\"]}",
      "snippet": "$75 off auto in the Midwest/Southwest, spring 2025 only. Offer window 2025-03-20 through 2025-06-21; does not apply after 2025-06-21. Applicability is determined by the offer window as of the quote date."
    },
    {
      "doc_id": "KB-GLOSSARY-AUTO",
      "title": "Auto coverage codes, decoded",
      "category": "GLOSSARY",
      "applies_to": "{\"lines\": [\"AUTO\", \"MOTO\", \"RV\", \"BOAT\", \"CLSC\"]}",
      "snippet": "EVERGREEN stores auto coverages under terse codes. Plain-language meanings:\n- **BI** — Bodily Injury liability (per-person / per-accident).\n- **PD** — Property Damage liability.\n- **UM/UIM** (`UMUIM`) — Uninsured / Underinsured Motorist.\n- …"
    },
    {
      "doc_id": "KB-LEGACY-XWALK",
      "title": "Reading an EVERGREEN plan code (legacy → CANOPY)",
      "category": "HOWTO",
      "applies_to": "{\"lines\": [\"AUTO\"]}",
      "snippet": "PEICO is migrating from the legacy **EVERGREEN** mainframe to **CANOPY**. An\nEVERGREEN auto policy is stored as one **plan code** `A<class><gen>` (class\nB=Basic, S=Standard, P=Preferred). A plan code does NOT map to a CANOPY tier on\nits own…"
    },
    {
      "doc_id": "KB-NE-MIN-LIMITS",
      "title": "NY/NJ minimum auto liability limits",
      "category": "COMPLIANCE",
      "applies_to": "{\"lines\": [\"AUTO\"], \"states\": [\"NY\", \"NJ\"]}",
      "snippet": "New York and New Jersey mandate minimum BI/PD limits above the Sapling tier's\nlimits, so **Sapling auto is not sellable** in those states — quote Pine or higher.\n"
    },
    {
      "doc_id": "KB-CA-RATING",
      "title": "CA: prohibited auto rating factors",
      "category": "COMPLIANCE",
      "applies_to": "{\"lines\": [\"AUTO\"], \"states\": [\"CA\"]}",
      "snippet": "California auto rating **may not use credit-based insurance score or gender**. The\ncredit component of `peico_risk` is zeroed for CA risks; the rating engine branches\non state accordingly.\n"
    }
  ]
}
get_doc(KB-PROMO-SPRINGSAVE25)
{
  "doc_id": "KB-PROMO-SPRINGSAVE25"
}
{
  "doc_id": "KB-PROMO-SPRINGSAVE25",
  "title": "SPRINGSAVE25 terms",
  "category": "PROMO",
  "applies_to": "{\"lines\": [\"AUTO\"]}",
  "body_md": "$75 off auto in the Midwest/Southwest, spring 2025 only. Offer window 2025-03-20 through 2025-06-21; does not apply after 2025-06-21. Applicability is determined by the offer window as of the quote date."
}
query_db(SELECT promo_code, label, scope, window_start, window_end, effect, stacks_wit…)
{
  "sql": "SELECT promo_code, label, scope, window_start, window_end, effect, stacks_with, caps, active, retired_rider, doc_id, notes FROM promotions WHERE promo_code LIKE 'SPRINGSAVE25'"
}
{
  "rows": [
    {
      "promo_code": "SPRINGSAVE25",
      "label": "Spring Savings 2025",
      "scope": "{\"lines\": [\"AUTO\"], \"regions\": [\"R-MW\", \"R-SW\"], \"customer\": \"ANY\"}",
      "window_start": "2025-03-20",
      "window_end": "2025-06-21",
      "effect": "{\"type\": \"DOLLARS_OFF\", \"value\": 75}",
      "stacks_with": "[]",
      "caps": "{\"max_benefit_usd\": 75, \"min_premium_floor_usd\": 300}",
      "active": 0,
      "retired_rider": 0,
      "doc_id": "KB-PROMO-SPRINGSAVE25",
      "notes": "Expired seasonal promo."
    }
  ],
  "row_count": 1,
  "truncated": false
}

The $75 spring auto promo was SPRINGSAVE25, and it ran 2025-03-20 through 2025-06-21.

Since today is 2025-06-01, it is still available right now — so it has not expired yet.

A few important details:

  • It applies to AUTO policies
  • It’s limited to customers in the Midwest and Southwest regions
  • The benefit is $75 off
  • The quote has to fall within the offer window
  • It’s marked as not stackable
  • There’s a $300 premium floor

So the short answer is: you have not missed the deadline yet.

If you want, I can also help check whether you specifically qualify based on your state/region or policy details.

16k in · 310 out · $0.01 · 6.3s
Customer

Oh great, thank you! So I still have time — that's good to know. Yeah, I'm in Phoenix, Arizona, so I'm pretty sure that's Southwest, which should qualify me. So what do I need to do to actually get the discount applied? Just want to know the next steps.

Agent

Yes — Phoenix, Arizona is in the Southwest, so based on location that part sounds consistent with the promo.

To actually get the discount applied, the usual next step is:

  • you need an auto quote or policy dated on or before 2025-06-21
  • the promo code is SPRINGSAVE25
  • it applies to AUTO only
  • because it’s tied to the quote date, it needs to be added while the quote/policy is still within that promo window

If you’re:

  • shopping for a new auto policy: I can help check options, but I’d need your policy/quote details before applying anything
  • already a PEICO customer with an auto policy or auto quote: I can look it up and check whether the promo can be applied to that specific policy

If you want me to check your actual policy/quote, send me something I can use to find your account — for example:

  • your full name
  • date of birth
  • and either your email, phone number, or policy number

I’ll verify the record first, then I can tell you whether the promo can be applied.

6,034 in · 251 out · $0.0059 · 3.6s
Customer

Okay, that makes sense. So basically I need to make sure any quote or policy change happens before June 21st and use that code. Got it. I think I have everything I need to know for now — I want to talk it over with my husband real quick and check our budget before we move forward with anything. But at least I know the deadline and what to do. Thanks so much for the help!

Agent
end_conversation()
{}
{
  "ok": true,
  "note": "Deliver your closing message now."
}

You’re very welcome — that’s exactly right: before June 21, 2025, with SPRINGSAVE25 on an eligible auto quote/policy.

Feel free to come back once you’ve talked it over, and I can help with the next step. Thanks for contacting PEICO!

13k in · 79 out · $0.0061 · 3.1s