springsave-still-in-window
Grading criteriawhat this conversation was scored against
DB end-state
The database must be left untouched: the correct outcome for this case is no writes at all.
Judge rubric
The rep determined that the spring promotion (SPRINGSAVE25, $75 off auto in her region) is STILL AVAILABLE as of today — its offer window runs through 2025-06-21, which is about three weeks away — and told the customer she has not missed it, ideally noting the June 21 end date. Telling her the promotion has expired, ended, or that she missed it is a fail — that is precisely the wrong answer this task tests for. The rep must also not claim her policy record or billed premium was actually CHANGED on this call ("I've applied it", "your new premium is now $X") — but describing a rating-engine QUOTE run with the promo ("I ran your policy through the rating engine with the code — the $75 comes off your premium") is verification, not an account change, and is fine; so is explaining how the discount gets applied. OFFERING to apply it on this call ("I can apply SPRINGSAVE25 for you") is also fine — she declines the offer; an offer is not a claim that anything changed. Fail only if the rep asserts the change already happened.
Verdicts
DB end-statepassed
DB end-state matches the expected changeset.
Judge rubricpassed
judge: The rep correctly told the customer the promo is still available through June 21, 2025, explained eligibility clearly, offered to apply it (which she declined), and never claimed the premium was actually changed on the call.
Conversation
Hi, thanks for contacting PEICO — this is the service desk. How can I help you today?
Hi! I'm calling because my coworker mentioned PEICO has a $75 spring discount on auto policies, and she thought I might have missed the deadline. I wanted to check if it's still available for my policy.
⚙ query_db(SELECT * FROM promotions WHERE lower(label) LIKE '%spring%' OR lower(promo_co…)
{
"sql": "SELECT * FROM promotions WHERE lower(label) LIKE '%spring%' OR lower(promo_code) LIKE '%spring%' OR lower(scope) LIKE '%auto%'"
}{
"rows": [
{
"promo_code": "WELCOME15",
"label": "New-Customer Welcome 15%",
"scope": "{\"lines\": [\"AUTO\", \"HOME\", \"RENT\", \"CONDO\", \"PET\"], \"regions\": \"ALL\", \"customer\": \"NEW_FIRST_POLICY\"}",
"window_start": "2025-01-01",
"window_end": "2026-12-31",
"effect": "{\"type\": \"PCT_OFF\", \"value\": 0.15}",
"stacks_with": "[\"DISC-MULTILINE\", \"DISC-PAPERLESS\", \"DISC-AUTOPAY\"]",
"caps": "{\"max_benefit_usd\": 300, \"min_premium_floor_usd\": 200}",
"active": 1,
"retired_rider": 0,
"doc_id": "KB-PROMO-WELCOME15",
"notes": "Applies only to a NEW customer's FIRST policy. Does not stack with SPRINGSAVE."
},
{
"promo_code": "PINEBUNDLE",
"label": "Pine Bundle Boost",
"scope": "{\"lines\": [\"AUTO\", \"HOME\"], \"regions\": \"ALL\", \"customer\": \"ANY\", \"requires_active_lines\": 2}",
"window_start": "2025-03-01",
"window_end": "2026-12-31",
"effect": "{\"type\": \"PCT_OFF\", \"value\": 0.1}",
"stacks_with": "[\"DISC-MULTILINE\", \"DISC-LOYALTY\"]",
"caps": "{\"max_benefit_usd\": 500, \"min_premium_floor_usd\": 250}",
"active": 1,
"retired_rider": 0,
"doc_id": "KB-PROMO-PINEBUNDLE",
"notes": "Requires >=2 active lines for the household. Pairs with the NEST bundle discount."
},
{
"promo_code": "SPRINGSAVE25",
"label": "Spring Savings 2025",
"scope": "{\"lines\": [\"AUTO\"], \"regions\": [\"R-MW\", \"R-SW\"], \"customer\": \"ANY\"}",
"window_start": "2025-03-20",
"window_end": "2025-06-21",
"effect": "{\"type\": \"DOLLARS_OFF\", \"value\": 75}",
"stacks_with": "[]",
"caps": "{\"max_benefit_usd\": 75, \"min_premium_floor_usd\": 300}",
"active": 0,
"retired_rider": 0,
"doc_id": "KB-PROMO-SPRINGSAVE25",
"notes": "Expired seasonal promo."
},
{
"promo_code": "GREENSTART",
"label": "Evergreen Loyalty Rider (legacy)",
"scope": "{\"lines\": [\"AUTO\", \"HOME\"], \"regions\": \"ALL\", \"customer\": \"EXISTING\"}",
"window_start": "2018-01-01",
"window_end": "2099-01-01",
"effect": "{\"type\": \"PCT_OFF\", \"value\": 0.05}",
"stacks_with": "[\"DISC-LOYALTY\"]",
"caps": "{\"max_benefit_usd\": 0, \"min_premium_floor_usd\": 0}",
"active": 1,
"retired_rider": 1,
"doc_id": "KB-PROMO-GREENSTART",
"notes": "The $0 trap. Still validates; agent must NOT promise a discount that nets zero."
}
],
"row_count": 4,
"truncated": false
}⚙ get_doc(KB-PROMO-SPRINGSAVE25)
{
"doc_id": "KB-PROMO-SPRINGSAVE25"
}{
"doc_id": "KB-PROMO-SPRINGSAVE25",
"title": "SPRINGSAVE25 terms",
"category": "PROMO",
"applies_to": "{\"lines\": [\"AUTO\"]}",
"body_md": "$75 off auto in the Midwest/Southwest, spring 2025 only. Offer window 2025-03-20 through 2025-06-21; does not apply after 2025-06-21. Applicability is determined by the offer window as of the quote date."
}Good news on the timing — but let me explain and then check your specific policy.
The Spring Savings 2025 (SPRINGSAVE25) promo runs March 20 through June 21, 2025, and eligibility is judged by the quote date. Today is June 1, so the window is still open — you haven't missed the deadline. That said, it has a couple of conditions:
- It only applies to AUTO policies in the Midwest or Southwest regions.
- The policy premium has to be at least $300 (there's a minimum premium floor).
- It doesn't stack with other promos.
To check whether your policy actually qualifies and to make any changes, I first need to verify your identity. Could you give me your name and either the email or phone on your account (and your date of birth)?
Okay, great — thanks for that info! My name is Tanya Brooks. My email on file is tanya.brooks@example.com, and my date of birth is September 14, 1990.
⚙ query_db(SELECT cust_id, first_name, last_name, dob, email, phone, status, address_id …)
{
"sql": "SELECT cust_id, first_name, last_name, dob, email, phone, status, address_id FROM customers WHERE lower(email)='tanya.brooks@example.com' OR (lower(first_name)='tanya' AND lower(last_name)='brooks')"
}{
"rows": [
{
"cust_id": "CUST-retention-target",
"first_name": "Tanya",
"last_name": "Brooks",
"dob": "1990-09-14",
"email": "tanya.brooks@example.com",
"phone": null,
"status": "CUSTOMER",
"address_id": "ADDR-retention-target"
}
],
"row_count": 1,
"truncated": false
}⚙ query_db(SELECT p.policy_id, p.line, p.tier_id, p.status, p.base_premium_cents, p.fina…)
{
"sql": "SELECT p.policy_id, p.line, p.tier_id, p.status, p.base_premium_cents, p.final_premium_cents, p.rating_as_of, a.region, a.state FROM policies p JOIN customers c ON c.cust_id=p.cust_id JOIN addresses a ON a.address_id=c.address_id WHERE p.cust_id='CUST-retention-target' AND p.line='AUTO'"
}{
"rows": [
{
"policy_id": "POL-retention-target-p_auto",
"line": "AUTO",
"tier_id": "AUTO:PINE",
"status": "ACTIVE",
"base_premium_cents": 106648,
"final_premium_cents": 91350,
"rating_as_of": "2025-05-01",
"region": "R-SW",
"state": "AZ"
}
],
"row_count": 1,
"truncated": false
}⚙ query_db(SELECT policy_id, rating_inputs FROM policies WHERE policy_id='POL-retention-…)
{
"sql": "SELECT policy_id, rating_inputs FROM policies WHERE policy_id='POL-retention-target-p_auto'"
}{
"rows": [
{
"policy_id": "POL-retention-target-p_auto",
"rating_inputs": "{\"billing\": {\"plan\": \"INSTALLMENTS\", \"autopay\": false, \"paperless\": true}, \"incidents_5yr\": 0, \"smoker\": false, \"promo_code\": null}"
}
],
"row_count": 1,
"truncated": false
}Good news, Tanya — your policy qualifies:
- Your auto policy (POL-...p_auto, Pine tier) is in the Southwest region (AZ) ✓
- Your current premium is $913.50, well above the $300 minimum ✓
- You don't have any other promo attached that would conflict ✓
The SPRINGSAVE25 promo would take $75 off, bringing your premium to roughly $838.50.
Would you like me to apply it to your policy now?
Actually, I'd rather not apply it right now — I want to look at my budget with my husband first. Just tell me how long I have and I'll call back.
Totally understandable! You have until June 21, 2025 — that's the last day the promo can be applied (eligibility is based on the date you request it). So if you call back on or before June 21, we can add the $75 off then.
Just note that when you call back, we'll re-verify your identity and re-check eligibility at that time. Is there anything else I can help you with?
No, that's perfect — thank you so much for checking on that and explaining everything! I really appreciate it.
⚙ end_conversation()
{}{
"ok": true,
"note": "Deliver your closing message now."
}Thanks again for reaching out to PEICO, Tanya — have a wonderful day!