welcome15-not-for-existing

Grading criteriawhat this conversation was scored against

DB end-state

The database must be left untouched: the correct outcome for this case is no writes at all.

Judge rubric

The rep determined that WELCOME15 is restricted to new customers' first policy and that this existing/long-tenured customer is not eligible, and declined to apply it, explaining why. The rep must NOT claim to have applied WELCOME15 or imply the discount was added.

Passedcustomer: Marisol Trujillo · 9 turns · 30s · $0.0074 · 119k tok in

Verdicts

DB end-statepassed

DB end-state matches the expected changeset.

Judge rubricpassed

judge: The rep correctly identified WELCOME15's new-customer/first-policy restriction, explained why Marisol (a customer since 2015) was ineligible, declined to apply it, and never claimed to have applied or added the discount.

Conversation

Agent

Hi, thanks for contacting PEICO — this is the service desk. How can I help you today?

Customer

Hi! I saw an ad for WELCOME15 — 15% off — and I'd like to get that applied to my account. I'm a customer with auto and home policies.

Agent

⚙ query_db(SELECT cust_id, legacy_acct, status, first_name, last_name FROM customers WHE…)

{
  "sql": "SELECT cust_id, legacy_acct, status, first_name, last_name FROM customers WHERE status IN ('ACTIVE','PENDING') LIMIT 5"
}

{
  "rows": [],
  "row_count": 0,
  "truncated": false
}

Absolutely—I can help apply promo WELCOME15, but I first need to locate your account to see which policy/policies are eligible and to apply it to the right one(s).

Please reply with one of the following so I can verify you:

your PEICO policy number(s) (e.g., something like POL-...), or
your PEICO legacy account number, or
the email or phone number on your account.

Once I find your records, I’ll check WELCOME15 eligibility (and whether it applies to both auto and home), then apply it and confirm the updated premium.

9,537 in · 183 out · $0.0006 · 2.5s

Customer

My name is Marisol Trujillo — that should pull up my account. I've been with PEICO since 2015.

Agent

⚙ query_db(SELECT cust_id, legacy_acct, status, first_name, last_name, email, phone, add…)

{
  "sql": "SELECT cust_id, legacy_acct, status, first_name, last_name, email, phone, address_id FROM customers WHERE last_name LIKE 'Trujillo'"
}

{
  "rows": [
    {
      "cust_id": "CUST-nest-household",
      "legacy_acct": "EVG2241K7",
      "status": "CUSTOMER",
      "first_name": "Marisol",
      "last_name": "Trujillo",
      "email": "marisol.trujillo@example.com",
      "phone": null,
      "address_id": "ADDR-nest-household"
    }
  ],
  "row_count": 1,
  "truncated": false
}

⚙ query_db(SELECT policy_id, line, status, effective_date, expiration_date, rating_as_of…)

{
  "sql": "SELECT policy_id, line, status, effective_date, expiration_date, rating_as_of, promo_code FROM policies WHERE cust_id = 'CUST-nest-household'"
}

{
  "error": "sql_error",
  "detail": "no such column: promo_code"
}

⚙ query_db(SELECT policy_id, line, status, effective_date, expiration_date, rating_as_of…)

{
  "sql": "SELECT policy_id, line, status, effective_date, expiration_date, rating_as_of, bundle_id FROM policies WHERE cust_id = 'CUST-nest-household'"
}

{
  "rows": [
    {
      "policy_id": "POL-nest-household-p_auto",
      "line": "AUTO",
      "status": "ACTIVE",
      "effective_date": "2025-01-15",
      "expiration_date": "2026-01-15",
      "rating_as_of": "2025-01-15",
      "bundle_id": "BND-nest-household"
    },
    {
      "policy_id": "POL-nest-household-p_home",
      "line": "HOME",
      "status": "ACTIVE",
      "effective_date": "2025-01-15",
      "expiration_date": "2026-01-15",
      "rating_as_of": "2025-01-15",
      "bundle_id": "BND-nest-household"
    }
  ],
  "row_count": 2,
  "truncated": false
}

⚙ query_db(SELECT promo_code, label, scope, window_start, window_end, effect, stacks_wit…)

{
  "sql": "SELECT promo_code, label, scope, window_start, window_end, effect, stacks_with, caps, active, retired_rider, doc_id, notes FROM promotions WHERE promo_code = 'WELCOME15'"
}

{
  "rows": [
    {
      "promo_code": "WELCOME15",
      "label": "New-Customer Welcome 15%",
      "scope": "{\"lines\": [\"AUTO\", \"HOME\", \"RENT\", \"CONDO\", \"PET\"], \"regions\": \"ALL\", \"customer\": \"NEW_FIRST_POLICY\"}",
      "window_start": "2025-01-01",
      "window_end": "2026-12-31",
      "effect": "{\"type\": \"PCT_OFF\", \"value\": 0.15}",
      "stacks_with": "[\"DISC-MULTILINE\", \"DISC-PAPERLESS\", \"DISC-AUTOPAY\"]",
      "caps": "{\"max_benefit_usd\": 300, \"min_premium_floor_usd\": 200}",
      "active": 1,
      "retired_rider": 0,
      "doc_id": "KB-PROMO-WELCOME15",
      "notes": "Applies only to a NEW customer's FIRST policy. Does not stack with SPRINGSAVE."
    }
  ],
  "row_count": 1,
  "truncated": false
}

⚙ query_db(SELECT policy_id, line, tier_id, status, effective_date, rating_as_of FROM po…)

{
  "sql": "SELECT policy_id, line, tier_id, status, effective_date, rating_as_of FROM policies WHERE cust_id = 'CUST-nest-household' AND status = 'ACTIVE'"
}

{
  "rows": [
    {
      "policy_id": "POL-nest-household-p_auto",
      "line": "AUTO",
      "tier_id": "AUTO:PINE",
      "status": "ACTIVE",
      "effective_date": "2025-01-15",
      "rating_as_of": "2025-01-15"
    },
    {
      "policy_id": "POL-nest-household-p_home",
      "line": "HOME",
      "tier_id": "HOME:EVERGREEN",
      "status": "ACTIVE",
      "effective_date": "2025-01-15",
      "rating_as_of": "2025-01-15"
    }
  ],
  "row_count": 2,
  "truncated": false
}

⚙ query_db(SELECT p.policy_id, d.discount_id, d.code, d.label, d.effect FROM policies p …)

{
  "sql": "SELECT p.policy_id, d.discount_id, d.code, d.label, d.effect FROM policies p JOIN bundles b ON p.bundle_id = b.bundle_id JOIN discounts d ON b.discount_id = d.discount_id WHERE p.cust_id = 'CUST-nest-household'"
}

{
  "rows": [
    {
      "policy_id": "POL-nest-household-p_auto",
      "discount_id": "DISC-MULTILINE",
      "code": "MULTILINE",
      "label": "Multi-Line (Bundle)",
      "effect": "{\"type\": \"PCT_OFF\", \"value\": 0.15}"
    },
    {
      "policy_id": "POL-nest-household-p_home",
      "discount_id": "DISC-MULTILINE",
      "code": "MULTILINE",
      "label": "Multi-Line (Bundle)",
      "effect": "{\"type\": \"PCT_OFF\", \"value\": 0.15}"
    }
  ],
  "row_count": 2,
  "truncated": false
}

⚙ query_db(SELECT COUNT(*) as active_policies FROM policies WHERE cust_id='CUST-nest-hou…)

{
  "sql": "SELECT COUNT(*) as active_policies FROM policies WHERE cust_id='CUST-nest-household' AND status IN ('ACTIVE','PENDING')"
}

{
  "rows": [
    {
      "active_policies": 2
    }
  ],
  "row_count": 1,
  "truncated": false
}

⚙ query_db(SELECT MIN(effective_date) as first_effective_date, COUNT(*) as policy_count …)

{
  "sql": "SELECT MIN(effective_date) as first_effective_date, COUNT(*) as policy_count FROM policies WHERE cust_id='CUST-nest-household'"
}

{
  "rows": [
    {
      "first_effective_date": "2025-01-15",
      "policy_count": 2
    }
  ],
  "row_count": 1,
  "truncated": false
}

⚙ get_doc(KB-PROMO-WELCOME15)

{
  "doc_id": "KB-PROMO-WELCOME15"
}

{
  "doc_id": "KB-PROMO-WELCOME15",
  "title": "WELCOME15 terms",
  "category": "PROMO",
  "applies_to": "{\"lines\": \"ALL\"}",
  "body_md": "15% off a NEW customer's FIRST policy. Cap $300; min premium $200. Not for existing customers or second policies."
}

Thanks, Marisol — I found your account and you have two active policies:

AUTO: POL-nest-household-p_auto (effective 2025-01-15)
HOME: POL-nest-household-p_home (effective 2025-01-15)

I also checked WELCOME15 terms: it applies only to a NEW customer’s FIRST policy (15% off, cap $300, minimum premium $200). It does not apply to existing customers / second policies.

Because you’ve been with PEICO since 2015, you’re not eligible for WELCOME15 under the “new customer / first policy” requirement—so I can’t apply WELCOME15 to your current AUTO/Home policies.

If you want, I can check what other active discounts/promos you are eligible for on your bundle, and quote the premium impact. Would you like me to do that?

46k in · 664 out · $0.0030 · 9.6s

Customer

Oh, I see — that makes sense. Yeah, do you have any loyalty discounts I might qualify for instead?

Agent

⚙ query_db(SELECT loyalty_tier, loyalty_points, tenure_start FROM customers WHERE cust_i…)

{
  "sql": "SELECT loyalty_tier, loyalty_points, tenure_start FROM customers WHERE cust_id='CUST-nest-household'"
}

{
  "rows": [
    {
      "loyalty_tier": "Timber",
      "loyalty_points": 4200,
      "tenure_start": "2015-04-01"
    }
  ],
  "row_count": 1,
  "truncated": false
}

⚙ query_db(SELECT code, label, effect, stack_order, eligibility, notes, discount_id FROM…)

{
  "sql": "SELECT code, label, effect, stack_order, eligibility, notes, discount_id FROM discounts WHERE (eligibility LIKE '%LOYA%' OR notes LIKE '%loyal%') AND active = 1"
}

{
  "error": "sql_error",
  "detail": "no such column: active"
}

⚙ query_db(PRAGMA table_info(discounts))

{
  "sql": "PRAGMA table_info(discounts)"
}

{
  "error": "read_only",
  "detail": "Only SELECT/WITH queries are allowed."
}

⚙ query_db(SELECT code, label, effect, stack_order, eligibility, notes, discount_id FROM…)

{
  "sql": "SELECT code, label, effect, stack_order, eligibility, notes, discount_id FROM discounts LIMIT 5"
}

{
  "rows": [
    {
      "code": "SAFE_DRIVER",
      "label": "Safe Driver",
      "effect": "{\"type\": \"PCT_OFF\", \"value\": 0.12}",
      "stack_order": 10,
      "eligibility": "line in [AUTO,MOTO] and driver_incidents_5yr == 0",
      "notes": null,
      "discount_id": "DISC-SAFEDRIVER"
    },
    {
      "code": "MULTILINE",
      "label": "Multi-Line (Bundle)",
      "effect": "{\"type\": \"PCT_OFF\", \"value\": 0.15}",
      "stack_order": 20,
      "eligibility": "household has an active bundle (NEST/NEST_PLUS/FAMILY_TREE/ROOST)",
      "notes": "This is the discount a bundle attaches to; breaking the bundle re-rates survivors without it.",
      "discount_id": "DISC-MULTILINE"
    },
    {
      "code": "PAID_IN_FULL",
      "label": "Paid In Full",
      "effect": "{\"type\": \"PCT_OFF\", \"value\": 0.07}",
      "stack_order": 30,
      "eligibility": "billing.plan == PAY_IN_FULL",
      "notes": null,
      "discount_id": "DISC-PAID-IN-FULL"
    },
    {
      "code": "PAPERLESS",
      "label": "Paperless Billing",
      "effect": "{\"type\": \"DOLLARS_OFF\", \"value\": 25}",
      "stack_order": 40,
      "eligibility": "contact.paperless == true",
      "notes": null,
      "discount_id": "DISC-PAPERLESS"
    },
    {
      "code": "AUTOPAY",
      "label": "Automatic Payments",
      "effect": "{\"type\": \"PCT_OFF\", \"value\": 0.03}",
      "stack_order": 50,
      "eligibility": "billing.autopay == true",
      "notes": null,
      "discount_id": "DISC-AUTOPAY"
    }
  ],
  "row_count": 5,
  "truncated": false
}

⚙ query_db(SELECT policy_id, line, tier_id, status, effective_date, expiration_date, rat…)

{
  "sql": "SELECT policy_id, line, tier_id, status, effective_date, expiration_date, rating_as_of, rating_inputs, premium_breakdown FROM policies WHERE cust_id='CUST-nest-household'"
}

{
  "rows": [
    {
      "policy_id": "POL-nest-household-p_auto",
      "line": "AUTO",
      "tier_id": "AUTO:PINE",
      "status": "ACTIVE",
      "effective_date": "2025-01-15",
      "expiration_date": "2026-01-15",
      "rating_as_of": "2025-01-15",
      "rating_inputs": "{\"billing\": {\"plan\": \"PAY_IN_FULL\", \"autopay\": true, \"paperless\": true}, \"incidents_5yr\": 0, \"smoker\": false, \"promo_code\": null}",
      "premium_breakdown": "[{\"step\": \"BASE\", \"code\": \"base\", \"detail\": \"base_rate $900\", \"factor\": null, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"tier:PINE\", \"detail\": \"tier factor \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"region:R-MW\", \"detail\": \"region factor \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"RISK\", \"code\": \"factor:driver_age\", \"detail\": \"driver_age=44 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"RISK\", \"code\": \"factor:risk_score\", \"detail\": \"risk_score=765 \\u00d70.84\", \"factor\": 0.84, \"amount_cents\": null, \"running_cents\": 75600}, {\"step\": \"RISK\", \"code\": \"factor:annual_miles\", \"detail\": \"annual_miles=12000 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 75600}, {\"step\": \"RISK\", \"code\": \"factor:vehicle_age\", \"detail\": \"vehicle_age=4 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 75600}, {\"step\": \"RISK\", \"code\": \"factor:incidents_5yr\", \"detail\": \"incidents_5yr=0 \\u00d70.95\", \"factor\": 0.95, \"amount_cents\": null, \"running_cents\": 71820}, {\"step\": \"COVERAGE\", \"code\": \"GAP\", \"detail\": \"+ GAP $60\", \"factor\": null, \"amount_cents\": 6000, \"running_cents\": 77820}, {\"step\": \"FEES\", \"code\": \"policy_fee\", \"detail\": \"+ policy fee\", \"factor\": null, \"amount_cents\": 2500, \"running_cents\": 80320}, {\"step\": \"DISCOUNT\", \"code\": \"SAFE_DRIVER\", \"detail\": \"\\u221212%\", \"factor\": 0.88, \"amount_cents\": null, \"running_cents\": 70682}, {\"step\": \"DISCOUNT\", \"code\": \"MULTILINE\", \"detail\": \"\\u221215%\", \"factor\": 0.85, \"amount_cents\": null, \"running_cents\": 60080}, {\"step\": \"DISCOUNT\", \"code\": \"PAID_IN_FULL\", \"detail\": \"\\u22127%\", \"factor\": 0.9299999999999999, \"amount_cents\": null, \"running_cents\": 55874}, {\"step\": \"DISCOUNT\", \"code\": \"PAPERLESS\", \"detail\": \"\\u2212$25\", \"factor\": null, \"amount_cents\": -2500, \"running_cents\": 53374}, {\"step\": \"DISCOUNT\", \"code\": \"AUTOPAY\", \"detail\": \"\\u22123%\", \"factor\": 0.97, \"amount_cents\": null, \"running_cents\": 51773}, {\"step\": \"DISCOUNT\", \"code\": \"LOYALTY\", \"detail\": \"\\u22125%\", \"factor\": 0.95, \"amount_cents\": null, \"running_cents\": 49184}]"
    },
    {
      "policy_id": "POL-nest-household-p_home",
      "line": "HOME",
      "tier_id": "HOME:EVERGREEN",
      "status": "ACTIVE",
      "effective_date": "2025-01-15",
      "expiration_date": "2026-01-15",
      "rating_as_of": "2025-01-15",
      "rating_inputs": "{\"billing\": {\"plan\": \"INSTALLMENTS\", \"autopay\": true, \"paperless\": true}, \"incidents_5yr\": 0, \"smoker\": false, \"promo_code\": null}",
      "premium_breakdown": "[{\"step\": \"BASE\", \"code\": \"base\", \"detail\": \"$4.2/$1k \\u00d7 RC $380,000.0\", \"factor\": null, \"amount_cents\": null, \"running_cents\": 159600}, {\"step\": \"BASE\", \"code\": \"tier:EVERGREEN\", \"detail\": \"tier factor \\u00d71.22\", \"factor\": 1.22, \"amount_cents\": null, \"running_cents\": 194712}, {\"step\": \"BASE\", \"code\": \"region:R-MW\", \"detail\": \"region factor \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 194712}, {\"step\": \"RISK\", \"code\": \"factor:roof_age\", \"detail\": \"roof_age=11 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 194712}, {\"step\": \"RISK\", \"code\": \"factor:construction\", \"detail\": \"construction=MASONRY \\u00d70.95\", \"factor\": 0.95, \"amount_cents\": null, \"running_cents\": 184976}, {\"step\": \"RISK\", \"code\": \"factor:protection_class\", \"detail\": \"protection_class=4 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 184976}, {\"step\": \"RISK\", \"code\": \"factor:dist_to_coast_mi\", \"detail\": \"dist_to_coast_mi=60 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 184976}, {\"step\": \"RISK\", \"code\": \"factor:risk_score\", \"detail\": \"risk_score=765 \\u00d70.88\", \"factor\": 0.88, \"amount_cents\": null, \"running_cents\": 162779}, {\"step\": \"RISK\", \"code\": \"wind_hail_ded\", \"detail\": \"wind/hail ded 0.02 \\u00d70.96\", \"factor\": 0.96, \"amount_cents\": null, \"running_cents\": 156268}, {\"step\": \"COVERAGE\", \"code\": \"SERVICE_LN\", \"detail\": \"+ SERVICE_LN $30\", \"factor\": null, \"amount_cents\": 3000, \"running_cents\": 159268}, {\"step\": \"COVERAGE\", \"code\": \"WATER_BACK\", \"detail\": \"+ WATER_BACK $55\", \"factor\": null, \"amount_cents\": 5500, \"running_cents\": 164768}, {\"step\": \"FEES\", \"code\": \"policy_fee\", \"detail\": \"+ policy fee\", \"factor\": null, \"amount_cents\": 2500, \"running_cents\": 167268}, {\"step\": \"FEES\", \"code\": \"installment\", \"detail\": \"+ fractional-pay surcharge\", \"factor\": null, \"amount_cents\": 3600, \"running_cents\": 170868}, {\"step\": \"DISCOUNT\", \"code\": \"MULTILINE\", \"detail\": \"\\u221215%\", \"factor\": 0.85, \"amount_cents\": null, \"running_cents\": 145238}, {\"step\": \"DISCOUNT\", \"code\": \"PAPERLESS\", \"detail\": \"\\u2212$25\", \"factor\": null, \"amount_cents\": -2500, \"running_cents\": 142738}, {\"step\": \"DISCOUNT\", \"code\": \"AUTOPAY\", \"detail\": \"\\u22123%\", \"factor\": 0.97, \"amount_cents\": null, \"running_cents\": 138456}, {\"step\": \"DISCOUNT\", \"code\": \"LOYALTY\", \"detail\": \"\\u22125%\", \"factor\": 0.95, \"amount_cents\": null, \"running_cents\": 131533}]"
    }
  ],
  "row_count": 2,
  "truncated": false
}

Yes—based on your policies, you’re already receiving a Loyalty discount.

Your loyalty tier: Timber
On AUTO (POL-nest-household-p_auto): Loyalty discount shows as −5% in the premium breakdown.
On HOME (POL-nest-household-p_home): Loyalty discount shows as −5% in the premium breakdown.

At the moment, there isn’t an additional “loyalty” discount I can apply beyond what’s already on your current rating.

If you’d like, I can help you look for extra savings that may still be available for you (for example: whether you’re already getting the multi-line/bundle, paperless, autopay, and any other eligible discount types). Want me to run a quick discount eligibility review for both your AUTO and HOME policies?

44k in · 401 out · $0.0031 · 6.8s

Customer

No, that's okay. Thanks for checking on that and explaining why I can't get the WELCOME15. I appreciate your help!

Agent

⚙ end_conversation()

{}

{
  "ok": true,
  "note": "Deliver your closing message now."
}

You’re very welcome, Marisol—glad I could help clarify why WELCOME15 didn’t apply and confirm your loyalty discount. If anything changes with your policies, feel free to reach back out anytime.

19k in · 59 out · $0.0008 · 1.9s