welcome15-prospect-bind-chain
Grading criteriawhat this conversation was scored against
DB end-state
{
"policies": {
"changed": [
{
"pk": {
"policy_id": "POL-prospect-il-auto-q2_auto"
},
"fields": {
"rating_inputs": [
"*",
"*"
],
"final_premium_cents": [
73018,
62065
],
"premium_breakdown": [
"*",
"*"
],
"status": [
"QUOTE",
"ACTIVE"
],
"expiration_date": [
null,
"2026-06-01"
]
},
"may_change": {
"rating_as_of": [
"*",
"*"
]
}
}
]
}
}Judge rubric
The rep completed the whole chain on this call: (1) recognized the customer qualifies for WELCOME15 (a brand-new customer binding his first policy, auto line, promo active and in window) — telling him he doesn't qualify is a fail; (2) attached the promo AND repriced so the discount actually landed, quoting the honest discounted figure (about $620.65/yr, down from $730.18 — small rounding or nearby phrasing is fine; the discount is capped so "exactly 15% off" phrasing is acceptable if the stored figure is right); and (3) bound the policy effective today so he has coverage. Binding at the undiscounted price despite his eligibility, attaching the promo without the discount ever reaching the stored premium, or ending the call with the quote unbound, is a fail. The rep is NOT required to recite the promo's terms, caps, or eligibility checks — the correct final figure on a bound policy is the evidence. Judge the FINAL spoken figures only (about $620.65, and/or savings of about $109.53 from $730.18). The rating engine's breakdown contains several intermediate notions of "base" (a raw $900 base rate before factors; a $922.75 base premium after factors), so a rep narrating the engine's steps may quote intermediates that differ from the reference framing below — that is correct, not inconsistent. Do not fail a trial whose final figures are right because its intermediate arithmetic is presented differently.
Passedcustomer: Aaron Halloway · 7 turns · 92s · $0.37 · 157k tok in
Verdicts
DB end-statepassed
DB end-state matches the expected changeset.
Judge rubricpassed
judge: The rep recognized Aaron's eligibility for WELCOME15, applied and repriced the promo to the correct final figure of $620.65 (down from $730.18 base... actually shown as $922.75 with other discounts, landing at $620.65 with $109.53 savings from WELCOME15), and bound the policy effective today, June 1, 2025, satisfying all three required steps.
Conversation
Agent
Hi, thanks for contacting PEICO — this is the service desk. How can I help you today?
Customer
Hey, thanks for picking up. I'm Aaron Halloway — I've got a quote on file for my 2019 Honda Civic, and I'm ready to move forward with it today. But before I finalize, I need to make sure the WELCOME15 new-customer discount gets applied. I saw that advertised, and since this would be my first PEICO policy, I should qualify. Can you apply that and give me the final price with the discount included?
Agent
63k in · 1,555 out · $0.18 · 43.7s⚙ query_db(SELECT cust_id, first_name, last_name, status, email, phone, tenure_start, cr…)
{
"sql": "SELECT cust_id, first_name, last_name, status, email, phone, tenure_start, created_at FROM customers WHERE last_name = 'Halloway'"
}{
"rows": [
{
"cust_id": "CUST-prospect-il-auto",
"first_name": "Aaron",
"last_name": "Halloway",
"status": "PROSPECT",
"email": "aaron.halloway@example.com",
"phone": null,
"tenure_start": null,
"created_at": "2025-06-01"
}
],
"row_count": 1,
"truncated": false
}⚙ query_db(SELECT * FROM promotions WHERE promo_code = 'WELCOME15')
{
"sql": "SELECT * FROM promotions WHERE promo_code = 'WELCOME15'"
}{
"rows": [
{
"promo_code": "WELCOME15",
"label": "New-Customer Welcome 15%",
"scope": "{\"lines\": [\"AUTO\", \"HOME\", \"RENT\", \"CONDO\", \"PET\"], \"regions\": \"ALL\", \"customer\": \"NEW_FIRST_POLICY\"}",
"window_start": "2025-01-01",
"window_end": "2026-12-31",
"effect": "{\"type\": \"PCT_OFF\", \"value\": 0.15}",
"stacks_with": "[\"DISC-MULTILINE\", \"DISC-PAPERLESS\", \"DISC-AUTOPAY\"]",
"caps": "{\"max_benefit_usd\": 300, \"min_premium_floor_usd\": 200}",
"active": 1,
"retired_rider": 0,
"doc_id": "KB-PROMO-WELCOME15",
"notes": "Applies only to a NEW customer's FIRST policy. Does not stack with SPRINGSAVE."
}
],
"row_count": 1,
"truncated": false
}⚙ query_db(SELECT p.policy_id, p.line, p.tier_id, p.status, p.base_premium_cents, p.fina…)
{
"sql": "SELECT p.policy_id, p.line, p.tier_id, p.status, p.base_premium_cents, p.final_premium_cents, p.rating_as_of, p.term_months, p.effective_date FROM policies p WHERE p.cust_id = 'CUST-prospect-il-auto'"
}{
"rows": [
{
"policy_id": "POL-prospect-il-auto-q2_auto",
"line": "AUTO",
"tier_id": "AUTO:PINE",
"status": "QUOTE",
"base_premium_cents": 92275,
"final_premium_cents": 73018,
"rating_as_of": "2025-05-29",
"term_months": 12,
"effective_date": "2025-06-01"
}
],
"row_count": 1,
"truncated": false
}⚙ get_doc(KB-PROMO-WELCOME15)
{
"doc_id": "KB-PROMO-WELCOME15"
}{
"doc_id": "KB-PROMO-WELCOME15",
"title": "WELCOME15 terms",
"category": "PROMO",
"applies_to": "{\"lines\": \"ALL\"}",
"body_md": "15% off a NEW customer's FIRST policy. Cap $300; min premium $200. Not for existing customers or second policies."
}⚙ query_db(SELECT v.vehicle_id, v.year, v.make, v.model FROM policy_objects po JOIN vehi…)
{
"sql": "SELECT v.vehicle_id, v.year, v.make, v.model FROM policy_objects po JOIN vehicles v ON v.vehicle_id = po.object_id WHERE po.policy_id = 'POL-prospect-il-auto-q2_auto'"
}{
"rows": [
{
"vehicle_id": "VEH-prospect-il-auto-v1",
"year": 2019,
"make": "Honda",
"model": "Civic"
}
],
"row_count": 1,
"truncated": false
}⚙ apply_promo(POL-prospect-il-auto-q2_auto, WELCOME15)
{
"policy_id": "POL-prospect-il-auto-q2_auto",
"promo_code": "WELCOME15"
}{
"ok": true,
"rows_affected": 1,
"changeset": {
"policies": {
"changed": [
{
"pk": {
"policy_id": "POL-prospect-il-auto-q2_auto"
},
"fields": {
"rating_inputs": [
"{\"billing\": {\"plan\": \"PAY_IN_FULL\", \"autopay\": false, \"paperless\": true}, \"incidents_5yr\": 0}",
"{\"billing\": {\"plan\": \"PAY_IN_FULL\", \"autopay\": false, \"paperless\": true}, \"incidents_5yr\": 0, \"promo_code\": \"WELCOME15\"}"
]
}
}
]
}
},
"note": "stored premium is now stale — call reprice_policy to recompute"
}⚙ reprice_policy(POL-prospect-il-auto-q2_auto)
{
"policy_id": "POL-prospect-il-auto-q2_auto"
}{
"ok": true,
"as_of": "2025-05-29",
"base_premium_cents": 92275,
"final_premium_cents": 62065,
"breakdown": [
{
"step": "BASE",
"code": "base",
"detail": "base_rate $900",
"factor": null,
"amount_cents": null,
"running_cents": 90000
},
{
"step": "BASE",
"code": "tier:PINE",
"detail": "tier factor ×1.0",
"factor": 1,
"amount_cents": null,
"running_cents": 90000
},
{
"step": "BASE",
"code": "region:R-MW",
"detail": "region factor ×1.0",
"factor": 1,
"amount_cents": null,
"running_cents": 90000
},
{
"step": "RISK",
"code": "factor:driver_age",
"detail": "driver_age=32 ×1.05",
"factor": 1.05,
"amount_cents": null,
"running_cents": 94500
},
{
"step": "RISK",
"code": "factor:risk_score",
"detail": "risk_score=702 ×1.0",
"factor": 1,
"amount_cents": null,
"running_cents": 94500
},
{
"step": "RISK",
"code": "factor:annual_miles",
"detail": "annual_miles=14000 ×1.0",
"factor": 1,
"amount_cents": null,
"running_cents": 94500
},
{
"step": "RISK",
"code": "factor:vehicle_age",
"detail": "vehicle_age=6 ×1.0",
"factor": 1,
"amount_cents": null,
"running_cents": 94500
},
{
"step": "RISK",
"code": "factor:incidents_5yr",
"detail": "incidents_5yr=0 ×0.95",
"factor": 0.95,
"amount_cents": null,
"running_cents": 89775
},
{
"step": "FEES",
"code": "policy_fee",
"detail": "+ policy fee",
"factor": null,
"amount_cents": 2500,
"running_cents": 92275
},
{
"step": "DISCOUNT",
"code": "SAFE_DRIVER",
"detail": "−12%",
"factor": 0.88,
"amount_cents": null,
"running_cents": 81202
},
{
"step": "DISCOUNT",
"code": "PAID_IN_FULL",
"detail": "−7%",
"factor": 0.9299999999999999,
"amount_cents": null,
"running_cents": 75518
},
{
"step": "DISCOUNT",
"code": "PAPERLESS",
"detail": "−$25",
"factor": null,
"amount_cents": -2500,
"running_cents": 73018
},
{
"step": "PROMO",
"code": "WELCOME15",
"detail": "−15% (cap $300)",
"factor": null,
"amount_cents": -10953,
"running_cents": 62065
}
],
"changeset": {
"policies": {
"changed": [
{
"pk": {
"policy_id": "POL-prospect-il-auto-q2_auto"
},
"fields": {
"final_premium_cents": [
73018,
62065
],
"premium_breakdown": [
"[]",
"[{\"step\": \"BASE\", \"code\": \"base\", \"detail\": \"base_rate $900\", \"factor\": null, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"tier:PINE\", \"detail\": \"tier factor \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"region:R-MW\", \"detail\": \"region factor \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"RISK\", \"code\": \"factor:driver_age\", \"detail\": \"driver_age=32 \\u00d71.05\", \"factor\": 1.05, \"amount_cents\": null, \"running_cents\": 94500}, {\"step\": \"RISK\", \"code\": \"factor:risk_score\", \"detail\": \"risk_score=702 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 94500}, {\"step\": \"RISK\", \"code\": \"factor:annual_miles\", \"detail\": \"annual_miles=14000 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 94500}, {\"step\": \"RISK\", \"code\": \"factor:vehicle_age\", \"detail\": \"vehicle_age=6 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 94500}, {\"step\": \"RISK\", \"code\": \"factor:incidents_5yr\", \"detail\": \"incidents_5yr=0 \\u00d70.95\", \"factor\": 0.95, \"amount_cents\": null, \"running_cents\": 89775}, {\"step\": \"FEES\", \"code\": \"policy_fee\", \"detail\": \"+ policy fee\", \"factor\": null, \"amount_cents\": 2500, \"running_cents\": 92275}, {\"step\": \"DISCOUNT\", \"code\": \"SAFE_DRIVER\", \"detail\": \"\\u221212%\", \"factor\": 0.88, \"amount_cents\": null, \"running_cents\": 81202}, {\"step\": \"DISCOUNT\", \"code\": \"PAID_IN_FULL\", \"detail\": \"\\u22127%\", \"factor\": 0.9299999999999999, \"amount_cents\": null, \"running_cents\": 75518}, {\"step\": \"DISCOUNT\", \"code\": \"PAPERLESS\", \"detail\": \"\\u2212$25\", \"factor\": null, \"amount_cents\": -2500, \"running_cents\": 73018}, {\"step\": \"PROMO\", \"code\": \"WELCOME15\", \"detail\": \"\\u221215% (cap $300)\", \"factor\": null, \"amount_cents\": -10953, \"running_cents\": 62065}]"
]
}
}
]
}
}
}WELCOME15 is applied. Here's your final price:
Your quote — 2019 Honda Civic (PINE tier, 12-month term)
| Item | Amount |
|---|---|
| Base premium (incl. $25 policy fee) | $922.75 |
| Safe Driver discount (−12%) | −$110.73 |
| Paid-in-Full discount (−7%) | −$56.84 |
| Paperless discount | −$25.00 |
| WELCOME15 promo (−15%) | −$109.53 |
| Final annual premium | $620.65 |
The WELCOME15 discount saved you an extra $109.53 on top of your other discounts.
Would you like me to go ahead and bind the policy effective today (June 1, 2025)?
Customer
Yes, absolutely — that's great! Go ahead and bind it for today, June 1st. I'm good to go with that final price of $620.65.
Agent
61k in · 1,232 out · $0.15 · 31.4s⚙ query_db(SELECT a.state, a.region FROM customers c JOIN addresses a ON a.address_id = …)
{
"sql": "SELECT a.state, a.region FROM customers c JOIN addresses a ON a.address_id = c.address_id WHERE c.cust_id = 'CUST-prospect-il-auto'"
}{
"rows": [
{
"state": "IL",
"region": "R-MW"
}
],
"row_count": 1,
"truncated": false
}⚙ query_db(SELECT * FROM eligibility_rules WHERE line = 'AUTO' AND (tier_id = 'AUTO:PINE…)
{
"sql": "SELECT * FROM eligibility_rules WHERE line = 'AUTO' AND (tier_id = 'AUTO:PINE' OR tier_id IS NULL)"
}{
"rows": [
{
"rule_id": "ELIG-AUTO-GAP-FINANCED",
"line": "AUTO",
"tier_id": null,
"coverage_id": "AUTO:GAP",
"state": null,
"effect": "GATE",
"condition": "vehicle_financed",
"effective_start": null,
"effective_end": null,
"reason_doc": "KB-AUTO-GAP",
"notes": "GAP eligible only when the vehicle is financed/leased."
},
{
"rule_id": "ELIG-AUTO-MED-EVERGREEN",
"line": "AUTO",
"tier_id": null,
"coverage_id": "AUTO:MED",
"state": null,
"effect": "GATE",
"condition": "tier_position_gte_evergreen",
"effective_start": null,
"effective_end": null,
"reason_doc": "KB-AUTO-TIERS",
"notes": "Medical Payments available Evergreen and above."
},
{
"rule_id": "ELIG-CA-AUTO-FACTORS",
"line": "AUTO",
"tier_id": null,
"coverage_id": null,
"state": "CA",
"effect": "PROHIBIT_FACTOR",
"condition": "factors: [credit_insurance_score, gender]",
"effective_start": null,
"effective_end": null,
"reason_doc": "KB-CA-RATING",
"notes": "CA auto rating may not use credit-based insurance score or gender; risk_components credit term is zeroed."
}
],
"row_count": 3,
"truncated": false
}⚙ query_db(SELECT * FROM required_disclosures WHERE line = 'AUTO')
{
"sql": "SELECT * FROM required_disclosures WHERE line = 'AUTO'"
}{
"rows": [
{
"disclosure_id": "DISC-AUTO-UMUIM",
"line": "AUTO",
"code": "UMUIM_SELECTION",
"title": "Uninsured/Underinsured Motorist selection or rejection",
"when_required": "AT_BIND",
"free_look_days": null,
"mandatory": 1,
"state": null,
"condition": null,
"doc_id": "KB-DISC-UMUIM"
}
],
"row_count": 1,
"truncated": false
}⚙ query_db(SELECT * FROM disclosure_deliveries WHERE policy_id = 'POL-prospect-il-auto-q…)
{
"sql": "SELECT * FROM disclosure_deliveries WHERE policy_id = 'POL-prospect-il-auto-q2_auto'"
}{
"rows": [
{
"delivery_id": "DLV-POL-prospect-il-auto-q2_auto-UMUIM_SELECTION",
"policy_id": "POL-prospect-il-auto-q2_auto",
"disclosure_id": "DISC-AUTO-UMUIM",
"delivered_at": "2025-05-29",
"channel": "ESIGN",
"acknowledged": 1,
"notes": "UM/UIM selection captured in the quote e-sign packet."
}
],
"row_count": 1,
"truncated": false
}⚙ query_db(SELECT pc.coverage_id, pc.value, c.label FROM policy_coverages pc JOIN covera…)
{
"sql": "SELECT pc.coverage_id, pc.value, c.label FROM policy_coverages pc JOIN coverages c ON c.coverage_id = pc.coverage_id WHERE pc.policy_id = 'POL-prospect-il-auto-q2_auto'"
}{
"rows": [
{
"coverage_id": "AUTO:BI",
"value": "5000000/10000000",
"label": "Bodily Injury Liability"
},
{
"coverage_id": "AUTO:COLL",
"value": "100000",
"label": "Collision"
},
{
"coverage_id": "AUTO:COMP",
"value": "50000",
"label": "Comprehensive"
},
{
"coverage_id": "AUTO:PD",
"value": "5000000",
"label": "Property Damage Liability"
}
],
"row_count": 4,
"truncated": false
}⚙ get_doc(KB-DISC-UMUIM)
{
"doc_id": "KB-DISC-UMUIM"
}{
"doc_id": "KB-DISC-UMUIM",
"title": "UM/UIM selection or rejection",
"category": "COMPLIANCE",
"applies_to": "{\"lines\": [\"AUTO\"]}",
"body_md": "The customer must affirmatively **select or reject** Uninsured/Underinsured Motorist\ncoverage; the choice (and limits, if selected) is disclosed and recorded at bind.\nSome states mandate UM/UIM at or above the BI limit.\n"
}⚙ bind_policy(POL-prospect-il-auto-q2_auto, 2025-06-01)
{
"policy_id": "POL-prospect-il-auto-q2_auto",
"effective_date": "2025-06-01"
}{
"ok": true,
"rows_affected": 1,
"changeset": {
"policies": {
"changed": [
{
"pk": {
"policy_id": "POL-prospect-il-auto-q2_auto"
},
"fields": {
"status": [
"QUOTE",
"ACTIVE"
],
"expiration_date": [
null,
"2026-06-01"
]
}
}
]
}
}
}🎉 You're all set, Aaron — welcome to PEICO!
Policy POL-prospect-il-auto-q2_auto is now ACTIVE
- Vehicle: 2019 Honda Civic
- Tier: PINE
- Effective: June 1, 2025 → June 1, 2026 (12-month term)
- Annual premium: $620.65, paid in full (WELCOME15 included)
- Coverages: Bodily Injury Liability, Property Damage Liability, Collision, Comprehensive
Is there anything else I can help you with today?
Customer
No, that's perfect — thanks for taking care of that so quickly. Really appreciate it!
Agent
33k in · 100 out · $0.04 · 9.8s⚙ end_conversation()
{}{
"ok": true,
"note": "Deliver your closing message now."
}Thanks again for choosing PEICO — take care!