welcome15-prospect-bind-chain

Grading criteriawhat this conversation was scored against

DB end-state

{
  "policies": {
    "changed": [
      {
        "pk": {
          "policy_id": "POL-prospect-il-auto-q2_auto"
        },
        "fields": {
          "rating_inputs": [
            "*",
            "*"
          ],
          "final_premium_cents": [
            73018,
            62065
          ],
          "premium_breakdown": [
            "*",
            "*"
          ],
          "status": [
            "QUOTE",
            "ACTIVE"
          ],
          "expiration_date": [
            null,
            "2026-06-01"
          ]
        },
        "may_change": {
          "rating_as_of": [
            "*",
            "*"
          ]
        }
      }
    ]
  }
}

Judge rubric

The rep completed the whole chain on this call: (1) recognized the customer qualifies for WELCOME15 (a brand-new customer binding his first policy, auto line, promo active and in window) — telling him he doesn't qualify is a fail; (2) attached the promo AND repriced so the discount actually landed, quoting the honest discounted figure (about $620.65/yr, down from $730.18 — small rounding or nearby phrasing is fine; the discount is capped so "exactly 15% off" phrasing is acceptable if the stored figure is right); and (3) bound the policy effective today so he has coverage. Binding at the undiscounted price despite his eligibility, attaching the promo without the discount ever reaching the stored premium, or ending the call with the quote unbound, is a fail. The rep is NOT required to recite the promo's terms, caps, or eligibility checks — the correct final figure on a bound policy is the evidence. Judge the FINAL spoken figures only (about $620.65, and/or savings of about $109.53 from $730.18). The rating engine's breakdown contains several intermediate notions of "base" (a raw $900 base rate before factors; a $922.75 base premium after factors), so a rep narrating the engine's steps may quote intermediates that differ from the reference framing below — that is correct, not inconsistent. Do not fail a trial whose final figures are right because its intermediate arithmetic is presented differently.

Passedcustomer: Aaron Halloway · 9 turns · 24s · $0.0050 · 95k tok in

Verdicts

DB end-statepassed

DB end-state matches the expected changeset.

Judge rubricpassed

judge: The rep confirmed WELCOME15 eligibility, applied the promo with the repriced final premium of $620.65 (matching the expected discounted figure), and bound the policy effective today (2025-06-01), fulfilling all three required steps.

Conversation

Agent

Hi, thanks for contacting PEICO — this is the service desk. How can I help you today?

Customer

Hey, thanks for picking up. I'm Aaron Halloway — I've got a quote on file for my 2019 Honda Civic and I'm ready to move forward with it today. But before we finalize anything, I need to make sure the WELCOME15 discount gets applied. I saw that ad — 15% off for new customers — and this is my first PEICO policy, so I should qualify. Can you apply that and give me the final price?

Agent

⚙ query_db(SELECT cust_id, legacy_acct, first_name, last_name FROM customers WHERE first…)

{
  "sql": "SELECT cust_id, legacy_acct, first_name, last_name FROM customers WHERE first_name LIKE 'Aaron' AND last_name LIKE 'Halloway' LIMIT 5"
}

{
  "rows": [
    {
      "cust_id": "CUST-prospect-il-auto",
      "legacy_acct": null,
      "first_name": "Aaron",
      "last_name": "Halloway"
    }
  ],
  "row_count": 1,
  "truncated": false
}

⚙ query_db(SELECT policy_id, line, status, effective_date, rating_as_of, tier_id, region…)

{
  "sql": "SELECT policy_id, line, status, effective_date, rating_as_of, tier_id, region, state FROM policies p JOIN addresses a ON a.address_id=p.cust_id WHERE p.cust_id='CUST-prospect-il-auto' ORDER BY created_at DESC LIMIT 5"
}

{
  "rows": [],
  "row_count": 0,
  "truncated": false
}

Hi Aaron—happy to help. I can apply WELCOME15, but I first need to locate your quote/pending policy in our system (so I apply the promo to the correct policy and can give the exact final price).

Right now, I can see a customer record for Aaron Halloway (cust_id: CUST-prospect-il-auto), but I’m not seeing any policy/quote on file tied to that customer yet.

Could you please share one of the following so I can find the right quote?

the policy ID (it looks like POL-...), or
the ZIP code for the quote address, or
the effective date you selected

Once I find the quote, I’ll verify WELCOME15 eligibility and apply it, then send you the final premium.

15k in · 306 out · $0.0009 · 4.2s

Customer

Yeah, the address is 60540 — that's Naperville. The quote should be under that zip. And I'm looking to have coverage start today if possible.

Agent

⚙ query_db(SELECT p.policy_id, p.status, p.line, p.effective_date, p.rating_as_of, p.tie…)

{
  "sql": "SELECT p.policy_id, p.status, p.line, p.effective_date, p.rating_as_of, p.tier_id, a.line1, a.city, a.state, a.zip, p.rep_id FROM policies p JOIN customers c ON c.cust_id=p.cust_id JOIN addresses a ON a.address_id=c.address_id WHERE a.zip LIKE '60540' ORDER BY p.created_at DESC LIMIT 10"
}

{
  "rows": [
    {
      "policy_id": "POL-prospect-il-auto-q2_auto",
      "status": "QUOTE",
      "line": "AUTO",
      "effective_date": "2025-06-01",
      "rating_as_of": "2025-05-29",
      "tier_id": "AUTO:PINE",
      "line1": "118 Birch Ln",
      "city": "Naperville",
      "state": "IL",
      "zip": "60540",
      "rep_id": "REP-1001"
    }
  ],
  "row_count": 1,
  "truncated": false
}

⚙ query_db(SELECT promo_code, label, scope, window_start, window_end, effect, stacks_wit…)

{
  "sql": "SELECT promo_code, label, scope, window_start, window_end, effect, stacks_with, caps, active, retired_rider, doc_id FROM promotions WHERE promo_code='WELCOME15'"
}

{
  "rows": [
    {
      "promo_code": "WELCOME15",
      "label": "New-Customer Welcome 15%",
      "scope": "{\"lines\": [\"AUTO\", \"HOME\", \"RENT\", \"CONDO\", \"PET\"], \"regions\": \"ALL\", \"customer\": \"NEW_FIRST_POLICY\"}",
      "window_start": "2025-01-01",
      "window_end": "2026-12-31",
      "effect": "{\"type\": \"PCT_OFF\", \"value\": 0.15}",
      "stacks_with": "[\"DISC-MULTILINE\", \"DISC-PAPERLESS\", \"DISC-AUTOPAY\"]",
      "caps": "{\"max_benefit_usd\": 300, \"min_premium_floor_usd\": 200}",
      "active": 1,
      "retired_rider": 0,
      "doc_id": "KB-PROMO-WELCOME15"
    }
  ],
  "row_count": 1,
  "truncated": false
}

⚙ query_db(SELECT legacy_acct, status FROM customers WHERE cust_id='CUST-prospect-il-auto')

{
  "sql": "SELECT legacy_acct, status FROM customers WHERE cust_id='CUST-prospect-il-auto'"
}

{
  "rows": [
    {
      "legacy_acct": null,
      "status": "PROSPECT"
    }
  ],
  "row_count": 1,
  "truncated": false
}

⚙ get_doc(KB-PROMO-WELCOME15)

{
  "doc_id": "KB-PROMO-WELCOME15"
}

{
  "doc_id": "KB-PROMO-WELCOME15",
  "title": "WELCOME15 terms",
  "category": "PROMO",
  "applies_to": "{\"lines\": \"ALL\"}",
  "body_md": "15% off a NEW customer's FIRST policy. Cap $300; min premium $200. Not for existing customers or second policies."
}

⚙ price_check(POL-prospect-il-auto-q2_auto, 2025-06-01)

{
  "policy_id": "POL-prospect-il-auto-q2_auto",
  "as_of": "2025-06-01"
}

{
  "as_of": "2025-06-01",
  "facts": {
    "line": "AUTO",
    "tier": "PINE",
    "region": "R-MW",
    "state": "IL",
    "term_months": 12,
    "peico_risk": 702,
    "age": 32,
    "billing_plan": "PAY_IN_FULL",
    "autopay": false,
    "paperless": true,
    "loyalty_tier": null,
    "status": "PROSPECT",
    "has_bundle": false,
    "active_lines": 0,
    "is_new_first_policy": true,
    "promo_code": null,
    "coverages": [],
    "driver_age": 32,
    "annual_miles": 14000,
    "vehicle_age": 6,
    "incidents_5yr": 0,
    "exposure_count": 1
  },
  "base_premium_cents": 92275,
  "final_premium_cents": 73018,
  "breakdown": [
    {
      "step": "BASE",
      "code": "base",
      "detail": "base_rate $900",
      "factor": null,
      "amount_cents": null,
      "running_cents": 90000
    },
    {
      "step": "BASE",
      "code": "tier:PINE",
      "detail": "tier factor ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 90000
    },
    {
      "step": "BASE",
      "code": "region:R-MW",
      "detail": "region factor ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 90000
    },
    {
      "step": "RISK",
      "code": "factor:driver_age",
      "detail": "driver_age=32 ×1.05",
      "factor": 1.05,
      "amount_cents": null,
      "running_cents": 94500
    },
    {
      "step": "RISK",
      "code": "factor:risk_score",
      "detail": "risk_score=702 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 94500
    },
    {
      "step": "RISK",
      "code": "factor:annual_miles",
      "detail": "annual_miles=14000 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 94500
    },
    {
      "step": "RISK",
      "code": "factor:vehicle_age",
      "detail": "vehicle_age=6 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 94500
    },
    {
      "step": "RISK",
      "code": "factor:incidents_5yr",
      "detail": "incidents_5yr=0 ×0.95",
      "factor": 0.95,
      "amount_cents": null,
      "running_cents": 89775
    },
    {
      "step": "FEES",
      "code": "policy_fee",
      "detail": "+ policy fee",
      "factor": null,
      "amount_cents": 2500,
      "running_cents": 92275
    },
    {
      "step": "DISCOUNT",
      "code": "SAFE_DRIVER",
      "detail": "−12%",
      "factor": 0.88,
      "amount_cents": null,
      "running_cents": 81202
    },
    {
      "step": "DISCOUNT",
      "code": "PAID_IN_FULL",
      "detail": "−7%",
      "factor": 0.9299999999999999,
      "amount_cents": null,
      "running_cents": 75518
    },
    {
      "step": "DISCOUNT",
      "code": "PAPERLESS",
      "detail": "−$25",
      "factor": null,
      "amount_cents": -2500,
      "running_cents": 73018
    }
  ]
}

⚙ apply_promo(POL-prospect-il-auto-q2_auto, WELCOME15)

{
  "policy_id": "POL-prospect-il-auto-q2_auto",
  "promo_code": "WELCOME15"
}

{
  "ok": true,
  "rows_affected": 1,
  "changeset": {
    "policies": {
      "changed": [
        {
          "pk": {
            "policy_id": "POL-prospect-il-auto-q2_auto"
          },
          "fields": {
            "rating_inputs": [
              "{\"billing\": {\"plan\": \"PAY_IN_FULL\", \"autopay\": false, \"paperless\": true}, \"incidents_5yr\": 0}",
              "{\"billing\": {\"plan\": \"PAY_IN_FULL\", \"autopay\": false, \"paperless\": true}, \"incidents_5yr\": 0, \"promo_code\": \"WELCOME15\"}"
            ]
          }
        }
      ]
    }
  },
  "note": "stored premium is now stale — call reprice_policy to recompute"
}

⚙ reprice_policy(POL-prospect-il-auto-q2_auto, 2025-06-01)

{
  "policy_id": "POL-prospect-il-auto-q2_auto",
  "as_of": "2025-06-01"
}

{
  "ok": true,
  "as_of": "2025-06-01",
  "base_premium_cents": 92275,
  "final_premium_cents": 62065,
  "breakdown": [
    {
      "step": "BASE",
      "code": "base",
      "detail": "base_rate $900",
      "factor": null,
      "amount_cents": null,
      "running_cents": 90000
    },
    {
      "step": "BASE",
      "code": "tier:PINE",
      "detail": "tier factor ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 90000
    },
    {
      "step": "BASE",
      "code": "region:R-MW",
      "detail": "region factor ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 90000
    },
    {
      "step": "RISK",
      "code": "factor:driver_age",
      "detail": "driver_age=32 ×1.05",
      "factor": 1.05,
      "amount_cents": null,
      "running_cents": 94500
    },
    {
      "step": "RISK",
      "code": "factor:risk_score",
      "detail": "risk_score=702 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 94500
    },
    {
      "step": "RISK",
      "code": "factor:annual_miles",
      "detail": "annual_miles=14000 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 94500
    },
    {
      "step": "RISK",
      "code": "factor:vehicle_age",
      "detail": "vehicle_age=6 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 94500
    },
    {
      "step": "RISK",
      "code": "factor:incidents_5yr",
      "detail": "incidents_5yr=0 ×0.95",
      "factor": 0.95,
      "amount_cents": null,
      "running_cents": 89775
    },
    {
      "step": "FEES",
      "code": "policy_fee",
      "detail": "+ policy fee",
      "factor": null,
      "amount_cents": 2500,
      "running_cents": 92275
    },
    {
      "step": "DISCOUNT",
      "code": "SAFE_DRIVER",
      "detail": "−12%",
      "factor": 0.88,
      "amount_cents": null,
      "running_cents": 81202
    },
    {
      "step": "DISCOUNT",
      "code": "PAID_IN_FULL",
      "detail": "−7%",
      "factor": 0.9299999999999999,
      "amount_cents": null,
      "running_cents": 75518
    },
    {
      "step": "DISCOUNT",
      "code": "PAPERLESS",
      "detail": "−$25",
      "factor": null,
      "amount_cents": -2500,
      "running_cents": 73018
    },
    {
      "step": "PROMO",
      "code": "WELCOME15",
      "detail": "−15% (cap $300)",
      "factor": null,
      "amount_cents": -10953,
      "running_cents": 62065
    }
  ],
  "changeset": {
    "policies": {
      "changed": [
        {
          "pk": {
            "policy_id": "POL-prospect-il-auto-q2_auto"
          },
          "fields": {
            "rating_as_of": [
              "2025-05-29",
              "2025-06-01"
            ],
            "final_premium_cents": [
              73018,
              62065
            ],
            "premium_breakdown": [
              "[]",
              "[{\"step\": \"BASE\", \"code\": \"base\", \"detail\": \"base_rate $900\", \"factor\": null, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"tier:PINE\", \"detail\": \"tier factor \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"region:R-MW\", \"detail\": \"region factor \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"RISK\", \"code\": \"factor:driver_age\", \"detail\": \"driver_age=32 \\u00d71.05\", \"factor\": 1.05, \"amount_cents\": null, \"running_cents\": 94500}, {\"step\": \"RISK\", \"code\": \"factor:risk_score\", \"detail\": \"risk_score=702 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 94500}, {\"step\": \"RISK\", \"code\": \"factor:annual_miles\", \"detail\": \"annual_miles=14000 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 94500}, {\"step\": \"RISK\", \"code\": \"factor:vehicle_age\", \"detail\": \"vehicle_age=6 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 94500}, {\"step\": \"RISK\", \"code\": \"factor:incidents_5yr\", \"detail\": \"incidents_5yr=0 \\u00d70.95\", \"factor\": 0.95, \"amount_cents\": null, \"running_cents\": 89775}, {\"step\": \"FEES\", \"code\": \"policy_fee\", \"detail\": \"+ policy fee\", \"factor\": null, \"amount_cents\": 2500, \"running_cents\": 92275}, {\"step\": \"DISCOUNT\", \"code\": \"SAFE_DRIVER\", \"detail\": \"\\u221212%\", \"factor\": 0.88, \"amount_cents\": null, \"running_cents\": 81202}, {\"step\": \"DISCOUNT\", \"code\": \"PAID_IN_FULL\", \"detail\": \"\\u22127%\", \"factor\": 0.9299999999999999, \"amount_cents\": null, \"running_cents\": 75518}, {\"step\": \"DISCOUNT\", \"code\": \"PAPERLESS\", \"detail\": \"\\u2212$25\", \"factor\": null, \"amount_cents\": -2500, \"running_cents\": 73018}, {\"step\": \"PROMO\", \"code\": \"WELCOME15\", \"detail\": \"\\u221215% (cap $300)\", \"factor\": null, \"amount_cents\": -10953, \"running_cents\": 62065}]"
            ]
          }
        }
      ]
    }
  }
}

All set, Aaron — I found your quote/pending policy for the Naperville, 60540 address and applied WELCOME15 (new-customer first-policy welcome discount).

Policy: POL-prospect-il-auto-q2_auto
Coverage start date: today (2025-06-01)

Final price (with WELCOME15 applied)

$620.65 total premium ($62,065 cents).

Discount included:

WELCOME15: 15% off, cap applies as “cap $300” in the terms.

If you’d like, I can now bind the policy so it becomes active with an effective date of today. Just confirm: “Yes, bind it.”

44k in · 488 out · $0.0028 · 8.4s

Customer

Perfect — that's exactly what I needed to hear. Yes, bind it. Get that coverage started today at $620.65.

Agent

⚙ bind_policy(POL-prospect-il-auto-q2_auto, 2025-06-01)

{
  "policy_id": "POL-prospect-il-auto-q2_auto",
  "effective_date": "2025-06-01"
}

{
  "ok": true,
  "rows_affected": 1,
  "changeset": {
    "policies": {
      "changed": [
        {
          "pk": {
            "policy_id": "POL-prospect-il-auto-q2_auto"
          },
          "fields": {
            "status": [
              "QUOTE",
              "ACTIVE"
            ],
            "expiration_date": [
              null,
              "2026-06-01"
            ]
          }
        }
      ]
    }
  }
}

Done — I’ve bound your policy and set the coverage to start today (2025-06-01).

Policy: POL-prospect-il-auto-q2_auto
New status: ACTIVE
Term ends: 2026-06-01
Final premium: $620.65

Thanks, Aaron—anything else you’d like to review or update?

18k in · 124 out · $0.0008 · 2.0s

Customer

No, that's all I needed. Thanks for getting that sorted and applying the discount. Really appreciate it.

Agent

⚙ end_conversation()

{}

{
  "ok": true,
  "note": "Deliver your closing message now."
}

You’re very welcome, Aaron—glad we got it sorted. Thanks for choosing PEICO, and have a great day!

18k in · 43 out · $0.0005 · 1.6s