payinfull-switch-savings

Grading criteriawhat this conversation was scored against

DB end-state

The database must be left untouched: the correct outcome for this case is no writes at all.

Judge rubric

The rep gave the customer the complete, engine-verified savings from switching his auto policy to pay-in-full: about $117.81 per 6-month term (equivalently: his term premium going from about $1,204.68 to about $1,086.87). The savings has TWO components — dropping the $36 fractional-pay surcharge AND gaining the 7% paid-in-full discount — and the rep's final answer must reflect the combined figure. Accept any final savings figure within a few dollars of $117.81 per term (or a new term total within a few dollars of $1,086.87) — e.g., ~$116 from a slightly different fee/discount ordering is a PASS; the tolerance is a couple of dollars, not tens. Telling him only that he'd avoid the ~$36 installment fee, and never producing the combined figure even after he pushes for the full number, is a fail. Giving a materially different combined figure (tens of dollars off — e.g., ~$197 per term, which comes from pricing a 12-month policy instead of his actual 6-month term) is a fail. The rep must not change his billing plan or anything else on this call — he explicitly isn't switching today; describing how to make the switch at renewal is fine.

Passedcustomer: Raymond Castillo · 7 turns · 23s · $0.05 · 65k tok in

Verdicts

DB end-statepassed

DB end-state matches the expected changeset.

Judge rubricpassed

judge: The rep provided the correct combined savings figure of $117.81 per 6-month term ($1,204.68 to $1,086.87), correctly attributing it to both the $36 surcharge removal and the paid-in-full discount, and did not change the billing plan on the call.

Conversation

Agent

Hi, thanks for contacting PEICO — this is the service desk. How can I help you today?

Customer

Hey, thanks for picking up. I've got a quick question about my auto policy. I'm thinking about paying my next term in full instead of doing monthly installments, and I'd like to know exactly how much I'd save by doing that. Can you help me figure out the actual number?

Agent

⚙ query_db(SELECT policy_id, cust_id, line, status, effective_date, expiration_date, fin…)

{
  "sql": "SELECT policy_id, cust_id, line, status, effective_date, expiration_date, final_premium_cents, rating_as_of FROM policies WHERE line = 'AUTO' AND status = 'ACTIVE' ORDER BY created_at DESC LIMIT 5"
}

{
  "rows": [
    {
      "policy_id": "POL-nest-household-p_auto",
      "cust_id": "CUST-nest-household",
      "line": "AUTO",
      "status": "ACTIVE",
      "effective_date": "2025-01-15",
      "expiration_date": "2026-01-15",
      "final_premium_cents": 49184,
      "rating_as_of": "2025-01-15"
    },
    {
      "policy_id": "POL-heritage-auto-p_auto",
      "cust_id": "CUST-heritage-auto",
      "line": "AUTO",
      "status": "ACTIVE",
      "effective_date": "2025-02-01",
      "expiration_date": "2026-02-01",
      "final_premium_cents": 176297,
      "rating_as_of": "2025-02-01"
    },
    {
      "policy_id": "POL-ca-masked-auto-p_auto",
      "cust_id": "CUST-ca-masked-auto",
      "line": "AUTO",
      "status": "ACTIVE",
      "effective_date": "2025-03-10",
      "expiration_date": "2026-03-10",
      "final_premium_cents": 147023,
      "rating_as_of": "2025-03-10"
    },
    {
      "policy_id": "POL-legacy-mismatch-p_auto",
      "cust_id": "CUST-legacy-mismatch",
      "line": "AUTO",
      "status": "ACTIVE",
      "effective_date": "2025-02-20",
      "expiration_date": "2025-08-20",
      "final_premium_cents": 120468,
      "rating_as_of": "2025-02-20"
    },
    {
      "policy_id": "POL-ne-auto-pref-p_auto",
      "cust_id": "CUST-ne-auto-pref",
      "line": "AUTO",
      "status": "ACTIVE",
      "effective_date": "2025-01-10",
      "expiration_date": "2026-01-10",
      "final_premium_cents": 114557,
      "rating_as_of": "2025-01-10"
    }
  ],
  "row_count": 5,
  "truncated": false
}

Absolutely — I can figure that out.

To give you the exact savings on your policy, I need to pull up your account first. Please provide one of these so I can locate the right auto policy:

your policy number, or
your full name and date of birth, or
your legacy account number

Once I have that, I’ll compare your current billing setup to pay-in-full and tell you the exact dollar difference.

10k in · 156 out · $0.0084 · 3.4s

Customer

Sure, I'm Raymond Castillo. My date of birth is December 11, 1974.

Agent

⚙ query_db(SELECT cust_id, first_name, last_name, dob, status FROM customers WHERE first…)

{
  "sql": "SELECT cust_id, first_name, last_name, dob, status FROM customers WHERE first_name = 'Raymond' AND last_name = 'Castillo' AND dob = '1974-12-11'"
}

{
  "rows": [
    {
      "cust_id": "CUST-legacy-mismatch",
      "first_name": "Raymond",
      "last_name": "Castillo",
      "dob": "1974-12-11",
      "status": "CUSTOMER"
    }
  ],
  "row_count": 1,
  "truncated": false
}

⚙ query_db(WITH auto_policies AS ( SELECT p.policy_id, p.cust_id, p.line, p.status, p.ef…)

{
  "sql": "WITH auto_policies AS ( SELECT p.policy_id, p.cust_id, p.line, p.status, p.effective_date, p.expiration_date, p.term_months, p.rating_as_of, p.base_premium_cents, p.final_premium_cents, p.premium_breakdown, p.rating_inputs FROM policies p WHERE p.cust_id = 'CUST-legacy-mismatch' AND p.line = 'AUTO' ) SELECT * FROM auto_policies ORDER BY created_at DESC"
}

{
  "error": "sql_error",
  "detail": "no such column: created_at"
}

⚙ query_db(SELECT policy_id, cust_id, line, status, effective_date, expiration_date, ter…)

{
  "sql": "SELECT policy_id, cust_id, line, status, effective_date, expiration_date, term_months, rating_as_of, base_premium_cents, final_premium_cents, premium_breakdown, rating_inputs, created_at FROM policies WHERE cust_id = 'CUST-legacy-mismatch' AND line = 'AUTO' ORDER BY created_at DESC"
}

{
  "rows": [
    {
      "policy_id": "POL-legacy-mismatch-p_auto",
      "cust_id": "CUST-legacy-mismatch",
      "line": "AUTO",
      "status": "ACTIVE",
      "effective_date": "2025-02-20",
      "expiration_date": "2025-08-20",
      "term_months": 6,
      "rating_as_of": "2025-02-20",
      "base_premium_cents": 120468,
      "final_premium_cents": 120468,
      "premium_breakdown": "[{\"step\": \"BASE\", \"code\": \"base\", \"detail\": \"base_rate $900\", \"factor\": null, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"tier:PINE\", \"detail\": \"tier factor \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"region:R-SW\", \"detail\": \"region factor \\u00d71.12\", \"factor\": 1.12, \"amount_cents\": null, \"running_cents\": 100800}, {\"step\": \"BASE\", \"code\": \"term\", \"detail\": \"6mo proration \\u00d70.5\", \"factor\": 0.5, \"amount_cents\": null, \"running_cents\": 50400}, {\"step\": \"RISK\", \"code\": \"factor:driver_age\", \"detail\": \"driver_age=50 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 50400}, {\"step\": \"RISK\", \"code\": \"factor:risk_score\", \"detail\": \"risk_score=616 \\u00d71.22\", \"factor\": 1.22, \"amount_cents\": null, \"running_cents\": 61488}, {\"step\": \"RISK\", \"code\": \"factor:annual_miles\", \"detail\": \"annual_miles=16000 \\u00d71.2\", \"factor\": 1.2, \"amount_cents\": null, \"running_cents\": 73786}, {\"step\": \"RISK\", \"code\": \"factor:vehicle_age\", \"detail\": \"vehicle_age=7 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 73786}, {\"step\": \"RISK\", \"code\": \"factor:incidents_5yr\", \"detail\": \"incidents_5yr=2 \\u00d71.55\", \"factor\": 1.55, \"amount_cents\": null, \"running_cents\": 114368}, {\"step\": \"FEES\", \"code\": \"policy_fee\", \"detail\": \"+ policy fee\", \"factor\": null, \"amount_cents\": 2500, \"running_cents\": 116868}, {\"step\": \"FEES\", \"code\": \"installment\", \"detail\": \"+ fractional-pay surcharge\", \"factor\": null, \"amount_cents\": 3600, \"running_cents\": 120468}]",
      "rating_inputs": "{\"billing\": {\"plan\": \"INSTALLMENTS\", \"autopay\": false, \"paperless\": false}, \"incidents_5yr\": 2, \"smoker\": false, \"promo_code\": null}",
      "created_at": "2025-06-01"
    }
  ],
  "row_count": 1,
  "truncated": false
}

⚙ price_check(POL-legacy-mismatch-p_auto, 2025-06-01)

{
  "policy_id": "POL-legacy-mismatch-p_auto",
  "as_of": "2025-06-01"
}

{
  "as_of": "2025-06-01",
  "facts": {
    "line": "AUTO",
    "tier": "PINE",
    "region": "R-SW",
    "state": "TX",
    "term_months": 6,
    "peico_risk": 616,
    "age": 50,
    "billing_plan": "INSTALLMENTS",
    "autopay": false,
    "paperless": false,
    "loyalty_tier": "Sprout",
    "status": "CUSTOMER",
    "has_bundle": false,
    "active_lines": 1,
    "is_new_first_policy": false,
    "promo_code": null,
    "coverages": [],
    "driver_age": 50,
    "annual_miles": 16000,
    "vehicle_age": 7,
    "incidents_5yr": 2,
    "exposure_count": 1
  },
  "base_premium_cents": 120468,
  "final_premium_cents": 120468,
  "breakdown": [
    {
      "step": "BASE",
      "code": "base",
      "detail": "base_rate $900",
      "factor": null,
      "amount_cents": null,
      "running_cents": 90000
    },
    {
      "step": "BASE",
      "code": "tier:PINE",
      "detail": "tier factor ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 90000
    },
    {
      "step": "BASE",
      "code": "region:R-SW",
      "detail": "region factor ×1.12",
      "factor": 1.12,
      "amount_cents": null,
      "running_cents": 100800
    },
    {
      "step": "BASE",
      "code": "term",
      "detail": "6mo proration ×0.5",
      "factor": 0.5,
      "amount_cents": null,
      "running_cents": 50400
    },
    {
      "step": "RISK",
      "code": "factor:driver_age",
      "detail": "driver_age=50 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 50400
    },
    {
      "step": "RISK",
      "code": "factor:risk_score",
      "detail": "risk_score=616 ×1.22",
      "factor": 1.22,
      "amount_cents": null,
      "running_cents": 61488
    },
    {
      "step": "RISK",
      "code": "factor:annual_miles",
      "detail": "annual_miles=16000 ×1.2",
      "factor": 1.2,
      "amount_cents": null,
      "running_cents": 73786
    },
    {
      "step": "RISK",
      "code": "factor:vehicle_age",
      "detail": "vehicle_age=7 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 73786
    },
    {
      "step": "RISK",
      "code": "factor:incidents_5yr",
      "detail": "incidents_5yr=2 ×1.55",
      "factor": 1.55,
      "amount_cents": null,
      "running_cents": 114368
    },
    {
      "step": "FEES",
      "code": "policy_fee",
      "detail": "+ policy fee",
      "factor": null,
      "amount_cents": 2500,
      "running_cents": 116868
    },
    {
      "step": "FEES",
      "code": "installment",
      "detail": "+ fractional-pay surcharge",
      "factor": null,
      "amount_cents": 3600,
      "running_cents": 120468
    }
  ]
}

⚙ quote(2025-06-01, {"line":"AUTO","tier":"PINE","region":"R-SW","state":"TX","term_m…)

{
  "as_of": "2025-06-01",
  "facts": {
    "line": "AUTO",
    "tier": "PINE",
    "region": "R-SW",
    "state": "TX",
    "term_months": 6,
    "peico_risk": 616,
    "age": 50,
    "billing_plan": "PAY_IN_FULL",
    "autopay": false,
    "paperless": false,
    "loyalty_tier": "Sprout",
    "status": "CUSTOMER",
    "has_bundle": false,
    "active_lines": 1,
    "is_new_first_policy": false,
    "promo_code": null,
    "coverages": [],
    "driver_age": 50,
    "annual_miles": 16000,
    "vehicle_age": 7,
    "incidents_5yr": 2,
    "exposure_count": 1
  }
}

{
  "as_of": "2025-06-01",
  "base_premium_cents": 116868,
  "final_premium_cents": 108687,
  "breakdown": [
    {
      "step": "BASE",
      "code": "base",
      "detail": "base_rate $900",
      "factor": null,
      "amount_cents": null,
      "running_cents": 90000
    },
    {
      "step": "BASE",
      "code": "tier:PINE",
      "detail": "tier factor ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 90000
    },
    {
      "step": "BASE",
      "code": "region:R-SW",
      "detail": "region factor ×1.12",
      "factor": 1.12,
      "amount_cents": null,
      "running_cents": 100800
    },
    {
      "step": "BASE",
      "code": "term",
      "detail": "6mo proration ×0.5",
      "factor": 0.5,
      "amount_cents": null,
      "running_cents": 50400
    },
    {
      "step": "RISK",
      "code": "factor:driver_age",
      "detail": "driver_age=50 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 50400
    },
    {
      "step": "RISK",
      "code": "factor:risk_score",
      "detail": "risk_score=616 ×1.22",
      "factor": 1.22,
      "amount_cents": null,
      "running_cents": 61488
    },
    {
      "step": "RISK",
      "code": "factor:annual_miles",
      "detail": "annual_miles=16000 ×1.2",
      "factor": 1.2,
      "amount_cents": null,
      "running_cents": 73786
    },
    {
      "step": "RISK",
      "code": "factor:vehicle_age",
      "detail": "vehicle_age=7 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 73786
    },
    {
      "step": "RISK",
      "code": "factor:incidents_5yr",
      "detail": "incidents_5yr=2 ×1.55",
      "factor": 1.55,
      "amount_cents": null,
      "running_cents": 114368
    },
    {
      "step": "FEES",
      "code": "policy_fee",
      "detail": "+ policy fee",
      "factor": null,
      "amount_cents": 2500,
      "running_cents": 116868
    },
    {
      "step": "DISCOUNT",
      "code": "PAID_IN_FULL",
      "detail": "−7%",
      "factor": 0.9299999999999999,
      "amount_cents": null,
      "running_cents": 108687
    }
  ]
}

Yes — I pulled the exact numbers for your auto policy.

For your current 6-month term:

Current billing: installments
Current premium: $1,204.68
If paid in full: $1,086.87

Your savings would be $117.81.

That breaks down as:

$36.00 from avoiding the installment surcharge
plus a paid-in-full discount that brings the total savings to $117.81

If you want, I can also help you switch the policy to pay in full for the next term.

39k in · 562 out · $0.03 · 10.0s

Customer

Perfect — that's exactly what I needed. So switching to pay in full would save me $117.81 per term. Thanks for breaking that down. I'm going to think it over before my renewal comes up, but I appreciate you getting me those actual numbers. That helps a lot.

Agent

⚙ end_conversation()

{}

{
  "ok": true,
  "note": "Deliver your closing message now."
}

You’re very welcome — yes, based on the current rating, paying in full would save you $117.81 for the term.

Thanks for reaching out to PEICO, Raymond. We’ll be here if you want to make the change closer to renewal.

17k in · 69 out · $0.0077 · 2.7s