payinfull-switch-execute

Grading criteriawhat this conversation was scored against

DB end-state

{
  "policies": {
    "changed": [
      {
        "pk": {
          "policy_id": "POL-retention-target-p_auto"
        },
        "fields": {
          "base_premium_cents": [
            106648,
            103048
          ],
          "final_premium_cents": [
            91350,
            81834
          ],
          "premium_breakdown": [
            "*",
            "*"
          ],
          "rating_inputs": [
            "*",
            "*"
          ]
        },
        "may_change": {
          "rating_as_of": [
            "*",
            "*"
          ]
        }
      }
    ]
  }
}

Judge rubric

The rep (1) gave engine-verified pricing for the switch: her new annual pay-in-full premium of about $818.34, and/or true savings of about $95 per year off her current $913.50 (small rounding or nearby phrasing is fine); and (2) actually executed the billing switch AND the reprice on this call and told her so. Quoting only the $36 installment-fee refund, or only "7% off" hand-math on her current bill (about $64), as her final savings figure — without ever producing the true combined figure — is a fail: the fee removal and the paid-in-full discount compound, and verifying through the rating engine is the behavior under test. Merely promising the switch, submitting a request, or deflecting to a billing team instead of performing it is a fail.

Passedcustomer: Tanya Brooks · 9 turns · 37s · $0.13 · 130k tok in

Verdicts

DB end-statepassed

DB end-state matches the expected changeset.

Judge rubricpassed

judge: The rep provided the correct combined pricing ($818.34, $95.16 savings) and explicitly confirmed the billing switch and reprice were completed on the call.

Conversation

Agent

Hi, thanks for contacting PEICO — this is the service desk. How can I help you today?

Customer

Hi! Thanks for picking up. I'm looking to switch my auto policy from paying monthly to paying the full year upfront. I want to know if that actually saves me money and how much before I commit to it.

Agent

I can help with that. First, let me pull up your account to find your auto policy. Could you give me your name and either your email or phone number on file so I can verify your identity?

8,714 in · 51 out · $0.0065 · 1.9s

Customer

Sure, it's Tanya Brooks. My email on file is tanya.brooks@example.com.

Agent

⚙ query_db(SELECT cust_id, first_name, last_name, email, phone FROM customers WHERE lowe…)

{
  "sql": "SELECT cust_id, first_name, last_name, email, phone FROM customers WHERE lower(email)='tanya.brooks@example.com'"
}

{
  "rows": [
    {
      "cust_id": "CUST-retention-target",
      "first_name": "Tanya",
      "last_name": "Brooks",
      "email": "tanya.brooks@example.com",
      "phone": null
    }
  ],
  "row_count": 1,
  "truncated": false
}

⚙ query_db(SELECT policy_id, line, tier_id, status, final_premium_cents, rating_as_of, r…)

{
  "sql": "SELECT policy_id, line, tier_id, status, final_premium_cents, rating_as_of, rating_inputs FROM policies WHERE cust_id='CUST-retention-target' AND line='AUTO'"
}

{
  "rows": [
    {
      "policy_id": "POL-retention-target-p_auto",
      "line": "AUTO",
      "tier_id": "AUTO:PINE",
      "status": "ACTIVE",
      "final_premium_cents": 91350,
      "rating_as_of": "2025-05-01",
      "rating_inputs": "{\"billing\": {\"plan\": \"INSTALLMENTS\", \"autopay\": false, \"paperless\": true}, \"incidents_5yr\": 0, \"smoker\": false, \"promo_code\": null}"
    }
  ],
  "row_count": 1,
  "truncated": false
}

⚙ price_check(POL-retention-target-p_auto)

{
  "policy_id": "POL-retention-target-p_auto"
}

{
  "as_of": "2025-05-01",
  "facts": {
    "line": "AUTO",
    "tier": "PINE",
    "region": "R-SW",
    "state": "AZ",
    "term_months": 12,
    "peico_risk": 730,
    "age": 34,
    "billing_plan": "INSTALLMENTS",
    "autopay": false,
    "paperless": true,
    "loyalty_tier": "Sprout",
    "status": "CUSTOMER",
    "has_bundle": false,
    "active_lines": 1,
    "is_new_first_policy": false,
    "promo_code": null,
    "coverages": [],
    "driver_age": 34,
    "annual_miles": 11000,
    "vehicle_age": 5,
    "incidents_5yr": 0,
    "exposure_count": 1
  },
  "base_premium_cents": 106648,
  "final_premium_cents": 91350,
  "breakdown": [
    {
      "step": "BASE",
      "code": "base",
      "detail": "base_rate $900",
      "factor": null,
      "amount_cents": null,
      "running_cents": 90000
    },
    {
      "step": "BASE",
      "code": "tier:PINE",
      "detail": "tier factor ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 90000
    },
    {
      "step": "BASE",
      "code": "region:R-SW",
      "detail": "region factor ×1.12",
      "factor": 1.12,
      "amount_cents": null,
      "running_cents": 100800
    },
    {
      "step": "RISK",
      "code": "factor:driver_age",
      "detail": "driver_age=34 ×1.05",
      "factor": 1.05,
      "amount_cents": null,
      "running_cents": 105840
    },
    {
      "step": "RISK",
      "code": "factor:risk_score",
      "detail": "risk_score=730 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 105840
    },
    {
      "step": "RISK",
      "code": "factor:annual_miles",
      "detail": "annual_miles=11000 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 105840
    },
    {
      "step": "RISK",
      "code": "factor:vehicle_age",
      "detail": "vehicle_age=5 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 105840
    },
    {
      "step": "RISK",
      "code": "factor:incidents_5yr",
      "detail": "incidents_5yr=0 ×0.95",
      "factor": 0.95,
      "amount_cents": null,
      "running_cents": 100548
    },
    {
      "step": "FEES",
      "code": "policy_fee",
      "detail": "+ policy fee",
      "factor": null,
      "amount_cents": 2500,
      "running_cents": 103048
    },
    {
      "step": "FEES",
      "code": "installment",
      "detail": "+ fractional-pay surcharge",
      "factor": null,
      "amount_cents": 3600,
      "running_cents": 106648
    },
    {
      "step": "DISCOUNT",
      "code": "SAFE_DRIVER",
      "detail": "−12%",
      "factor": 0.88,
      "amount_cents": null,
      "running_cents": 93850
    },
    {
      "step": "DISCOUNT",
      "code": "PAPERLESS",
      "detail": "−$25",
      "factor": null,
      "amount_cents": -2500,
      "running_cents": 91350
    }
  ]
}

⚙ quote({"line":"AUTO","tier":"PINE","region":"R-SW","state":"AZ","term_months":12,"p…)

{
  "facts": {
    "line": "AUTO",
    "tier": "PINE",
    "region": "R-SW",
    "state": "AZ",
    "term_months": 12,
    "peico_risk": 730,
    "age": 34,
    "billing_plan": "PAY_IN_FULL",
    "autopay": false,
    "paperless": true,
    "loyalty_tier": "Sprout",
    "status": "CUSTOMER",
    "has_bundle": false,
    "active_lines": 1,
    "is_new_first_policy": false,
    "promo_code": null,
    "coverages": [],
    "driver_age": 34,
    "annual_miles": 11000,
    "vehicle_age": 5,
    "incidents_5yr": 0,
    "exposure_count": 1
  },
  "as_of": "2025-05-01"
}

{
  "as_of": "2025-05-01",
  "base_premium_cents": 103048,
  "final_premium_cents": 81834,
  "breakdown": [
    {
      "step": "BASE",
      "code": "base",
      "detail": "base_rate $900",
      "factor": null,
      "amount_cents": null,
      "running_cents": 90000
    },
    {
      "step": "BASE",
      "code": "tier:PINE",
      "detail": "tier factor ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 90000
    },
    {
      "step": "BASE",
      "code": "region:R-SW",
      "detail": "region factor ×1.12",
      "factor": 1.12,
      "amount_cents": null,
      "running_cents": 100800
    },
    {
      "step": "RISK",
      "code": "factor:driver_age",
      "detail": "driver_age=34 ×1.05",
      "factor": 1.05,
      "amount_cents": null,
      "running_cents": 105840
    },
    {
      "step": "RISK",
      "code": "factor:risk_score",
      "detail": "risk_score=730 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 105840
    },
    {
      "step": "RISK",
      "code": "factor:annual_miles",
      "detail": "annual_miles=11000 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 105840
    },
    {
      "step": "RISK",
      "code": "factor:vehicle_age",
      "detail": "vehicle_age=5 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 105840
    },
    {
      "step": "RISK",
      "code": "factor:incidents_5yr",
      "detail": "incidents_5yr=0 ×0.95",
      "factor": 0.95,
      "amount_cents": null,
      "running_cents": 100548
    },
    {
      "step": "FEES",
      "code": "policy_fee",
      "detail": "+ policy fee",
      "factor": null,
      "amount_cents": 2500,
      "running_cents": 103048
    },
    {
      "step": "DISCOUNT",
      "code": "SAFE_DRIVER",
      "detail": "−12%",
      "factor": 0.88,
      "amount_cents": null,
      "running_cents": 90682
    },
    {
      "step": "DISCOUNT",
      "code": "PAID_IN_FULL",
      "detail": "−7%",
      "factor": 0.9299999999999999,
      "amount_cents": null,
      "running_cents": 84334
    },
    {
      "step": "DISCOUNT",
      "code": "PAPERLESS",
      "detail": "−$25",
      "factor": null,
      "amount_cents": -2500,
      "running_cents": 81834
    }
  ]
}

Yes — paying in full does save you money. Here's the comparison:

Monthly (installments, current): $913.50/year
Pay-in-full: $818.34/year

That's a savings of $95.16 per year. Two things change when you switch:

You drop the $36 installment surcharge.
You gain a 7% paid-in-full discount (about $59 off).

The trade-off is you'd pay the full $818.34 upfront instead of spreading it out.

Would you like me to make the switch to pay-in-full?

50k in · 1,007 out · $0.06 · 20.2s

Customer

Yes, absolutely — that savings makes sense for me right now. Go ahead and switch me to pay in full today, please.

Agent

⚙ update_billing(POL-retention-target-p_auto, PAY_IN_FULL)

{
  "policy_id": "POL-retention-target-p_auto",
  "billing_plan": "PAY_IN_FULL"
}

{
  "ok": true,
  "rows_affected": 1,
  "changeset": {
    "policies": {
      "changed": [
        {
          "pk": {
            "policy_id": "POL-retention-target-p_auto"
          },
          "fields": {
            "rating_inputs": [
              "{\"billing\": {\"plan\": \"INSTALLMENTS\", \"autopay\": false, \"paperless\": true}, \"incidents_5yr\": 0, \"smoker\": false, \"promo_code\": null}",
              "{\"billing\": {\"plan\": \"PAY_IN_FULL\", \"autopay\": false, \"paperless\": true}, \"incidents_5yr\": 0, \"smoker\": false, \"promo_code\": null}"
            ]
          }
        }
      ]
    }
  },
  "note": "stored premium is now stale — call reprice_policy to recompute"
}

⚙ reprice_policy(POL-retention-target-p_auto)

{
  "policy_id": "POL-retention-target-p_auto"
}

{
  "ok": true,
  "as_of": "2025-05-01",
  "base_premium_cents": 103048,
  "final_premium_cents": 81834,
  "breakdown": [
    {
      "step": "BASE",
      "code": "base",
      "detail": "base_rate $900",
      "factor": null,
      "amount_cents": null,
      "running_cents": 90000
    },
    {
      "step": "BASE",
      "code": "tier:PINE",
      "detail": "tier factor ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 90000
    },
    {
      "step": "BASE",
      "code": "region:R-SW",
      "detail": "region factor ×1.12",
      "factor": 1.12,
      "amount_cents": null,
      "running_cents": 100800
    },
    {
      "step": "RISK",
      "code": "factor:driver_age",
      "detail": "driver_age=34 ×1.05",
      "factor": 1.05,
      "amount_cents": null,
      "running_cents": 105840
    },
    {
      "step": "RISK",
      "code": "factor:risk_score",
      "detail": "risk_score=730 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 105840
    },
    {
      "step": "RISK",
      "code": "factor:annual_miles",
      "detail": "annual_miles=11000 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 105840
    },
    {
      "step": "RISK",
      "code": "factor:vehicle_age",
      "detail": "vehicle_age=5 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 105840
    },
    {
      "step": "RISK",
      "code": "factor:incidents_5yr",
      "detail": "incidents_5yr=0 ×0.95",
      "factor": 0.95,
      "amount_cents": null,
      "running_cents": 100548
    },
    {
      "step": "FEES",
      "code": "policy_fee",
      "detail": "+ policy fee",
      "factor": null,
      "amount_cents": 2500,
      "running_cents": 103048
    },
    {
      "step": "DISCOUNT",
      "code": "SAFE_DRIVER",
      "detail": "−12%",
      "factor": 0.88,
      "amount_cents": null,
      "running_cents": 90682
    },
    {
      "step": "DISCOUNT",
      "code": "PAID_IN_FULL",
      "detail": "−7%",
      "factor": 0.9299999999999999,
      "amount_cents": null,
      "running_cents": 84334
    },
    {
      "step": "DISCOUNT",
      "code": "PAPERLESS",
      "detail": "−$25",
      "factor": null,
      "amount_cents": -2500,
      "running_cents": 81834
    }
  ],
  "changeset": {
    "policies": {
      "changed": [
        {
          "pk": {
            "policy_id": "POL-retention-target-p_auto"
          },
          "fields": {
            "base_premium_cents": [
              106648,
              103048
            ],
            "final_premium_cents": [
              91350,
              81834
            ],
            "premium_breakdown": [
              "[{\"step\": \"BASE\", \"code\": \"base\", \"detail\": \"base_rate $900\", \"factor\": null, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"tier:PINE\", \"detail\": \"tier factor \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"region:R-SW\", \"detail\": \"region factor \\u00d71.12\", \"factor\": 1.12, \"amount_cents\": null, \"running_cents\": 100800}, {\"step\": \"RISK\", \"code\": \"factor:driver_age\", \"detail\": \"driver_age=34 \\u00d71.05\", \"factor\": 1.05, \"amount_cents\": null, \"running_cents\": 105840}, {\"step\": \"RISK\", \"code\": \"factor:risk_score\", \"detail\": \"risk_score=730 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 105840}, {\"step\": \"RISK\", \"code\": \"factor:annual_miles\", \"detail\": \"annual_miles=11000 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 105840}, {\"step\": \"RISK\", \"code\": \"factor:vehicle_age\", \"detail\": \"vehicle_age=5 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 105840}, {\"step\": \"RISK\", \"code\": \"factor:incidents_5yr\", \"detail\": \"incidents_5yr=0 \\u00d70.95\", \"factor\": 0.95, \"amount_cents\": null, \"running_cents\": 100548}, {\"step\": \"FEES\", \"code\": \"policy_fee\", \"detail\": \"+ policy fee\", \"factor\": null, \"amount_cents\": 2500, \"running_cents\": 103048}, {\"step\": \"FEES\", \"code\": \"installment\", \"detail\": \"+ fractional-pay surcharge\", \"factor\": null, \"amount_cents\": 3600, \"running_cents\": 106648}, {\"step\": \"DISCOUNT\", \"code\": \"SAFE_DRIVER\", \"detail\": \"\\u221212%\", \"factor\": 0.88, \"amount_cents\": null, \"running_cents\": 93850}, {\"step\": \"DISCOUNT\", \"code\": \"PAPERLESS\", \"detail\": \"\\u2212$25\", \"factor\": null, \"amount_cents\": -2500, \"running_cents\": 91350}]",
              "[{\"step\": \"BASE\", \"code\": \"base\", \"detail\": \"base_rate $900\", \"factor\": null, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"tier:PINE\", \"detail\": \"tier factor \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"region:R-SW\", \"detail\": \"region factor \\u00d71.12\", \"factor\": 1.12, \"amount_cents\": null, \"running_cents\": 100800}, {\"step\": \"RISK\", \"code\": \"factor:driver_age\", \"detail\": \"driver_age=34 \\u00d71.05\", \"factor\": 1.05, \"amount_cents\": null, \"running_cents\": 105840}, {\"step\": \"RISK\", \"code\": \"factor:risk_score\", \"detail\": \"risk_score=730 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 105840}, {\"step\": \"RISK\", \"code\": \"factor:annual_miles\", \"detail\": \"annual_miles=11000 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 105840}, {\"step\": \"RISK\", \"code\": \"factor:vehicle_age\", \"detail\": \"vehicle_age=5 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 105840}, {\"step\": \"RISK\", \"code\": \"factor:incidents_5yr\", \"detail\": \"incidents_5yr=0 \\u00d70.95\", \"factor\": 0.95, \"amount_cents\": null, \"running_cents\": 100548}, {\"step\": \"FEES\", \"code\": \"policy_fee\", \"detail\": \"+ policy fee\", \"factor\": null, \"amount_cents\": 2500, \"running_cents\": 103048}, {\"step\": \"DISCOUNT\", \"code\": \"SAFE_DRIVER\", \"detail\": \"\\u221212%\", \"factor\": 0.88, \"amount_cents\": null, \"running_cents\": 90682}, {\"step\": \"DISCOUNT\", \"code\": \"PAID_IN_FULL\", \"detail\": \"\\u22127%\", \"factor\": 0.9299999999999999, \"amount_cents\": null, \"running_cents\": 84334}, {\"step\": \"DISCOUNT\", \"code\": \"PAPERLESS\", \"detail\": \"\\u2212$25\", \"factor\": null, \"amount_cents\": -2500, \"running_cents\": 81834}]"
            ]
          }
        }
      ]
    }
  }
}

All done, Tanya! Your auto policy is now set to pay-in-full, and the new premium is locked in at $818.34/year — down from $913.50, saving you $95.16.

Is there anything else I can help you with?

40k in · 238 out · $0.04 · 5.7s

Customer

No, that's perfect. Thanks so much for your help today!

Agent

⚙ end_conversation()

{}

{
  "ok": true,
  "note": "Deliver your closing message now."
}

Thanks again for choosing PEICO. Have a wonderful day! 🌲

31k in · 82 out · $0.02 · 3.3s