mileage-drop-reprice

Grading criteriawhat this conversation was scored against

DB end-state

{
  "vehicles": {
    "changed": [
      {
        "pk": {
          "vehicle_id": "VEH-legacy-mismatch-v1"
        },
        "fields": {
          "usage": [
            "COMMUTE",
            "PLEASURE"
          ],
          "annual_miles": [
            16000,
            6000
          ]
        }
      }
    ]
  },
  "policies": {
    "changed": [
      {
        "pk": {
          "policy_id": "POL-legacy-mismatch-p_auto"
        },
        "fields": {
          "base_premium_cents": [
            120468,
            93782
          ],
          "final_premium_cents": [
            120468,
            93782
          ],
          "premium_breakdown": [
            "*",
            "*"
          ]
        },
        "may_change": {
          "rating_as_of": [
            "*",
            "*"
          ]
        }
      }
    ]
  }
}

Judge rubric

The rep (1) updated the vehicle's recorded facts to match what the customer said — about 6,000 annual miles and personal/pleasure use instead of commuting; (2) repriced the policy through the rating engine and gave him a real figure: a new premium of about $937.82 for his term and/or savings of about $266.86 (small rounding or nearby phrasing is fine; describing it per-month or annualized is fine if consistent with those figures); and (3) executed the update on this call rather than promising it. Refusing to update, quoting a made-up discount instead of repricing, or telling him only that "it should go down" with no engine-verified figure is a fail. Deflecting the update to an underwriting review instead of performing it is a fail.

Failed: wrong DB end-statecustomer: Raymond Castillo · 7 turns · 40s · $0.03 · 49k tok in

Verdicts

DB end-statefailed

DB end-state did not match.
  expected: {"vehicles": {"changed": [{"pk": {"vehicle_id": "VEH-legacy-mismatch-v1"}, "fields": {"usage": ["COMMUTE", "PLEASURE"], "annual_miles": [16000, 6000]}}]}, "policies": {"changed": [{"pk": {"policy_id": "POL-legacy-mismatch-p_auto"}, "fields": {"base_premium_cents": [120468, 93782], "final_premium_cents": [120468, 93782], "premium_breakdown": ["*", "*"]}, "may_change": {"rating_as_of": ["*", "*"]}}]}}
  actual:   {"policies": {"changed": [{"pk": {"policy_id": "POL-legacy-mismatch-p_auto"}, "fields": {"rating_as_of": ["2025-02-20", "2025-06-01"], "base_premium_cents": [120468, 93782], "final_premium_cents": [120468, 93782], "premium_breakdown": ["[{\"step\": \"BASE\", \"code\": \"base\", \"detail\": \"base_rate $900\", \"factor\": null, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"tier:PINE\", \"detail\": \"tier factor \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"region:R-SW\", \"detail\": \"region factor \\u00d71.12\", \"factor\": 1.12, \"amount_cents\": null, \"running_cents\": 100800}, {\"step\": \"BASE\", \"code\": \"term\", \"detail\": \"6mo proration \\u00d70.5\", \"factor\": 0.5, \"amount_cents\": null, \"running_cents\": 50400}, {\"step\": \"RISK\", \"code\": \"factor:driver_age\", \"detail\": \"driver_age=50 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 50400}, {\"step\": \"RISK\", \"code\": \"factor:risk_score\", \"detail\": \"risk_score=616 \\u00d71.22\", \"factor\": 1.22, \"amount_cents\": null, \"running_cents\": 61488}, {\"step\": \"RISK\", \"code\": \"factor:annual_miles\", \"detail\": \"annual_miles=16000 \\u00d71.2\", \"factor\": 1.2, \"amount_cents\": null, \"running_cents\": 73786}, {\"step\": \"RISK\", \"code\": \"factor:vehicle_age\", \"detail\": \"vehicle_age=7 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 73786}, {\"step\": \"RISK\", \"code\": \"factor:incidents_5yr\", \"detail\": \"incidents_5yr=2 \\u00d71.55\", \"factor\": 1.55, \"amount_cents\": null, \"running_cents\": 114368}, {\"step\": \"FEES\", \"code\": \"policy_fee\", \"detail\": \"+ policy fee\", \"factor\": null, \"amount_cents\": 2500, \"running_cents\": 116868}, {\"step\": \"FEES\", \"code\": \"installment\", \"detail\": \"+ fractional-pay surcharge\", \"factor\": null, \"amount_cents\": 3600, \"running_cents\": 120468}]", "[{\"step\": \"BASE\", \"code\": \"base\", \"detail\": \"base_rate $900\", \"factor\": null, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"tier:PINE\", \"detail\": \"tier factor \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"region:R-SW\", \"detail\": \"region factor \\u00d71.12\", \"factor\": 1.12, \"amount_cents\": null, \"running_cents\": 100800}, {\"step\": \"BASE\", \"code\": \"term\", \"detail\": \"6mo proration \\u00d70.5\", \"factor\": 0.5, \"amount_cents\": null, \"running_cents\": 50400}, {\"step\": \"RISK\", \"code\": \"factor:driver_age\", \"detail\": \"driver_age=50 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 50400}, {\"step\": \"RISK\", \"code\": \"factor:risk_score\", \"detail\": \"risk_score=616 \\u00d71.22\", \"factor\": 1.22, \"amount_cents\": null, \"running_cents\": 61488}, {\"step\": \"RISK\", \"code\": \"factor:annual_miles\", \"detail\": \"annual_miles=6000 \\u00d70.92\", \"factor\": 0.92, \"amount_cents\": null, \"running_cents\": 56569}, {\"step\": \"RISK\", \"code\": \"factor:vehicle_age\", \"detail\": \"vehicle_age=7 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 56569}, {\"step\": \"RISK\", \"code\": \"factor:incidents_5yr\", \"detail\": \"incidents_5yr=2 \\u00d71.55\", \"factor\": 1.55, \"amount_cents\": null, \"running_cents\": 87682}, {\"step\": \"FEES\", \"code\": \"policy_fee\", \"detail\": \"+ policy fee\", \"factor\": null, \"amount_cents\": 2500, \"running_cents\": 90182}, {\"step\": \"FEES\", \"code\": \"installment\", \"detail\": \"+ fractional-pay surcharge\", \"factor\": null, \"amount_cents\": 3600, \"running_cents\": 93782}]"]}}]}, "vehicles": {"changed": [{"pk": {"vehicle_id": "VEH-legacy-mismatch-v1"}, "fields": {"usage": ["COMMUTE", "PERSONAL"], "annual_miles": [16000, 6000]}}]}}

Judge rubricpassed

judge: The rep updated usage/mileage, repriced via the engine giving the exact figures ($937.82 new premium, $266.86 savings), and executed it on the call rather than deferring, matching the rubric.

Conversation

Agent

Hi, thanks for contacting PEICO — this is the service desk. How can I help you today?

Customer

Hey, thanks for picking up. So I've been working from home since April — my company went fully remote — and my truck just sits most of the time now. I'm only driving it weekends, maybe to the lake or the hardware store. I heard lower mileage means a cheaper rate, so I wanted to get my policy updated to reflect that and find out what my new premium would be.

Agent

Absolutely — I can help with that.

Since changing mileage/usage updates your policy record, I’ll need to verify your identity before I make any account changes or quote the updated premium from your policy file.

Please send:

Your full name
Date of birth
Either your policy number or the phone/email on the account

Also, if you already know roughly how many miles you drive per year now, include that too.

4,774 in · 90 out · $0.0038 · 2.5s

Customer

Sure, no problem. I'm Raymond Castillo, DOB December 11, 1974. My email on file is raymond.castillo@example.com, and my old account number is EVG4471Q2. And like I said, I'm driving about six thousand miles a year now — all personal use, no commuting.

Agent

⚙ query_db(SELECT cust_id, first_name, last_name, dob, email, legacy_acct, status FROM c…)

{
  "sql": "SELECT cust_id, first_name, last_name, dob, email, legacy_acct, status FROM customers WHERE first_name = 'Raymond' AND last_name = 'Castillo' AND dob = '1974-12-11' AND (email = 'raymond.castillo@example.com' OR legacy_acct = 'EVG4471Q2')"
}

{
  "rows": [
    {
      "cust_id": "CUST-legacy-mismatch",
      "first_name": "Raymond",
      "last_name": "Castillo",
      "dob": "1974-12-11",
      "email": "raymond.castillo@example.com",
      "legacy_acct": "EVG4471Q2",
      "status": "CUSTOMER"
    }
  ],
  "row_count": 1,
  "truncated": false
}

⚙ query_db(WITH cust AS (SELECT cust_id FROM customers WHERE cust_id = 'CUST-legacy-mism…)

{
  "sql": "WITH cust AS (SELECT cust_id FROM customers WHERE cust_id = 'CUST-legacy-mismatch') SELECT p.policy_id, p.line, p.status, p.effective_date, p.expiration_date, p.final_premium_cents, v.vehicle_id, v.year, v.make, v.model, v.usage, v.annual_miles FROM policies p JOIN policy_objects po ON po.policy_id = p.policy_id AND po.object_type = 'vehicle' JOIN vehicles v ON v.vehicle_id = po.object_id WHERE p.cust_id = (SELECT cust_id FROM cust) AND p.status = 'ACTIVE' ORDER BY p.created_at DESC"
}

{
  "rows": [
    {
      "policy_id": "POL-legacy-mismatch-p_auto",
      "line": "AUTO",
      "status": "ACTIVE",
      "effective_date": "2025-02-20",
      "expiration_date": "2025-08-20",
      "final_premium_cents": 120468,
      "vehicle_id": "VEH-legacy-mismatch-v1",
      "year": 2018,
      "make": "Ford",
      "model": "F-150",
      "usage": "COMMUTE",
      "annual_miles": 16000
    }
  ],
  "row_count": 1,
  "truncated": false
}

⚙ update_insured_object(vehicle, VEH-legacy-mismatch-v1, {"annual_miles":6000,"usage":"PERSONAL"})

{
  "object_type": "vehicle",
  "object_id": "VEH-legacy-mismatch-v1",
  "fields": {
    "annual_miles": 6000,
    "usage": "PERSONAL"
  }
}

{
  "ok": true,
  "rows_affected": 1,
  "changeset": {
    "vehicles": {
      "changed": [
        {
          "pk": {
            "vehicle_id": "VEH-legacy-mismatch-v1"
          },
          "fields": {
            "usage": [
              "COMMUTE",
              "PERSONAL"
            ],
            "annual_miles": [
              16000,
              6000
            ]
          }
        }
      ]
    }
  },
  "note": "if these facts feed rating, the affected policy's premium is stale — reprice_policy"
}

⚙ reprice_policy(POL-legacy-mismatch-p_auto, 2025-06-01)

{
  "policy_id": "POL-legacy-mismatch-p_auto",
  "as_of": "2025-06-01"
}

{
  "ok": true,
  "as_of": "2025-06-01",
  "base_premium_cents": 93782,
  "final_premium_cents": 93782,
  "breakdown": [
    {
      "step": "BASE",
      "code": "base",
      "detail": "base_rate $900",
      "factor": null,
      "amount_cents": null,
      "running_cents": 90000
    },
    {
      "step": "BASE",
      "code": "tier:PINE",
      "detail": "tier factor ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 90000
    },
    {
      "step": "BASE",
      "code": "region:R-SW",
      "detail": "region factor ×1.12",
      "factor": 1.12,
      "amount_cents": null,
      "running_cents": 100800
    },
    {
      "step": "BASE",
      "code": "term",
      "detail": "6mo proration ×0.5",
      "factor": 0.5,
      "amount_cents": null,
      "running_cents": 50400
    },
    {
      "step": "RISK",
      "code": "factor:driver_age",
      "detail": "driver_age=50 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 50400
    },
    {
      "step": "RISK",
      "code": "factor:risk_score",
      "detail": "risk_score=616 ×1.22",
      "factor": 1.22,
      "amount_cents": null,
      "running_cents": 61488
    },
    {
      "step": "RISK",
      "code": "factor:annual_miles",
      "detail": "annual_miles=6000 ×0.92",
      "factor": 0.92,
      "amount_cents": null,
      "running_cents": 56569
    },
    {
      "step": "RISK",
      "code": "factor:vehicle_age",
      "detail": "vehicle_age=7 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 56569
    },
    {
      "step": "RISK",
      "code": "factor:incidents_5yr",
      "detail": "incidents_5yr=2 ×1.55",
      "factor": 1.55,
      "amount_cents": null,
      "running_cents": 87682
    },
    {
      "step": "FEES",
      "code": "policy_fee",
      "detail": "+ policy fee",
      "factor": null,
      "amount_cents": 2500,
      "running_cents": 90182
    },
    {
      "step": "FEES",
      "code": "installment",
      "detail": "+ fractional-pay surcharge",
      "factor": null,
      "amount_cents": 3600,
      "running_cents": 93782
    }
  ],
  "changeset": {
    "policies": {
      "changed": [
        {
          "pk": {
            "policy_id": "POL-legacy-mismatch-p_auto"
          },
          "fields": {
            "rating_as_of": [
              "2025-02-20",
              "2025-06-01"
            ],
            "base_premium_cents": [
              120468,
              93782
            ],
            "final_premium_cents": [
              120468,
              93782
            ],
            "premium_breakdown": [
              "[{\"step\": \"BASE\", \"code\": \"base\", \"detail\": \"base_rate $900\", \"factor\": null, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"tier:PINE\", \"detail\": \"tier factor \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"region:R-SW\", \"detail\": \"region factor \\u00d71.12\", \"factor\": 1.12, \"amount_cents\": null, \"running_cents\": 100800}, {\"step\": \"BASE\", \"code\": \"term\", \"detail\": \"6mo proration \\u00d70.5\", \"factor\": 0.5, \"amount_cents\": null, \"running_cents\": 50400}, {\"step\": \"RISK\", \"code\": \"factor:driver_age\", \"detail\": \"driver_age=50 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 50400}, {\"step\": \"RISK\", \"code\": \"factor:risk_score\", \"detail\": \"risk_score=616 \\u00d71.22\", \"factor\": 1.22, \"amount_cents\": null, \"running_cents\": 61488}, {\"step\": \"RISK\", \"code\": \"factor:annual_miles\", \"detail\": \"annual_miles=16000 \\u00d71.2\", \"factor\": 1.2, \"amount_cents\": null, \"running_cents\": 73786}, {\"step\": \"RISK\", \"code\": \"factor:vehicle_age\", \"detail\": \"vehicle_age=7 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 73786}, {\"step\": \"RISK\", \"code\": \"factor:incidents_5yr\", \"detail\": \"incidents_5yr=2 \\u00d71.55\", \"factor\": 1.55, \"amount_cents\": null, \"running_cents\": 114368}, {\"step\": \"FEES\", \"code\": \"policy_fee\", \"detail\": \"+ policy fee\", \"factor\": null, \"amount_cents\": 2500, \"running_cents\": 116868}, {\"step\": \"FEES\", \"code\": \"installment\", \"detail\": \"+ fractional-pay surcharge\", \"factor\": null, \"amount_cents\": 3600, \"running_cents\": 120468}]",
              "[{\"step\": \"BASE\", \"code\": \"base\", \"detail\": \"base_rate $900\", \"factor\": null, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"tier:PINE\", \"detail\": \"tier factor \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"region:R-SW\", \"detail\": \"region factor \\u00d71.12\", \"factor\": 1.12, \"amount_cents\": null, \"running_cents\": 100800}, {\"step\": \"BASE\", \"code\": \"term\", \"detail\": \"6mo proration \\u00d70.5\", \"factor\": 0.5, \"amount_cents\": null, \"running_cents\": 50400}, {\"step\": \"RISK\", \"code\": \"factor:driver_age\", \"detail\": \"driver_age=50 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 50400}, {\"step\": \"RISK\", \"code\": \"factor:risk_score\", \"detail\": \"risk_score=616 \\u00d71.22\", \"factor\": 1.22, \"amount_cents\": null, \"running_cents\": 61488}, {\"step\": \"RISK\", \"code\": \"factor:annual_miles\", \"detail\": \"annual_miles=6000 \\u00d70.92\", \"factor\": 0.92, \"amount_cents\": null, \"running_cents\": 56569}, {\"step\": \"RISK\", \"code\": \"factor:vehicle_age\", \"detail\": \"vehicle_age=7 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 56569}, {\"step\": \"RISK\", \"code\": \"factor:incidents_5yr\", \"detail\": \"incidents_5yr=2 \\u00d71.55\", \"factor\": 1.55, \"amount_cents\": null, \"running_cents\": 87682}, {\"step\": \"FEES\", \"code\": \"policy_fee\", \"detail\": \"+ policy fee\", \"factor\": null, \"amount_cents\": 2500, \"running_cents\": 90182}, {\"step\": \"FEES\", \"code\": \"installment\", \"detail\": \"+ fractional-pay surcharge\", \"factor\": null, \"amount_cents\": 3600, \"running_cents\": 93782}]"
            ]
          }
        }
      ]
    }
  }
}

Thanks, Raymond — I verified your account and updated your truck’s usage to personal use with 6,000 annual miles.

Your auto policy has been repriced, and your new premium is $937.82 for the 6-month term.

What changed:

Previous premium: $1,204.68
New premium: $937.82
Difference: $266.86 lower for the term

The biggest change was the mileage factor:

Old annual miles: 16,000
New annual miles: 6,000

I also updated the usage from commuting to personal, based on what you told me.

If you want, I can also help estimate what that means per installment payment.

29k in · 465 out · $0.02 · 18.2s

Customer

That's great — thanks for getting that done. So I'm saving $266.86 every six months, that's solid. I appreciate you breaking down what changed. I don't need the installment breakdown — I can figure that out. But I'm glad that's all set. Thanks for your help.

Agent

⚙ end_conversation()

{}

{
  "ok": true,
  "note": "Deliver your closing message now."
}

You’re very welcome — glad I could help. Thanks for choosing PEICO, and have a great day.

15k in · 39 out · $0.0064 · 2.7s