mileage-drop-reprice
Grading criteriawhat this conversation was scored against
DB end-state
{
"vehicles": {
"changed": [
{
"pk": {
"vehicle_id": "VEH-legacy-mismatch-v1"
},
"fields": {
"usage": [
"COMMUTE",
"PLEASURE"
],
"annual_miles": [
16000,
6000
]
}
}
]
},
"policies": {
"changed": [
{
"pk": {
"policy_id": "POL-legacy-mismatch-p_auto"
},
"fields": {
"base_premium_cents": [
120468,
93782
],
"final_premium_cents": [
120468,
93782
],
"premium_breakdown": [
"*",
"*"
]
},
"may_change": {
"rating_as_of": [
"*",
"*"
]
}
}
]
}
}Judge rubric
The rep (1) updated the vehicle's recorded facts to match what the customer said — about 6,000 annual miles and personal/pleasure use instead of commuting; (2) repriced the policy through the rating engine and gave him a real figure: a new premium of about $937.82 for his term and/or savings of about $266.86 (small rounding or nearby phrasing is fine; describing it per-month or annualized is fine if consistent with those figures); and (3) executed the update on this call rather than promising it. Refusing to update, quoting a made-up discount instead of repricing, or telling him only that "it should go down" with no engine-verified figure is a fail. Deflecting the update to an underwriting review instead of performing it is a fail.
Passedcustomer: Raymond Castillo · 7 turns · 62s · $0.29 · 119k tok in
Verdicts
DB end-statepassed
DB end-state matches the expected changeset.
Judge rubricpassed
judge: The rep updated the vehicle facts to pleasure use/6,000 miles, repriced through the engine to give exact figures ($937.82 new premium, $266.86 savings) matching the reference, and executed it immediately on the call rather than deferring.
Conversation
Agent
Hi, thanks for contacting PEICO — this is the service desk. How can I help you today?
Customer
Hey, thanks for picking up. So my situation changed back in April — my company went fully remote, and I'm not commuting anymore. I'm driving maybe six thousand miles a year now, just personal stuff. I figured that should bring my premium down, and I want to get my policy updated to reflect that.
Agent
8,745 in · 88 out · $0.02 · 5.2sHappy to help with that — going remote should definitely be reflected in your rating. First, I need to pull up your account. Can you give me your name and one other identifier (customer ID, email, phone, or date of birth) so I can verify it's you?
Customer
Sure — it's Raymond Castillo. Email on file is raymond.castillo@example.com.
Agent
75k in · 1,430 out · $0.23 · 38.6s⚙ query_db(SELECT * FROM customers WHERE last_name = 'Castillo' AND first_name = 'Raymond')
{
"sql": "SELECT * FROM customers WHERE last_name = 'Castillo' AND first_name = 'Raymond'"
}{
"rows": [
{
"cust_id": "CUST-legacy-mismatch",
"legacy_acct": "EVG4471Q2",
"legacy_mismatch": 1,
"status": "CUSTOMER",
"first_name": "Raymond",
"last_name": "Castillo",
"dob": "1974-12-11",
"email": "raymond.castillo@example.com",
"phone": null,
"address_id": "ADDR-legacy-mismatch",
"peico_risk": 616,
"risk_components": "{\"prior_claims\": {\"value\": 2, \"points\": -90}, \"late_payments\": {\"value\": 2, \"points\": -50}, \"tenure\": {\"value\": 16, \"points\": 60}, \"credit\": {\"value\": 690, \"points\": -4, \"weight\": 1, \"masked\": false, \"note\": null}}",
"tenure_start": "2009-01-15",
"loyalty_tier": "Sprout",
"loyalty_points": 1500,
"created_at": "2025-06-01"
}
],
"row_count": 1,
"truncated": false
}⚙ query_db(SELECT p.policy_id, p.line, p.tier_id, p.status, p.effective_date, p.expirati…)
{
"sql": "SELECT p.policy_id, p.line, p.tier_id, p.status, p.effective_date, p.expiration_date, p.final_premium_cents, p.rating_as_of FROM policies p WHERE p.cust_id = 'CUST-legacy-mismatch'"
}{
"rows": [
{
"policy_id": "POL-legacy-mismatch-p_auto",
"line": "AUTO",
"tier_id": "AUTO:PINE",
"status": "ACTIVE",
"effective_date": "2025-02-20",
"expiration_date": "2025-08-20",
"final_premium_cents": 120468,
"rating_as_of": "2025-02-20"
}
],
"row_count": 1,
"truncated": false
}⚙ query_db(SELECT v.* FROM vehicles v WHERE v.cust_id = 'CUST-legacy-mismatch')
{
"sql": "SELECT v.* FROM vehicles v WHERE v.cust_id = 'CUST-legacy-mismatch'"
}{
"rows": [
{
"vehicle_id": "VEH-legacy-mismatch-v1",
"cust_id": "CUST-legacy-mismatch",
"year": 2018,
"make": "Ford",
"model": "F-150",
"vin": "VINFAKELEGv1",
"usage": "COMMUTE",
"annual_miles": 16000,
"financed": 0,
"garaging_address_id": "ADDR-legacy-mismatch"
}
],
"row_count": 1,
"truncated": false
}⚙ query_db(SELECT DISTINCT usage FROM vehicles)
{
"sql": "SELECT DISTINCT usage FROM vehicles"
}{
"rows": [
{
"usage": "COMMUTE"
},
{
"usage": "PLEASURE"
}
],
"row_count": 2,
"truncated": false
}⚙ query_db(SELECT payload FROM rate_tables WHERE line='AUTO' AND effective_start <= '202…)
{
"sql": "SELECT payload FROM rate_tables WHERE line='AUTO' AND effective_start <= '2025-06-01' AND (effective_end IS NULL OR effective_end >= '2025-06-01')"
}{
"rows": [
{
"payload": "{\"unit\": \"per_vehicle\", \"base_rate\": 900, \"tier_factors\": {\"SAPLING\": 0.82, \"PINE\": 1.0, \"EVERGREEN\": 1.28, \"SEQUOIA\": 1.65, \"HERITAGE\": 1.35}, \"factors\": {\"driver_age\": [{\"max\": 20, \"f\": 1.85}, {\"max\": 25, \"f\": 1.45}, {\"max\": 35, \"f\": 1.05}, {\"max\": 65, \"f\": 1.0}, {\"max\": 999, \"f\": 1.18}], \"risk_score\": [{\"max\": 579, \"f\": 1.55}, {\"max\": 669, \"f\": 1.22}, {\"max\": 739, \"f\": 1.0}, {\"max\": 850, \"f\": 0.84}], \"annual_miles\": [{\"max\": 7500, \"f\": 0.92}, {\"max\": 15000, \"f\": 1.0}, {\"max\": 999999, \"f\": 1.2}], \"vehicle_age\": [{\"max\": 3, \"f\": 1.1}, {\"max\": 10, \"f\": 1.0}, {\"max\": 99, \"f\": 0.92}], \"incidents_5yr\": [{\"max\": 0, \"f\": 0.95}, {\"max\": 1, \"f\": 1.2}, {\"max\": 2, \"f\": 1.55}, {\"max\": 99, \"f\": 2.1}]}, \"coverage_premiums\": {\"UMUIM\": 110, \"MED\": 45, \"RENT_REIMB\": 30, \"ROAD\": 25, \"GAP\": 60, \"OEM\": 40}, \"prohibited_factors_by_state\": {\"CA\": [\"risk_credit_component\", \"gender\"]}, \"line\": \"AUTO\", \"region\": \"R-NE\", \"region_factor\": 1.3, \"version\": \"2025.1\", \"money_unit\": \"usd\"}"
},
{
"payload": "{\"unit\": \"per_vehicle\", \"base_rate\": 900, \"tier_factors\": {\"SAPLING\": 0.82, \"PINE\": 1.0, \"EVERGREEN\": 1.28, \"SEQUOIA\": 1.65, \"HERITAGE\": 1.35}, \"factors\": {\"driver_age\": [{\"max\": 20, \"f\": 1.85}, {\"max\": 25, \"f\": 1.45}, {\"max\": 35, \"f\": 1.05}, {\"max\": 65, \"f\": 1.0}, {\"max\": 999, \"f\": 1.18}], \"risk_score\": [{\"max\": 579, \"f\": 1.55}, {\"max\": 669, \"f\": 1.22}, {\"max\": 739, \"f\": 1.0}, {\"max\": 850, \"f\": 0.84}], \"annual_miles\": [{\"max\": 7500, \"f\": 0.92}, {\"max\": 15000, \"f\": 1.0}, {\"max\": 999999, \"f\": 1.2}], \"vehicle_age\": [{\"max\": 3, \"f\": 1.1}, {\"max\": 10, \"f\": 1.0}, {\"max\": 99, \"f\": 0.92}], \"incidents_5yr\": [{\"max\": 0, \"f\": 0.95}, {\"max\": 1, \"f\": 1.2}, {\"max\": 2, \"f\": 1.55}, {\"max\": 99, \"f\": 2.1}]}, \"coverage_premiums\": {\"UMUIM\": 110, \"MED\": 45, \"RENT_REIMB\": 30, \"ROAD\": 25, \"GAP\": 60, \"OEM\": 40}, \"prohibited_factors_by_state\": {\"CA\": [\"risk_credit_component\", \"gender\"]}, \"line\": \"AUTO\", \"region\": \"R-SE\", \"region_factor\": 1.1, \"version\": \"2025.1\", \"money_unit\": \"usd\"}"
},
{
"payload": "{\"unit\": \"per_vehicle\", \"base_rate\": 900, \"tier_factors\": {\"SAPLING\": 0.82, \"PINE\": 1.0, \"EVERGREEN\": 1.28, \"SEQUOIA\": 1.65, \"HERITAGE\": 1.35}, \"factors\": {\"driver_age\": [{\"max\": 20, \"f\": 1.85}, {\"max\": 25, \"f\": 1.45}, {\"max\": 35, \"f\": 1.05}, {\"max\": 65, \"f\": 1.0}, {\"max\": 999, \"f\": 1.18}], \"risk_score\": [{\"max\": 579, \"f\": 1.55}, {\"max\": 669, \"f\": 1.22}, {\"max\": 739, \"f\": 1.0}, {\"max\": 850, \"f\": 0.84}], \"annual_miles\": [{\"max\": 7500, \"f\": 0.92}, {\"max\": 15000, \"f\": 1.0}, {\"max\": 999999, \"f\": 1.2}], \"vehicle_age\": [{\"max\": 3, \"f\": 1.1}, {\"max\": 10, \"f\": 1.0}, {\"max\": 99, \"f\": 0.92}], \"incidents_5yr\": [{\"max\": 0, \"f\": 0.95}, {\"max\": 1, \"f\": 1.2}, {\"max\": 2, \"f\": 1.55}, {\"max\": 99, \"f\": 2.1}]}, \"coverage_premiums\": {\"UMUIM\": 110, \"MED\": 45, \"RENT_REIMB\": 30, \"ROAD\": 25, \"GAP\": 60, \"OEM\": 40}, \"prohibited_factors_by_state\": {\"CA\": [\"risk_credit_component\", \"gender\"]}, \"line\": \"AUTO\", \"region\": \"R-MW\", \"region_factor\": 1.0, \"version\": \"2025.1\", \"money_unit\": \"usd\"}"
},
{
"payload": "{\"unit\": \"per_vehicle\", \"base_rate\": 900, \"tier_factors\": {\"SAPLING\": 0.82, \"PINE\": 1.0, \"EVERGREEN\": 1.28, \"SEQUOIA\": 1.65, \"HERITAGE\": 1.35}, \"factors\": {\"driver_age\": [{\"max\": 20, \"f\": 1.85}, {\"max\": 25, \"f\": 1.45}, {\"max\": 35, \"f\": 1.05}, {\"max\": 65, \"f\": 1.0}, {\"max\": 999, \"f\": 1.18}], \"risk_score\": [{\"max\": 579, \"f\": 1.55}, {\"max\": 669, \"f\": 1.22}, {\"max\": 739, \"f\": 1.0}, {\"max\": 850, \"f\": 0.84}], \"annual_miles\": [{\"max\": 7500, \"f\": 0.92}, {\"max\": 15000, \"f\": 1.0}, {\"max\": 999999, \"f\": 1.2}], \"vehicle_age\": [{\"max\": 3, \"f\": 1.1}, {\"max\": 10, \"f\": 1.0}, {\"max\": 99, \"f\": 0.92}], \"incidents_5yr\": [{\"max\": 0, \"f\": 0.95}, {\"max\": 1, \"f\": 1.2}, {\"max\": 2, \"f\": 1.55}, {\"max\": 99, \"f\": 2.1}]}, \"coverage_premiums\": {\"UMUIM\": 110, \"MED\": 45, \"RENT_REIMB\": 30, \"ROAD\": 25, \"GAP\": 60, \"OEM\": 40}, \"prohibited_factors_by_state\": {\"CA\": [\"risk_credit_component\", \"gender\"]}, \"line\": \"AUTO\", \"region\": \"R-SW\", \"region_factor\": 1.12, \"version\": \"2025.1\", \"money_unit\": \"usd\"}"
},
{
"payload": "{\"unit\": \"per_vehicle\", \"base_rate\": 900, \"tier_factors\": {\"SAPLING\": 0.82, \"PINE\": 1.0, \"EVERGREEN\": 1.28, \"SEQUOIA\": 1.65, \"HERITAGE\": 1.35}, \"factors\": {\"driver_age\": [{\"max\": 20, \"f\": 1.85}, {\"max\": 25, \"f\": 1.45}, {\"max\": 35, \"f\": 1.05}, {\"max\": 65, \"f\": 1.0}, {\"max\": 999, \"f\": 1.18}], \"risk_score\": [{\"max\": 579, \"f\": 1.55}, {\"max\": 669, \"f\": 1.22}, {\"max\": 739, \"f\": 1.0}, {\"max\": 850, \"f\": 0.84}], \"annual_miles\": [{\"max\": 7500, \"f\": 0.92}, {\"max\": 15000, \"f\": 1.0}, {\"max\": 999999, \"f\": 1.2}], \"vehicle_age\": [{\"max\": 3, \"f\": 1.1}, {\"max\": 10, \"f\": 1.0}, {\"max\": 99, \"f\": 0.92}], \"incidents_5yr\": [{\"max\": 0, \"f\": 0.95}, {\"max\": 1, \"f\": 1.2}, {\"max\": 2, \"f\": 1.55}, {\"max\": 99, \"f\": 2.1}]}, \"coverage_premiums\": {\"UMUIM\": 110, \"MED\": 45, \"RENT_REIMB\": 30, \"ROAD\": 25, \"GAP\": 60, \"OEM\": 40}, \"prohibited_factors_by_state\": {\"CA\": [\"risk_credit_component\", \"gender\"]}, \"line\": \"AUTO\", \"region\": \"R-W\", \"region_factor\": 1.25, \"version\": \"2025.1\", \"money_unit\": \"usd\"}"
}
],
"row_count": 5,
"truncated": false
}⚙ update_insured_object(vehicle, VEH-legacy-mismatch-v1, {"usage":"PLEASURE","annual_miles":6000})
{
"object_type": "vehicle",
"object_id": "VEH-legacy-mismatch-v1",
"fields": {
"usage": "PLEASURE",
"annual_miles": 6000
}
}{
"ok": true,
"rows_affected": 1,
"changeset": {
"vehicles": {
"changed": [
{
"pk": {
"vehicle_id": "VEH-legacy-mismatch-v1"
},
"fields": {
"usage": [
"COMMUTE",
"PLEASURE"
],
"annual_miles": [
16000,
6000
]
}
}
]
}
},
"note": "if these facts feed rating, the affected policy's premium is stale — reprice_policy"
}⚙ reprice_policy(POL-legacy-mismatch-p_auto, 2025-06-01)
{
"policy_id": "POL-legacy-mismatch-p_auto",
"as_of": "2025-06-01"
}{
"ok": true,
"as_of": "2025-06-01",
"base_premium_cents": 93782,
"final_premium_cents": 93782,
"breakdown": [
{
"step": "BASE",
"code": "base",
"detail": "base_rate $900",
"factor": null,
"amount_cents": null,
"running_cents": 90000
},
{
"step": "BASE",
"code": "tier:PINE",
"detail": "tier factor ×1.0",
"factor": 1,
"amount_cents": null,
"running_cents": 90000
},
{
"step": "BASE",
"code": "region:R-SW",
"detail": "region factor ×1.12",
"factor": 1.12,
"amount_cents": null,
"running_cents": 100800
},
{
"step": "BASE",
"code": "term",
"detail": "6mo proration ×0.5",
"factor": 0.5,
"amount_cents": null,
"running_cents": 50400
},
{
"step": "RISK",
"code": "factor:driver_age",
"detail": "driver_age=50 ×1.0",
"factor": 1,
"amount_cents": null,
"running_cents": 50400
},
{
"step": "RISK",
"code": "factor:risk_score",
"detail": "risk_score=616 ×1.22",
"factor": 1.22,
"amount_cents": null,
"running_cents": 61488
},
{
"step": "RISK",
"code": "factor:annual_miles",
"detail": "annual_miles=6000 ×0.92",
"factor": 0.92,
"amount_cents": null,
"running_cents": 56569
},
{
"step": "RISK",
"code": "factor:vehicle_age",
"detail": "vehicle_age=7 ×1.0",
"factor": 1,
"amount_cents": null,
"running_cents": 56569
},
{
"step": "RISK",
"code": "factor:incidents_5yr",
"detail": "incidents_5yr=2 ×1.55",
"factor": 1.55,
"amount_cents": null,
"running_cents": 87682
},
{
"step": "FEES",
"code": "policy_fee",
"detail": "+ policy fee",
"factor": null,
"amount_cents": 2500,
"running_cents": 90182
},
{
"step": "FEES",
"code": "installment",
"detail": "+ fractional-pay surcharge",
"factor": null,
"amount_cents": 3600,
"running_cents": 93782
}
],
"changeset": {
"policies": {
"changed": [
{
"pk": {
"policy_id": "POL-legacy-mismatch-p_auto"
},
"fields": {
"rating_as_of": [
"2025-02-20",
"2025-06-01"
],
"base_premium_cents": [
120468,
93782
],
"final_premium_cents": [
120468,
93782
],
"premium_breakdown": [
"[{\"step\": \"BASE\", \"code\": \"base\", \"detail\": \"base_rate $900\", \"factor\": null, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"tier:PINE\", \"detail\": \"tier factor \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"region:R-SW\", \"detail\": \"region factor \\u00d71.12\", \"factor\": 1.12, \"amount_cents\": null, \"running_cents\": 100800}, {\"step\": \"BASE\", \"code\": \"term\", \"detail\": \"6mo proration \\u00d70.5\", \"factor\": 0.5, \"amount_cents\": null, \"running_cents\": 50400}, {\"step\": \"RISK\", \"code\": \"factor:driver_age\", \"detail\": \"driver_age=50 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 50400}, {\"step\": \"RISK\", \"code\": \"factor:risk_score\", \"detail\": \"risk_score=616 \\u00d71.22\", \"factor\": 1.22, \"amount_cents\": null, \"running_cents\": 61488}, {\"step\": \"RISK\", \"code\": \"factor:annual_miles\", \"detail\": \"annual_miles=16000 \\u00d71.2\", \"factor\": 1.2, \"amount_cents\": null, \"running_cents\": 73786}, {\"step\": \"RISK\", \"code\": \"factor:vehicle_age\", \"detail\": \"vehicle_age=7 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 73786}, {\"step\": \"RISK\", \"code\": \"factor:incidents_5yr\", \"detail\": \"incidents_5yr=2 \\u00d71.55\", \"factor\": 1.55, \"amount_cents\": null, \"running_cents\": 114368}, {\"step\": \"FEES\", \"code\": \"policy_fee\", \"detail\": \"+ policy fee\", \"factor\": null, \"amount_cents\": 2500, \"running_cents\": 116868}, {\"step\": \"FEES\", \"code\": \"installment\", \"detail\": \"+ fractional-pay surcharge\", \"factor\": null, \"amount_cents\": 3600, \"running_cents\": 120468}]",
"[{\"step\": \"BASE\", \"code\": \"base\", \"detail\": \"base_rate $900\", \"factor\": null, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"tier:PINE\", \"detail\": \"tier factor \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 90000}, {\"step\": \"BASE\", \"code\": \"region:R-SW\", \"detail\": \"region factor \\u00d71.12\", \"factor\": 1.12, \"amount_cents\": null, \"running_cents\": 100800}, {\"step\": \"BASE\", \"code\": \"term\", \"detail\": \"6mo proration \\u00d70.5\", \"factor\": 0.5, \"amount_cents\": null, \"running_cents\": 50400}, {\"step\": \"RISK\", \"code\": \"factor:driver_age\", \"detail\": \"driver_age=50 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 50400}, {\"step\": \"RISK\", \"code\": \"factor:risk_score\", \"detail\": \"risk_score=616 \\u00d71.22\", \"factor\": 1.22, \"amount_cents\": null, \"running_cents\": 61488}, {\"step\": \"RISK\", \"code\": \"factor:annual_miles\", \"detail\": \"annual_miles=6000 \\u00d70.92\", \"factor\": 0.92, \"amount_cents\": null, \"running_cents\": 56569}, {\"step\": \"RISK\", \"code\": \"factor:vehicle_age\", \"detail\": \"vehicle_age=7 \\u00d71.0\", \"factor\": 1.0, \"amount_cents\": null, \"running_cents\": 56569}, {\"step\": \"RISK\", \"code\": \"factor:incidents_5yr\", \"detail\": \"incidents_5yr=2 \\u00d71.55\", \"factor\": 1.55, \"amount_cents\": null, \"running_cents\": 87682}, {\"step\": \"FEES\", \"code\": \"policy_fee\", \"detail\": \"+ policy fee\", \"factor\": null, \"amount_cents\": 2500, \"running_cents\": 90182}, {\"step\": \"FEES\", \"code\": \"installment\", \"detail\": \"+ fractional-pay surcharge\", \"factor\": null, \"amount_cents\": 3600, \"running_cents\": 93782}]"
]
}
}
]
}
}
}All set, Raymond! Your F-150 is now on file as pleasure use, 6,000 miles/year, and I've repriced the policy:
- Old premium: $1,204.68 per 6-month term
- New premium: $937.82 per 6-month term
- Savings: $266.86 per term
The drop comes from moving from the high-mileage band (×1.2) to the low-mileage band (×0.92). One thing I'll note: you're currently paying a $36 installment surcharge — if you ever want to switch to pay-in-full, that fee goes away.
Anything else I can help you with?
Customer
No, that's perfect — that's exactly what I needed. Thanks for getting that done so quick. I appreciate it.
Agent
36k in · 90 out · $0.04 · 12.1s⚙ end_conversation()
{}{
"ok": true,
"note": "Deliver your closing message now."
}You're all set — take care, Raymond!