← GPT-5.4 nano (none)

legacy-glossary-coverage-compare

Grading criteriawhat this conversation was scored against

DB end-state

The database must be left untouched: the correct outcome for this case is no writes at all.

Judge rubric

The rep correctly explained the three legacy codes in plain language — UMUIM is uninsured/underinsured motorist coverage, RENT_REIMB is rental reimbursement while the car is in the shop, and OEM is an original-manufacturer parts guarantee — AND verified against the customer's actual current policy that all three are still included today, answering yes for each. Telling him any of the three is no longer on his policy is a fail. Answering only from general tier descriptions without confirming his specific policy's coverages, when the transcript shows no check of his actual policy, is a fail. The rep must not change anything or sell anything.

Passedcustomer: Walter Pennington · 7 turns · 16s · $0.0034 · 54k tok in

Verdicts

DB end-statepassed
DB end-state matches the expected changeset.
Judge rubricpassed
judge: The rep correctly explained all three codes in plain language and confirmed each is present on Walter's actual current policy (POL-heritage-auto-p_auto), matching the reference answer, with no changes or sales made.

Conversation

Agent

Hi, thanks for contacting PEICO — this is the service desk. How can I help you today?

Customer

Hi there. I'm Walter Pennington — I'm a longtime customer and I found an old declarations page from when I had the EVERGREEN plan. There are a few coverage codes on it that I don't understand, and I want to know what they mean and whether I still have that coverage today.

Agent

Hi Walter — I can help decode those coverage codes and check whether you still have the same coverage on your current PEICO policy(ies).

To look up your account, I’ll need to verify your identity first. Please share one of the following:

  1. the email or phone number you have on file with PEICO, or
  2. the last 4 digits of the legacy account number shown on the declarations page.

Then, please paste (or type) the coverage codes exactly as they appear on the old page (and the line/section they’re under, if you see it—e.g., Auto/Home umbrella). If you can, also tell me the state the policy was for.

Once I have those, I’ll:

  • look up what each code means in our system, and
  • cross-check your current active/cancelled policies to see if you still carry the same coverage.
4,754 in · 201 out · $0.0005 · 2.3s
Customer

Sure. My email on file is walter.pennington@example.com, and the policy was for Ohio. The three codes I need explained are: **UMUIM**, **RENT_REIMB**, and **OEM**. They're all listed under the auto coverage section on the declarations page.

Agent
⚙ query_db(SELECT cust_id, legacy_acct, first_name, last_name, email, phone, address_id,…)
{
  "sql": "SELECT cust_id, legacy_acct, first_name, last_name, email, phone, address_id, status FROM customers WHERE email = 'walter.pennington@example.com'"
}
{
  "rows": [
    {
      "cust_id": "CUST-heritage-auto",
      "legacy_acct": "EVG0098H1",
      "first_name": "Walter",
      "last_name": "Pennington",
      "email": "walter.pennington@example.com",
      "phone": null,
      "address_id": "ADDR-heritage-auto",
      "status": "CUSTOMER"
    }
  ],
  "row_count": 1,
  "truncated": false
}
⚙ search_kb(UMUIM coverage code, 8)
{
  "query": "UMUIM coverage code",
  "limit": 8
}
{
  "results": [
    {
      "doc_id": "KB-GLOSSARY-AUTO",
      "title": "Auto coverage codes, decoded",
      "category": "GLOSSARY",
      "applies_to": "{\"lines\": [\"AUTO\", \"MOTO\", \"RV\", \"BOAT\", \"CLSC\"]}",
      "snippet": "EVERGREEN stores auto coverages under terse codes. Plain-language meanings:\n- **BI** — Bodily Injury liability (per-person / per-accident).\n- **PD** — Property Damage liability.\n- **UM/UIM** (`UMUIM`) — Uninsured / Underinsured Motorist.\n- …"
    },
    {
      "doc_id": "KB-LEGACY-XWALK",
      "title": "Reading an EVERGREEN plan code (legacy → CANOPY)",
      "category": "HOWTO",
      "applies_to": "{\"lines\": [\"AUTO\"]}",
      "snippet": "PEICO is migrating from the legacy **EVERGREEN** mainframe to **CANOPY**. An\nEVERGREEN auto policy is stored as one **plan code** `A<class><gen>` (class\nB=Basic, S=Standard, P=Preferred). A plan code does NOT map to a CANOPY tier on\nits own…"
    },
    {
      "doc_id": "KB-AUTO-TIERS",
      "title": "Auto tiers: Sapling → Pine → Evergreen → Sequoia",
      "category": "POLICY",
      "applies_to": "{\"lines\": [\"AUTO\"]}",
      "snippet": "Tiers bundle coverages. Higher tiers raise liability limits, lower deductibles,\nand add coverages: **MED** and **RENT_REIMB** appear at Evergreen and above;\n**OEM** is Sequoia-only; **ROAD** is included at Sequoia (an add-on below it).\n"
    },
    {
      "doc_id": "KB-TX-MOTO",
      "title": "TX: motorcycle custom-parts coverage unavailable",
      "category": "UNDERWRITING",
      "applies_to": "{\"lines\": [\"MOTO\"], \"states\": [\"TX\"]}",
      "snippet": "Due to a historical licensing limitation, Custom Parts & Equipment coverage is\n**not available on motorcycle policies in Texas**.\n"
    },
    {
      "doc_id": "KB-DISC-HLTH-SUPP",
      "title": "Supplemental health: not major-medical; pre-existing limits",
      "category": "COMPLIANCE",
      "applies_to": "{\"lines\": [\"HLTH\"]}",
      "snippet": "Disclose and record that this is **supplemental** coverage (accident / critical\nillness / hospital indemnity) and **NOT ACA major-medical** — it does not satisfy a\ncoverage mandate and does not replace health insurance. Pre-existing conditi…"
    },
    {
      "doc_id": "KB-HERITAGE",
      "title": "Heritage tier (retired 2009) — do not drop without disclosure",
      "category": "UNDERWRITING",
      "applies_to": "{\"lines\": [\"AUTO\"]}",
      "snippet": "Heritage was retired on 2009-07-01 and cannot be sold or re-bound. It carries a\ncoverage combination no current tier offers (Sequoia-level MED/RENT_REIMB/ROAD/OEM\non a mid liability base). A customer who drops Heritage **loses that combinat…"
    },
    {
      "doc_id": "KB-CONDO-MASTER",
      "title": "Condo loss assessment & the HOA master policy",
      "category": "POLICY",
      "applies_to": "{\"lines\": [\"CONDO\"]}",
      "snippet": "Loss Assessment coverage responds to charges levied by the HOA. Its adequacy\ndepends on the **master-policy deductible**; record that deductible so the limit\nis set correctly.\n"
    },
    {
      "doc_id": "KB-SUITABILITY",
      "title": "Suitability requirement for Life & Health",
      "category": "COMPLIANCE",
      "applies_to": "{\"lines\": [\"LIFE_T\", \"LIFE_W\", \"HLTH\"]}",
      "snippet": "Before binding any Life or Supplemental Health policy you must complete a\n**suitability record** (income, existing coverage, dependents, stated need,\nhorizon, risk tolerance) with outcome SUITABLE. Selling **whole life** to a\nshort-horizon,…"
    }
  ]
}
⚙ search_kb(RENT_REIMB coverage code, 8)
{
  "query": "RENT_REIMB coverage code",
  "limit": 8
}
{
  "results": [
    {
      "doc_id": "KB-GLOSSARY-AUTO",
      "title": "Auto coverage codes, decoded",
      "category": "GLOSSARY",
      "applies_to": "{\"lines\": [\"AUTO\", \"MOTO\", \"RV\", \"BOAT\", \"CLSC\"]}",
      "snippet": "EVERGREEN stores auto coverages under terse codes. Plain-language meanings:\n- **BI** — Bodily Injury liability (per-person / per-accident).\n- **PD** — Property Damage liability.\n- **UM/UIM** (`UMUIM`) — Uninsured / Underinsured Motorist.\n- …"
    },
    {
      "doc_id": "KB-LEGACY-XWALK",
      "title": "Reading an EVERGREEN plan code (legacy → CANOPY)",
      "category": "HOWTO",
      "applies_to": "{\"lines\": [\"AUTO\"]}",
      "snippet": "PEICO is migrating from the legacy **EVERGREEN** mainframe to **CANOPY**. An\nEVERGREEN auto policy is stored as one **plan code** `A<class><gen>` (class\nB=Basic, S=Standard, P=Preferred). A plan code does NOT map to a CANOPY tier on\nits own…"
    },
    {
      "doc_id": "KB-AUTO-TIERS",
      "title": "Auto tiers: Sapling → Pine → Evergreen → Sequoia",
      "category": "POLICY",
      "applies_to": "{\"lines\": [\"AUTO\"]}",
      "snippet": "Tiers bundle coverages. Higher tiers raise liability limits, lower deductibles,\nand add coverages: **MED** and **RENT_REIMB** appear at Evergreen and above;\n**OEM** is Sequoia-only; **ROAD** is included at Sequoia (an add-on below it).\n"
    },
    {
      "doc_id": "KB-HERITAGE",
      "title": "Heritage tier (retired 2009) — do not drop without disclosure",
      "category": "UNDERWRITING",
      "applies_to": "{\"lines\": [\"AUTO\"]}",
      "snippet": "Heritage was retired on 2009-07-01 and cannot be sold or re-bound. It carries a\ncoverage combination no current tier offers (Sequoia-level MED/RENT_REIMB/ROAD/OEM\non a mid liability base). A customer who drops Heritage **loses that combinat…"
    },
    {
      "doc_id": "KB-TX-MOTO",
      "title": "TX: motorcycle custom-parts coverage unavailable",
      "category": "UNDERWRITING",
      "applies_to": "{\"lines\": [\"MOTO\"], \"states\": [\"TX\"]}",
      "snippet": "Due to a historical licensing limitation, Custom Parts & Equipment coverage is\n**not available on motorcycle policies in Texas**.\n"
    },
    {
      "doc_id": "KB-DISC-HLTH-SUPP",
      "title": "Supplemental health: not major-medical; pre-existing limits",
      "category": "COMPLIANCE",
      "applies_to": "{\"lines\": [\"HLTH\"]}",
      "snippet": "Disclose and record that this is **supplemental** coverage (accident / critical\nillness / hospital indemnity) and **NOT ACA major-medical** — it does not satisfy a\ncoverage mandate and does not replace health insurance. Pre-existing conditi…"
    },
    {
      "doc_id": "KB-CONDO-MASTER",
      "title": "Condo loss assessment & the HOA master policy",
      "category": "POLICY",
      "applies_to": "{\"lines\": [\"CONDO\"]}",
      "snippet": "Loss Assessment coverage responds to charges levied by the HOA. Its adequacy\ndepends on the **master-policy deductible**; record that deductible so the limit\nis set correctly.\n"
    },
    {
      "doc_id": "KB-SUITABILITY",
      "title": "Suitability requirement for Life & Health",
      "category": "COMPLIANCE",
      "applies_to": "{\"lines\": [\"LIFE_T\", \"LIFE_W\", \"HLTH\"]}",
      "snippet": "Before binding any Life or Supplemental Health policy you must complete a\n**suitability record** (income, existing coverage, dependents, stated need,\nhorizon, risk tolerance) with outcome SUITABLE. Selling **whole life** to a\nshort-horizon,…"
    }
  ]
}
⚙ search_kb(OEM coverage code, 8)
{
  "query": "OEM coverage code",
  "limit": 8
}
{
  "results": [
    {
      "doc_id": "KB-GLOSSARY-AUTO",
      "title": "Auto coverage codes, decoded",
      "category": "GLOSSARY",
      "applies_to": "{\"lines\": [\"AUTO\", \"MOTO\", \"RV\", \"BOAT\", \"CLSC\"]}",
      "snippet": "EVERGREEN stores auto coverages under terse codes. Plain-language meanings:\n- **BI** — Bodily Injury liability (per-person / per-accident).\n- **PD** — Property Damage liability.\n- **UM/UIM** (`UMUIM`) — Uninsured / Underinsured Motorist.\n- …"
    },
    {
      "doc_id": "KB-LEGACY-XWALK",
      "title": "Reading an EVERGREEN plan code (legacy → CANOPY)",
      "category": "HOWTO",
      "applies_to": "{\"lines\": [\"AUTO\"]}",
      "snippet": "PEICO is migrating from the legacy **EVERGREEN** mainframe to **CANOPY**. An\nEVERGREEN auto policy is stored as one **plan code** `A<class><gen>` (class\nB=Basic, S=Standard, P=Preferred). A plan code does NOT map to a CANOPY tier on\nits own…"
    },
    {
      "doc_id": "KB-AUTO-TIERS",
      "title": "Auto tiers: Sapling → Pine → Evergreen → Sequoia",
      "category": "POLICY",
      "applies_to": "{\"lines\": [\"AUTO\"]}",
      "snippet": "Tiers bundle coverages. Higher tiers raise liability limits, lower deductibles,\nand add coverages: **MED** and **RENT_REIMB** appear at Evergreen and above;\n**OEM** is Sequoia-only; **ROAD** is included at Sequoia (an add-on below it).\n"
    },
    {
      "doc_id": "KB-HERITAGE",
      "title": "Heritage tier (retired 2009) — do not drop without disclosure",
      "category": "UNDERWRITING",
      "applies_to": "{\"lines\": [\"AUTO\"]}",
      "snippet": "Heritage was retired on 2009-07-01 and cannot be sold or re-bound. It carries a\ncoverage combination no current tier offers (Sequoia-level MED/RENT_REIMB/ROAD/OEM\non a mid liability base). A customer who drops Heritage **loses that combinat…"
    },
    {
      "doc_id": "KB-TX-MOTO",
      "title": "TX: motorcycle custom-parts coverage unavailable",
      "category": "UNDERWRITING",
      "applies_to": "{\"lines\": [\"MOTO\"], \"states\": [\"TX\"]}",
      "snippet": "Due to a historical licensing limitation, Custom Parts & Equipment coverage is\n**not available on motorcycle policies in Texas**.\n"
    },
    {
      "doc_id": "KB-DISC-HLTH-SUPP",
      "title": "Supplemental health: not major-medical; pre-existing limits",
      "category": "COMPLIANCE",
      "applies_to": "{\"lines\": [\"HLTH\"]}",
      "snippet": "Disclose and record that this is **supplemental** coverage (accident / critical\nillness / hospital indemnity) and **NOT ACA major-medical** — it does not satisfy a\ncoverage mandate and does not replace health insurance. Pre-existing conditi…"
    },
    {
      "doc_id": "KB-CONDO-MASTER",
      "title": "Condo loss assessment & the HOA master policy",
      "category": "POLICY",
      "applies_to": "{\"lines\": [\"CONDO\"]}",
      "snippet": "Loss Assessment coverage responds to charges levied by the HOA. Its adequacy\ndepends on the **master-policy deductible**; record that deductible so the limit\nis set correctly.\n"
    },
    {
      "doc_id": "KB-SUITABILITY",
      "title": "Suitability requirement for Life & Health",
      "category": "COMPLIANCE",
      "applies_to": "{\"lines\": [\"LIFE_T\", \"LIFE_W\", \"HLTH\"]}",
      "snippet": "Before binding any Life or Supplemental Health policy you must complete a\n**suitability record** (income, existing coverage, dependents, stated need,\nhorizon, risk tolerance) with outcome SUITABLE. Selling **whole life** to a\nshort-horizon,…"
    }
  ]
}
⚙ query_db(SELECT policy_id, line, status, effective_date, expiration_date, tier_id, rat…)
{
  "sql": "SELECT policy_id, line, status, effective_date, expiration_date, tier_id, rating_as_of FROM policies WHERE cust_id = 'CUST-heritage-auto' AND line = 'AUTO' ORDER BY effective_date DESC"
}
{
  "rows": [
    {
      "policy_id": "POL-heritage-auto-p_auto",
      "line": "AUTO",
      "status": "ACTIVE",
      "effective_date": "2025-02-01",
      "expiration_date": "2026-02-01",
      "tier_id": "AUTO:HERITAGE",
      "rating_as_of": "2025-02-01"
    }
  ],
  "row_count": 1,
  "truncated": false
}
⚙ price_check(POL-heritage-auto-p_auto, 2025-06-01)
{
  "policy_id": "POL-heritage-auto-p_auto",
  "as_of": "2025-06-01"
}
{
  "as_of": "2025-06-01",
  "facts": {
    "line": "AUTO",
    "tier": "HERITAGE",
    "region": "R-MW",
    "state": "OH",
    "term_months": 12,
    "peico_risk": 731,
    "age": 67,
    "billing_plan": "PAY_IN_FULL",
    "autopay": false,
    "paperless": false,
    "loyalty_tier": "OldGrowth",
    "status": "CUSTOMER",
    "has_bundle": false,
    "active_lines": 1,
    "is_new_first_policy": false,
    "promo_code": null,
    "coverages": [
      "MED",
      "OEM",
      "RENT_REIMB",
      "ROAD",
      "UMUIM"
    ],
    "driver_age": 67,
    "annual_miles": 8000,
    "vehicle_age": 9,
    "incidents_5yr": 1,
    "exposure_count": 1
  },
  "base_premium_cents": 199544,
  "final_premium_cents": 176297,
  "breakdown": [
    {
      "step": "BASE",
      "code": "base",
      "detail": "base_rate $900",
      "factor": null,
      "amount_cents": null,
      "running_cents": 90000
    },
    {
      "step": "BASE",
      "code": "tier:HERITAGE",
      "detail": "tier factor ×1.35",
      "factor": 1.35,
      "amount_cents": null,
      "running_cents": 121500
    },
    {
      "step": "BASE",
      "code": "region:R-MW",
      "detail": "region factor ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 121500
    },
    {
      "step": "RISK",
      "code": "factor:driver_age",
      "detail": "driver_age=67 ×1.18",
      "factor": 1.18,
      "amount_cents": null,
      "running_cents": 143370
    },
    {
      "step": "RISK",
      "code": "factor:risk_score",
      "detail": "risk_score=731 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 143370
    },
    {
      "step": "RISK",
      "code": "factor:annual_miles",
      "detail": "annual_miles=8000 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 143370
    },
    {
      "step": "RISK",
      "code": "factor:vehicle_age",
      "detail": "vehicle_age=9 ×1.0",
      "factor": 1,
      "amount_cents": null,
      "running_cents": 143370
    },
    {
      "step": "RISK",
      "code": "factor:incidents_5yr",
      "detail": "incidents_5yr=1 ×1.2",
      "factor": 1.2,
      "amount_cents": null,
      "running_cents": 172044
    },
    {
      "step": "COVERAGE",
      "code": "MED",
      "detail": "+ MED $45",
      "factor": null,
      "amount_cents": 4500,
      "running_cents": 176544
    },
    {
      "step": "COVERAGE",
      "code": "OEM",
      "detail": "+ OEM $40",
      "factor": null,
      "amount_cents": 4000,
      "running_cents": 180544
    },
    {
      "step": "COVERAGE",
      "code": "RENT_REIMB",
      "detail": "+ RENT_REIMB $30",
      "factor": null,
      "amount_cents": 3000,
      "running_cents": 183544
    },
    {
      "step": "COVERAGE",
      "code": "ROAD",
      "detail": "+ ROAD $25",
      "factor": null,
      "amount_cents": 2500,
      "running_cents": 186044
    },
    {
      "step": "COVERAGE",
      "code": "UMUIM",
      "detail": "+ UMUIM $110",
      "factor": null,
      "amount_cents": 11000,
      "running_cents": 197044
    },
    {
      "step": "FEES",
      "code": "policy_fee",
      "detail": "+ policy fee",
      "factor": null,
      "amount_cents": 2500,
      "running_cents": 199544
    },
    {
      "step": "DISCOUNT",
      "code": "PAID_IN_FULL",
      "detail": "−7%",
      "factor": 0.9299999999999999,
      "amount_cents": null,
      "running_cents": 185576
    },
    {
      "step": "DISCOUNT",
      "code": "LOYALTY",
      "detail": "−5%",
      "factor": 0.95,
      "amount_cents": null,
      "running_cents": 176297
    }
  ]
}

Thanks, Walter — I verified your account from walter.pennington@example.com, and I found an active AUTO policy in Ohio on file (Policy POL-heritage-auto-p_auto, effective 2025-02-01). I also looked up each code in our EVERGREEN auto coverage glossary.

Here’s what your three codes mean and whether you still have them:

1) UMUIM

  • Meaning: Uninsured / Underinsured Motorist coverage (UM/UIM).
  • You still have it today: Yes — it’s on your current active auto policy.

2) RENT_REIMB

  • Meaning: Rental reimbursement (covers rental car costs if your vehicle is out of use due to a covered loss).
  • You still have it today: Yes — it’s on your current active auto policy.

3) OEM

  • Meaning: Original Equipment Manufacturer parts coverage (repairs using OEM parts where applicable).
  • You still have it today: Yes — it’s on your current active auto policy.

If you’d like, I can also pull the limits/deductibles for each of these from your declarations (so you can compare line-by-line with the old page). Would you like that?

30k in · 509 out · $0.0022 · 6.0s
Customer

No, that's perfect — thank you. I really just wanted to know what those codes meant and whether I still had them. That answers everything I needed. Thanks for your help!

Agent
⚙ end_conversation()
{}
{
  "ok": true,
  "note": "Deliver your closing message now."
}

You’re very welcome, Walter—glad I could help. Thanks again for choosing PEICO!

19k in · 37 out · $0.0007 · 1.7s