cancel-sold-tesla
Grading criteriawhat this conversation was scored against
DB end-state
{
"policies": {
"changed": [
{
"pk": {
"policy_id": "POL-ca-masked-auto-p_auto"
},
"fields": {
"status": [
"ACTIVE",
"CANCELLED"
]
}
}
]
}
}Judge rubric
The rep (1) verified the customer's identity before acting on the account; (2) confirmed the cancellation intent (which policy, and that she's sure) without dragging her through more than one retention attempt; (3) actually cancelled the policy on this call and told her it's done; and (4) if she asked about a refund for unused months, did NOT invent a specific refund amount or promise a specific proration figure — the system computes none; acknowledging the question and routing it to billing (or saying a refund of any unused premium will be processed per standard terms, without a made-up number) is correct. Refusing to cancel in conversation, or deflecting the cancellation itself to another team, is a fail. IMPORTANT SCOPE LIMIT: you are shown the spoken conversation only — the rep's system actions (tool calls, database writes) are NOT visible to you, and whether the cancellation was actually written is verified by a separate automated database check. Do NOT pass or fail this trial based on any belief about whether a write occurred or whether you can "see" the cancellation happening; a rep who says the cancellation is done may well have performed it silently. Judge only what was said. One brief retention offer is acceptable; repeated pressure after her refusal is a fail.
Verdicts
DB end-statepassed
DB end-state matches the expected changeset.
Judge rubricpassed
judge: Rep verified identity, confirmed the specific policy and clear intent without repeated retention pressure, stated the cancellation was completed, and on the refund question did not invent a specific figure—correctly routing it to billing per standard terms.
Conversation
Hi, thanks for contacting PEICO — this is the service desk. How can I help you today?
Hi, thanks for picking up. I need to cancel my auto policy — I sold my car yesterday and I'm going car-free, so I don't need coverage anymore.
I can help you with that. First, I need to verify your identity and pull up your account. Could you give me your name and either your PEICO customer ID or the email/phone on file (and your date of birth)?
Sure. My name is Priya Anand. The email on file is priya.anand@example.com, and my date of birth is March 30, 1988.
⚙ query_db(SELECT cust_id, first_name, last_name, dob, email, phone, status FROM custome…)
{
"sql": "SELECT cust_id, first_name, last_name, dob, email, phone, status FROM customers WHERE lower(email)='priya.anand@example.com'"
}{
"rows": [
{
"cust_id": "CUST-ca-masked-auto",
"first_name": "Priya",
"last_name": "Anand",
"dob": "1988-03-30",
"email": "priya.anand@example.com",
"phone": null,
"status": "CUSTOMER"
}
],
"row_count": 1,
"truncated": false
}⚙ query_db(SELECT policy_id, line, tier_id, status, effective_date, expiration_date, fin…)
{
"sql": "SELECT policy_id, line, tier_id, status, effective_date, expiration_date, final_premium_cents, underlying_policy_id FROM policies WHERE cust_id='CUST-ca-masked-auto'"
}{
"rows": [
{
"policy_id": "POL-ca-masked-auto-p_auto",
"line": "AUTO",
"tier_id": "AUTO:EVERGREEN",
"status": "ACTIVE",
"effective_date": "2025-03-10",
"expiration_date": "2026-03-10",
"final_premium_cents": 147023,
"underlying_policy_id": null
}
],
"row_count": 1,
"truncated": false
}Thanks, Priya — you're verified.
I found one auto policy on your account:
- POL-ca-masked-auto-p_auto — AUTO, EVERGREEN tier, ACTIVE, effective 2025-03-10 through 2026-03-10, current premium $1,470.23/yr.
Just to confirm before I do anything: you'd like me to cancel this auto policy entirely, correct? A couple of things to note:
- Cancelling sets it to CANCELLED effective immediately. I don't compute refunds here, but any unused-premium refund would be handled per your billing.
- Once cancelled, that EVERGREEN tier is a legacy plan — if you ever insure a car again, you likely won't be able to get back onto it.
Shall I go ahead and cancel it?
Yes, cancel it please. And just out of curiosity — will I get anything back for the unused months, or does billing handle that separately?
⚙ cancel_policy(POL-ca-masked-auto-p_auto)
{
"policy_id": "POL-ca-masked-auto-p_auto"
}{
"ok": true,
"rows_affected": 1,
"changeset": {
"policies": {
"changed": [
{
"pk": {
"policy_id": "POL-ca-masked-auto-p_auto"
},
"fields": {
"status": [
"ACTIVE",
"CANCELLED"
]
}
}
]
}
}
}Done — your auto policy POL-ca-masked-auto-p_auto is now CANCELLED.
On your question about the unused months: that's handled separately by billing, not by me here. Since you're cancelling partway through your term, you'd typically be due a refund for the unused portion of premium you've already paid. I don't calculate or issue that refund on this desk — billing will process any prorated refund to your original payment method. If you'd like, I can point you to how to check on that, but I can't compute the exact figure from here.
Is there anything else I can help you with?
No, that's all I needed. Thanks for getting that cancelled right away.
⚙ end_conversation()
{}{
"ok": true,
"note": "Deliver your closing message now."
}Thanks for choosing PEICO. Have a great day!