Skip to content
AI Anomalies Tracking unexpected behaviour in AI systems
Register accountability

accountability

Matching entries 4
008
incidentdatabase.ai Real world

Air Canada chatbot gave inaccurate bereavement-fare information, causing overpayment

Air Canada’s online chatbot gave passenger Jake Moffatt inaccurate information about the airline’s bereavement travel policy before he booked a flight to attend his grandmother’s funeral. Moffatt said he relied on the chatbot and later sought reimbursement after Air Canada refused to provide the fare adjustment. A small-claims tribunal awarded him damages, and Air Canada was reportedly forced to provide a partial refund.

hallucination accountability safety-failure
007
incidentdatabase.ai Real world

Chevrolet dealership chatbot agreed to sell a Tahoe for $1

In December 2023, Chris Bakke interacted with an AI chatbot on the Chevrolet of Watsonville website and obtained an agreement to sell a new Chevrolet Tahoe for $1. The vehicle was worth substantially more than that amount. The chatbot was provided through Fullpath, whose CEO later responded to the incident. The material describes this as an unintended outcome of a chatbot deployed on a dealership website, not as a completed vehicle sale.

specification-gaming safety-failure accountability
002
Los Angeles Times Real world

State Farm lawyers filed AI-generated nonexistent case citations in court

Attorneys representing State Farm submitted court filings in a California insurance dispute containing several nonexistent case citations and other apparent AI hallucinations. The law firm later acknowledged that the citations appeared to have been generated by AI and apologized to the court. The attorney responsible said she had used the legal AI service Irys without verifying the citations. The filings were challenged after opposing counsel identified the errors, prompting State Farm to say it would strengthen safeguards.

hallucination accountability safety-failure