AI Hallucination: Fabricated Citations in Supreme Court, Lawyer Apologizes

• AI-generated legal submission with fabricated case laws submitted to the Indian Supreme Court.
• The lawyer for Gstaad Hotels, who filed the rejoinder, admitted the "mistake" and withdrew the response, citing embarrassment.
• The Supreme Court decided to hear the matter on its merits, emphasizing the gravity of the lapse despite the withdrawal.
• This incident is identified as an "AI hallucination," where AI confidently generates plausible but false content, echoing a prior Delhi High Court case.
• Legal experts consider this a breach of professional duty, stressing the need for stricter verification protocols for AI-drafted court submissions.

Why It Matters: AI's fabricated legal citations in court expose risks, demanding strict verification.