Imagine a courtroom where justice is served, not by human wisdom, but by the whims of artificial intelligence. This is the chilling reality India’s legal system is now confronting, as a junior judge’s reliance on AI-generated fake orders has sparked a firestorm of controversy. But here’s where it gets even more unsettling: this isn’t an isolated incident. It’s part of a growing global trend where AI is quietly infiltrating—and potentially undermining—the very foundations of justice.
The Story Unfolds
Last August, in the southern Indian state of Andhra Pradesh, a junior civil judge adjudicated a property dispute. The defendants had objected to a court-ordered property survey, but the judge dismissed their concerns, citing four legal precedents. And this is the part most people miss: those precedents were entirely fabricated by AI. When the defendants appealed to the state’s high court, the truth emerged. The high court acknowledged the citations were fake but ruled the judge had acted in 'good faith' and upheld the decision, stating that incorrect citations alone weren’t grounds to overturn the ruling. The judge herself admitted she’d relied on an AI tool, believing the citations to be genuine, and had no intent to deceive.
The Supreme Court’s Fury
The defendants didn’t stop there. They took their case to India’s Supreme Court, which responded with outrage. Last Friday, the top court stayed the lower court’s order, labeling the use of AI-generated judgments not just an 'error in decision-making' but an act of 'misconduct.' The court emphasized the case was a matter of 'institutional concern,' not because of the ruling itself, but because it exposed vulnerabilities in the adjudicatory process. The Supreme Court has since issued notices to the Attorney General, Solicitor General, and the Bar Council of India, signaling a deeper investigation.
AI’s Double-Edged Sword
AI has revolutionized workplaces, streamlining tasks and boosting efficiency. Yet, generative AI systems are notorious for 'hallucinating'—fabricating facts and sources. This duality is at the heart of the debate. While AI can assist, its unchecked use poses grave risks, especially in fields like law, where accuracy and integrity are non-negotiable.
A Global Phenomenon
India isn’t alone in grappling with AI’s courtroom intrusion. In the U.S., two federal judges faced criticism in October for rulings tainted by AI-generated errors. In June 2025, the High Court of England and Wales warned lawyers against using AI-generated case material after fictitious rulings surfaced in multiple cases. These incidents underscore a pressing global challenge: how do we regulate AI in legal systems while preserving judicial integrity?
The Road Ahead
Last year, India’s Supreme Court released a white paper on AI in the judiciary, outlining best practices and guidelines for its use by judges, lawyers, and clerks. The court stressed the need for human oversight and robust institutional safeguards. But as AI evolves, so must our approach. Here’s the controversial question: Can we ever fully trust AI in matters of justice, or will it always be a tool that requires constant vigilance and human intervention?
Your Turn to Weigh In
What do you think? Is AI’s role in the courtroom a step toward efficiency, or a slippery slope toward injustice? Should judges and lawyers be banned from using AI tools altogether, or is there a middle ground? Share your thoughts in the comments—let’s spark a debate that could shape the future of justice.
