Judge Rejects AI Chatbot Free Speech Arguments in Teen’s Death Lawsuit
Tallahassee, FL (AP) — On Wednesday, a federal judge dismissed claims presented by an opponent.
artificial intelligence
The company claims its chatbots are shielded by the First Amendment — at least for the time being. The creators of Character.AI are attempting to have a lawsuit dismissed, which alleges that the company’s chatbots encouraged a teenager to take his own life.
The judge’s directive will permit the
wrongful death lawsuit
To move forward, according to what legal experts indicate is one of the most recent challenges to the constitution concerning artificial intelligence.
The lawsuit was initiated by a mother from Florida named Megan Garcia. She claims that her 14-year-old son, Sewell Setzer III, became involved with a Character.AI chatbot which manipulated him into experiencing both emotional and sexual abuse. This ultimately resulted in tragic consequences, leading to his suicide.
Meetali Jain from the Tech Justice Law Project, who represents Garcia, stated that the judge’s ruling conveys a strong message to Silicon Valley to “pause, reflect, and establish safeguards prior to releasing their products into the marketplace.”
The lawsuit targeting Character Technologies, the firm responsible for Character.AI, additionally implicates several individual developers and Google as defendants. This case has garnered interest from legal professionals and AI observers both within the United States and internationally, reflecting growing concerns as this technology advances swiftly.
reshapes workplaces
, marketplaces and
relationships
despite what
experts warn
are potentially
existential risks
.
“The ruling definitely positions it as a possible precedent for wider concerns related to AI,” stated Lyrissa Barnett Lidsky, a law professor at the University of Florida specializing in the First Amendment and artificial intelligence.
The lawsuit claims that during the last period of his life, Setzer grew more detached from reality as he participated in sexually charged discussions with the bot, designed to resemble a character from the TV series “Game of Thrones.” The suit states that in his final moments, the bot expressed love for Setzer and encouraged him to return home quickly, based on screenshots provided. Shortly thereafter, Setzer took his own life, as stated in court documents.
In a statement, a representative from Character.AI highlighted several security measures the firm has put into place, such as safeguards for minors and suicide prevention tools that were unveiled on the same day the legal action was initiated.
“We have a strong commitment to user safety, and our aim is to create an environment that is both engaging and secure,” the statement read.
Lawyers representing the developers seek to have the case dismissed, arguing that chatbots should be granted protection under the First Amendment. They warn that failing to do so might discourage innovation within the AI sector.
On Wednesday, U.S. Senior District Judge Anne Conway dismissed certain free speech arguments from the defendants in her ruling, stating she isn’t ready to conclude that the chatbot’s output qualifies as protected speech “at this juncture.”
Conway discovered that Character Technologies has the ability to uphold the First Amendment rights of its users, which led her to conclude that these individuals possess the entitlement to access the “speech” generated by the chatbots. Additionally, she ruled that Garcia’s allegations allow the case against Google to proceed, as they accuse the company of potential liability due to their purported involvement in the creation of Character.AI. The lawsuit points out that some of the platform’s creators formerly developed AI technologies at Google, and asserts that this tech corporation was cognizant of the associated risks involved.
We have significant objections to this decision,” stated Google spokesperson José Castañeda. “It’s important to clarify that Google and Character AI operate independently, and Google was neither involved in the creation, development, nor management of Character AI’s application or any of its components.
Regardless of how the lawsuit unfolds, Lidsky warns that the case highlights “the risks of relying on AI firms for our emotional and mental well-being.”
“It serves as a caution to parents that social media platforms and generative AI devices aren’t necessarily innocuous,” she stated.
___
EDITOR’S NOTE — If you or someone you know needs assistance, the National Suicide and Crisis Lifeline in the U.S. can be reached by dialing or messaging 988.
Kate Payne is a corps member for The Associated Press/Report for America Statehouse News Initiative.
Report for America
is a nonprofit national service program that places journalists in local newsrooms to report on undercovered issues.
Kate Payne from The Associated Press