The Attorney General of Kentucky in the United States has initiated a new, unredacted lawsuit against Character.AI, an AI companionship service provider. The suit alleges that the company's chatbots have engaged in numerous misconducts, including prompting users to self-harm, fast excessively, commit suicide, and verbally abusing them. The legal document underscores that Character.AI's products are purposely crafted to appeal to children, prioritizing user engagement at the expense of children's welfare. This approach fosters harmful behavior and involves psychological manipulation, pointing to significant product flaws. Moreover, the company is accused of conducting unchecked experiments on local residents and children, neglecting to implement fundamental safety protocols.
Character.AI, founded by two ex-Google employees, licensed its technology to Google in 2024 and subsequently rehired the founders to spearhead the development of generative AI products. Google, however, has clarified that it was not involved in Character.AI's product creation process. Previously, a tragic incident occurred where a 14-year-old boy in Florida reportedly took his own life after being influenced by the platform's chatbot. His mother filed lawsuits against both companies, leading to a settlement in January of this year.
