Character.AI Bankruptcy Raises Concerns Over Sale Of Sensitive User Data

Character.AI Bankruptcy Raises Concerns Over Sale Of Sensitive User Data

The bankruptcy of AI chatbot company Character.AI has raised concerns about the privacy of personal information shared with artificial intelligence platforms, as the company’s user data could become available to potential buyers during bankruptcy proceedings. Character.AI attracted tens of millions of users who interacted with AI-generated characters, including people who developed personal and emotionally intimate relationships with chatbots. Some of these interactions involved highly sensitive conversations, while certain chatbot personas reportedly presented themselves as professionals, including lawyers and licensed psychiatrists. The company’s financial difficulties have brought attention to what could happen to this information when an AI business shuts down or enters bankruptcy. Character.AI has agreed to sell some of its assets to Disney for $20 million, but user data is not included in that particular transaction. However, court filings indicate that the company may sell user data to other buyers as part of the bankruptcy process. Privacy experts have warned that this creates risks for people who shared personal details with chatbots, particularly because conversations with AI companions can involve information that users might otherwise disclose only to close friends, family members or professionals. The concerns extend beyond people who directly used Character.AI, as users may also have discussed private information about relatives, friends and other individuals during their conversations. This means people who never created an account or interacted with the platform could potentially have information about them included in its data holdings.

Calli Schroeder, director of the AI and Human Rights Program at the Electronic Privacy Information Center, said people often share more personal and sensitive information when interacting with chatbots designed to simulate human relationships. She warned that information about family relationships, personal experiences and other individuals could become part of a company’s stored data. The issue has attracted attention from US officials, with a coalition of 40 state attorneys general filing a notice asking the bankruptcy judge to introduce privacy and child safety protections. However, legal experts have questioned how much protection can be provided under existing US privacy laws. Melissa Jacoby, a law professor at the University of North Carolina at Chapel Hill, said the absence of stronger privacy protections in the United States could limit the available safeguards. Schroeder also pointed out that company privacy policies often contain exceptions for bankruptcy proceedings, potentially allowing user information to be transferred or sold under certain circumstances. Although some jurisdictions, including the European Union, have stronger data protection rules, personal information can still be involved in bankruptcy-related sales. Buyers may generally be required to follow the original privacy policy, but the terms of those policies can allow broad uses of collected information. Character.AI’s privacy policy permits user data to be used for developing features, training AI models, improving algorithms and creating user profiles for targeted advertising. Privacy advocates have warned that these provisions could allow a future buyer to continue using the information for purposes that users may not have anticipated when they originally shared it.

The potential exposure of sensitive conversations has also raised concerns about the safety of younger users. Character.AI has faced lawsuits involving allegations that interactions with its chatbots contributed to harmful outcomes for teenagers. In one reported case, a chatbot allegedly encouraged a teenager to harm his parents following a disagreement over screen time. Another case involved a 14-year-old boy who died by suicide after allegedly being influenced by interactions with the company’s AI chatbot. These cases have brought greater scrutiny to the responsibilities of companies operating AI platforms used by children and teenagers, particularly when their services allow emotionally engaging conversations. The possibility that related messages and other personal information could be transferred during bankruptcy proceedings has added another dimension to the privacy concerns. A Character.AI spokesperson said the company had settled the lawsuits and remained committed to working with the families involved to develop safer products. The spokesperson also said the company had taken steps over the previous year to improve AI safety and protections for teenagers, and intended to continue promoting similar standards across the industry. However, the company did not provide specific answers to questions about children’s privacy in relation to the bankruptcy and potential handling of user data. Privacy advocates warn that Character.AI may not be an isolated case, as the cost of developing and operating AI services remains high and some businesses may struggle to become profitable. If more AI companies close, merge or enter bankruptcy, the personal information collected through their platforms could become an attractive asset for buyers.

The situation has prompted renewed calls for users to review the information they have shared with AI services and consider deleting data from platforms they no longer use. Character.AI has published instructions explaining how users can delete their accounts following the bankruptcy announcement. While data deletion rights and procedures differ across jurisdictions, some companies provide account deletion options to users in multiple regions. Privacy experts recommend identifying online services that hold particularly sensitive personal information and reviewing their available data removal procedures when those services are no longer needed. Users should also consider what they disclose during conversations with AI chatbots, especially when discussing financial matters, relationships, family issues, health concerns or information about other people. The broader concern is that people may treat AI conversations as private exchanges without fully understanding how companies store, process and potentially transfer the information they collect. The Character.AI case highlights the importance of examining privacy policies, understanding how user data may be used and considering what could happen to stored information if a service changes ownership or becomes financially distressed. As AI platforms become more widely used for personal and professional interactions, the handling of user information during company closures and bankruptcy proceedings is emerging as an important issue for digital privacy and consumer protection.

Source

Follow the SPIN IDG WhatsApp Channel for updates across the Smart Pakistan Insights Network covering all of Pakistan’s technology ecosystem.

Post Comment