According to Google's Year in Search 2024 list, Character.AI is the most frequently searched artificial intelligence (AI) service by Malaysian and global users. The Character.AI chatbot is used as a chat companion by lonely people and there have been several cases of users having unhealthy relationships with the virtual AI characters it produces.
Therefore, Character.AI today announced several new features that allow parents or guardians to control the use of their application for users under 18 years of age. They can also see which AI characters are used most frequently and the time spent. There are also notifications so that underage users do not spend too much time chatting with AI.
Finally, users will be reminded that the characters in the application are not real people and every conversation is just fiction and should not be taken seriously. Among the issues reported by Characted.AI users is a character who allegedly tells users to commit suicide or their parents because they feel dissatisfied. Two lawsuits have already been filed due to this issue.