Meta Adds Support and Parental Notification for AI Chats About Self-Harm
Amid a period of intense scrutiny over safety, Meta is beefing up its options for parental supervision and notification of their child's online activities.
- Meta AI chatbot now detects self-harm, suicide, and eating disorder discussions in conversations with teens, triggering parental alerts.
- Parental notifications sent via the Family Center — parents see a summary of the concern, not the full chat content.
- Feature uses Crisis Text Line-trained machine learning models, tested with clinical psychologists for accuracy.
- Over 20 US states have filed lawsuits accusing Meta of knowingly harming teen mental health — this feature aims to address some of those concerns.
- Rollout begins in the US in August 2025, with international expansion planned by Q2 2026.
"Our goal is to give parents better visibility while ensuring teens still have private, supportive conversations when they need help."
"We built this in partnership with mental health experts to balance safety and privacy."
"We are cautiously optimistic, but alert fatigue and potential teen distrust remain serious risks."
Frequently Asked Questions
Meta uses machine learning models trained on crisis intervention data from organizations like Crisis Text Line. The AI analyzes message content for keywords and patterns related to suicide, self-harm, and eating disorders. When a likely risk is detected, the system flags the conversation for parental notification.
Parents receive a notification via the Family Center that their teen may have been involved in a conversation about self-harm or distressing topics. They do not see the actual message content—only a general alert that a concerning discussion occurred. This is designed to balance teen privacy with safety.
Meta faces intense scrutiny from lawmakers, regulators, and lawsuits alleging its platforms harm teen mental health. The feature is part of broader efforts to improve child safety online and respond to demands for more proactive oversight, especially after Mark Zuckerberg's Senate testimony and multiple state lawsuits.
No system is perfect. Meta says the AI is designed to minimize false positives and false negatives but acknowledges edge cases. The tool is continuously improved with feedback from mental health experts. It currently only works in English and for users in the initial rollout countries.
Meta claims privacy is a priority. The AI scans messages in real time but only sends a generic alert to parents—not the chat text. Teens are not notified that their conversation was flagged. Some critics argue this could deter teens from seeking help, while others say the safety benefit outweighs privacy concerns.
The feature launched in the United States in August 2025. Meta plans to expand to other English-speaking countries by early 2026, with broader international coverage expected by mid-2026. Users must have their Family Center linked and supervision enabled.
Topics
Original source
www.cnet.com
Discussion
Join the discussion
Sign in to post a comment or reply.
No comments yet. Be the first to share your thoughts!