Safety

Meta will notify parents when teens mention self-harm to its chatbot

Meta says it will inform parents if their teenage children discuss suicide or self-harm with the company's chatbot, and is developing a system to alert emergency services in serious cases.

Meta will notify parents when teens mention self-harm to its chatbot

Meta has announced that it will inform parents when their teenage children discuss suicide or self-harm in conversations with the company’s chatbot, according to a report by TechCrunch that summarizes the company’s disclosure.

Meta also said it is working on the capability to notify emergency services in situations that indicate serious risk.

Why this matters

AI companies have faced heightened scrutiny after several incidents in which chatbots reportedly handled conversations with troubled young people poorly. In some cases, parents have even filed lawsuits — for example, some parents have sued OpenAI alleging ChatGPT had a role in their child’s suicide. Those controversies have increased pressure on AI providers to implement safety and alerting mechanisms.

How Meta’s system works

Meta says its new AI system can detect references to self-harm or suicide within conversations. To avoid false alarms, any detected conversation will be reviewed by a human before a notification is sent to parents. However, if the risk is unclear, Meta has said it will err on the side of caution and still send a warning.

Availability and timeline

The safety feature will be rolled out first in the United States, Australia and several other regions. It is not yet available in Hungary, but Meta intends to enable the feature globally by the end of the year.

Practical implications

Meta’s approach aims to accelerate help for at-risk teenagers and reduce harm arising from interactions with AI chatbots. The system combines automated detection with human review and plans for emergency-service notification in high-risk cases.