2 min read

Meta will alert parents over teen suicide chats

Meta says teens who discuss suicide or self-harm with Meta AI will trigger parent alerts through Instagram supervision controls.

Image: Mashable

Meta says conversations in which teens mention suicide or self-harm to Meta AI will now trigger a parental notification, expanding the company’s existing teen safety controls. The alerts will only go to parents who use Instagram supervision controls.

According to a Thursday blog post, Meta worked with parents and experts to decide which conversations should prompt an alert, including cases where a teen makes a clear reference to hurting themselves, even if the wording is subtle. Meta AI already surfaces crisis helplines and encourages teens to contact a trusted adult. Under the new system, those chats can also lead to a parent alert.

Meta said it will err on the side of caution for now. Potentially concerning chats are first flagged by AI, then manually reviewed before an alert is sent. Parents will also receive expert-developed guidance on how to talk with their child about suicide and self-harm. Notifications arrive through the app plus a separate email, text, or WhatsApp message, depending on the contact details on file.

Meta said the alerts will be available to parents in the U.S., United Kingdom, Canada, and Australia, with global access planned by the end of the year. In February, the company introduced a similar notification feature for Instagram.

It also announced a new limited content setting for Meta AI, extending a feature first launched on Instagram last year. Meta said this enables its strictest filters, making the model more likely to identify problematic prompts and refuse a wider range of requests. The company says Meta AI is already trained not to engage in sexual or romantic conversations with teens or provide alcoholic drink recipes.

Recommended reading

Data brokers can still profile you offline

The move comes amid continued criticism from child safety advocates. In April, Meta added parental controls that show broad categories of a teen’s Meta AI conversations, including school, entertainment, writing, health, and wellbeing. Josh Golin, executive director of Fairplay, said that approach still puts too much of the burden on caregivers instead of creating a safer product from the start.

Meta is also facing ongoing legal pressure over child safety. Earlier this year, the company lost two separate landmark trials tied to child safety protections and claims that its products use addictive design. Meta said it will appeal both verdicts, while hundreds of pending lawsuits alleging child harm have yet to be tried.

Sophia Reynolds

Security Editor

Sophia unpacks the invisible wars happening on our networks. Covering cybersecurity, privacy legislation, and cryptography, she exposes how our data is weaponized and defended. Before joining for(geeks), she spent years as a penetration tester. She's the reason the rest of the team uses physical security keys.

via Mashable

// Keep reading