Breaking
Lindsey Graham’s Sudden Death Sparks Questions About Cardiac Arrest ◆ Tricking AI By Simply Switching Which Spoken Language You Use In Your Prompts ◆ Today's NYT Strands Hints, Answers and Help for July 12 #861 ◆ Obamacare Premium Increases Raise Questions About Affordability And ‘Death Spiral’ ◆ OpenAI’s GPT-5.6 Lands With Work Agents And A Desktop Pivot ◆ OpenAI Intros GPT-Live Models: What Does That Mean? ◆ Why A Record-Hot Ocean Is Supercharging The El Niño Effect ◆ OpenAI And Anthropic Are Preparing For IPOs—Here’s How They Stack Up ◆ Capping Annual Medicare Beneficiary Out-Of-Pocket Costs At $5,000 ◆ How Air Pollution Impacts Other Aspects Of Human Health, Not Just Lungs ◆ Central Banks Are Joining The AI Bubble Debate ◆ Building Clinical Software For A World That Changes Faster Than Code ◆
Dark mode
Light mode
ClareNow
Search
ClareNow
Toggle sidebar
AI ↓ Negative

Meta Pulls Instagram AI Update After Everyone Said They Didn't Want to Be Deepfaked

"We've heard the feedback that this feature missed the mark," Meta wrote in a blog post.

CNET 1 min read 6/10 Menlo Park
Meta Pulls Instagram AI Update After Everyone Said They Didn't Want to Be Deepfaked
Key Takeaways
  • Meta disabled the Instagram AI update within 48 hours of its rollout after users and privacy advocates condemned it as a deepfake generator that could be used for harassment and misinformation.
  • The feature allowed users to upload a selfie and generate AI videos of themselves in predefined scenarios, like dancing or reacting to prompts, without requiring permission from individuals whose faces could be cloned.
  • Over 10,000 users signed a public petition on Change.org within 24 hours calling the update 'a dangerous step toward normalized AI impersonation,' according to online records.
  • Meta's blog post acknowledged the feedback, with a spokesperson confirming that the company would 're-evaluate the feature's consent mechanisms and safety controls' before any potential re-release.
  • The backlash comes amid broader regulatory scrutiny in the U.S. and EU, where lawmakers are drafting bills that would require explicit consent for any AI-generated content using a person's likeness.
  • Internal research at Meta had flagged potential risks of the feature leading to non-consensual deepfake videos, but the company proceeded with a limited test in select countries, including the U.S. and Australia.
Meta pulled its Instagram AI update after users erupted in outrage over the feature's ability to generate deepfake-style videos without explicit consent. The update, which allowed users to create AI-generated videos of themselves in various scenarios, was intended to boost engagement but instead sparked a firestorm of criticism over privacy, consent, and the potential for misuse. Meta acknowledged the backlash in a blog post, stating, 'We've heard the feedback that this feature missed the mark.' The company has since disabled the tool indefinitely, marking a rare public retreat for a tech giant that has aggressively invested in generative AI. The incident highlights the growing tension between innovation and ethical responsibility, as regulators and consumers increasingly demand guardrails around AI-generated content. Experts warn that Meta's misstep could set a precedent for how social platforms approach AI features, particularly those that manipulate personal likenesses. With no timeline for a revised rollout, the episode underscores the challenges of deploying AI in sensitive social contexts where trust is fragile. As Meta continues to push its AI ambitions, the Instagram debacle serves as a cautionary tale about the risks of moving too fast without adequate safeguards.

"We've heard the feedback that this feature missed the mark."

"This is a dangerous step toward normalized AI impersonation. Meta should be ashamed for even testing it."

"If Meta cannot distinguish between a fun filter and a tool for harassment, it has no business releasing AI features."

Frequently Asked Questions

Meta pulled the Instagram AI update after widespread backlash from users who said the feature enabled non-consensual deepfake videos. Critics argued it could be used for harassment, misinformation, and identity theft. Meta acknowledged the feedback in a blog post and disabled the tool indefinitely.

The update allowed users to upload a selfie and generate AI-created videos of themselves performing various actions, such as dancing or reacting to prompts. It used generative AI to animate the face onto pre-recorded clips, raising concerns about consent and misuse without proper safeguards.

Users reacted with outrage, with over 10,000 signing a Change.org petition within 24 hours calling the feature dangerous. Privacy advocates, lawmakers, and AI ethics researchers condemned it as a step toward normalizing AI impersonation, prompting Meta to halt the rollout.

Risks include non-consensual creation of deepfake content, potential for harassment and defamation, erosion of trust in video evidence, and challenges for law enforcement and content moderation. Without strong consent and watermarking tools, such features can be easily weaponized.

Meta has not announced a timeline for a revised release. The company stated it will re-evaluate the feature's consent mechanisms and safety controls. Future versions may require explicit permission from all identifiable individuals and include better AI-detection labels.

Topics

Meta Instagram AI update deepfake backlash privacy concerns generative AI social media regulation consent technology

Original source

www.cnet.com

Read original

Discussion

Join the discussion

Sign in to post a comment or reply.

No comments yet. Be the first to share your thoughts!

Sign in
Enter your email to receive a one-time sign-in code. No password needed.
Email address