ClareNow
Search
ClareNow
Toggle sidebar
AI ↓ Negative

Think Twice Before Using That Unsanctioned AI App at Work

So-called "shadow AI" can do more than cause headaches for your friends in IT.

CNET 3 min read 6/10
Think Twice Before Using That Unsanctioned AI App at Work
Key Takeaways
  • Shadow AI usage in workplaces surged 640% in 2024, with 75% of employees using at least one unsanctioned generative AI tool, per Cyberhaven.
  • Samsung banned internal ChatGPT use in May 2023 after employees inadvertently uploaded confidential source code to the public model.
  • Financial institutions like JPMorgan Chase have restricted AI tool access due to compliance risks under SEC and FINRA regulations.
  • The EU AI Act, effective in phases from 2025, requires organizations to document and govern all AI use, including shadow AI, or face fines up to 7% of global revenue.
  • Data leaked through shadow AI can permanently embed proprietary information into public AI training sets, making it irretrievable.
Your employees are running unsanctioned AI apps on company devices, and that could be a disaster waiting to happen. Shadow AI — the use of generative AI tools without IT approval — is surging in workplaces, creating unprecedented security, legal, and compliance risks that most organizations are ill-equipped to manage.

**WHO:** Employees across all sectors, enabled by the ease of access to tools like ChatGPT, Gemini, and Copilot. **WHAT:** The growing phenomenon known as 'shadow AI' — the use of generative AI tools without official IT approval or oversight. **WHERE:** Workplaces globally, with particular concentration in knowledge-intensive industries such as tech, finance, healthcare, and legal. **WHEN:** The trend has accelerated dramatically since the public launch of ChatGPT in late 2022, but is now reaching a tipping point as enterprises scramble to respond. **WHY IT MATTERS NOW:** Without controls, shadow AI can expose sensitive data, violate regulatory requirements, cause intellectual property leaks, and create legal liability — all while evading standard security monitoring.

**CONTEXT:** The 'shadow IT' problem is decades old — employees using unsanctioned software to get work done faster. But generative AI amplifies the risks exponentially. Unlike a rogue spreadsheet or messaging app, AI tools can ingest, process, and output company data in unpredictable ways. Data fed into a public AI model is often used for training, meaning proprietary information could become part of a model's public knowledge base. Regulatory bodies in the EU, US, and Asia are increasingly scrutinizing AI governance, and a single shadow AI incident can trigger investigations and fines.

**KEY DETAILS:** According to a 2024 report by Cyberhaven, the use of generative AI in the workplace grew by 640% in the past year, with over 75% of employees using at least one unsanctioned AI tool. Common examples include employees pasting confidential customer data into ChatGPT for summarization, using AI writing assistants to draft contracts, or employing code generators to build internal tools — all without review. CNET's report highlights that IT departments often discover shadow AI only after a breach or after data appears in external training sets. Named companies that have faced issues include Samsung, which banned ChatGPT after employees uploaded proprietary source code, and JPMorgan Chase, which restricted access due to compliance concerns.

**ANALYSIS:** 'Shadow AI is the new shadow IT, but on steroids,' says Dr. Lena Petrova, a cybersecurity researcher at MIT. 'The difference is that AI models are black boxes — once data goes in, you can't be sure where it ends up.' Experts argue that the root cause is not malicious intent but a lack of sanctioned alternatives. When employees need AI to boost productivity and the IT department hasn't provided approved tools, they will find their own. This creates a cat-and-mouse game where blocking one service leads to adoption of another.

**OUTLOOK:** Companies must move from outright bans to managed enablement. This means deploying enterprise-grade AI platforms with data privacy guarantees, training employees on safe use, and implementing monitoring tools that detect and flag unsanctioned AI activity. Regulators are also stepping in: the EU AI Act requires organizations to document AI use, and the US Executive Order on AI calls for risk management frameworks. Organizations that fail to address shadow AI now risk not only data breaches but also losing competitive advantage as AI becomes central to operations. Watch for increasing vendor offerings that provide 'AI firewall' capabilities and for regulatory actions that will set clearer boundaries.

Frequently Asked Questions

Shadow AI refers to the use of generative artificial intelligence tools and applications by employees without the explicit approval or knowledge of the IT department or management. This includes using public models like ChatGPT, Gemini, or Copilot for work-related tasks such as writing emails, summarizing documents, or generating code.

Shadow AI poses significant security risks because sensitive company data—such as customer information, financial records, or proprietary code—can be uploaded to public AI models. Once data enters these models, it may be used for training or retained, leading to data leaks, intellectual property theft, and compliance violations under regulations like GDPR or the EU AI Act.

A notable example is Samsung, which banned ChatGPT in 2023 after employees accidentally leaked confidential semiconductor data. Other cases include financial services firms where staff used AI chatbots to generate compliance-sensitive documents, and healthcare workers inputting patient data into unapproved AI tools, risking HIPAA breaches.

Companies can reduce shadow AI risks by deploying approved enterprise AI platforms with data privacy guarantees, creating clear usage policies, training employees on safe AI use, and implementing monitoring tools that detect unauthorized AI activity. A proactive 'managed enablement' approach is more effective than outright bans.

The EU AI Act requires organizations to document and govern AI systems, including shadow AI uses. In the US, the Executive Order on AI promotes risk management frameworks, and sector-specific regulators like the SEC and FINRA are issuing guidance on AI governance. Non-compliance can result in severe fines and legal liability.

Original source

www.cnet.com

Read original

Discussion

Join the discussion

Sign in to post a comment or reply.

No comments yet. Be the first to share your thoughts!

Sign in
Enter your email to receive a one-time sign-in code. No password needed.
Email address