With Perplexity's Push for Hybrid AI, Your Laptop Could Function as a Data Center
Perplexity is shifting how some sensitive AI data is stored, balancing processing between local silicon and cloud servers.
- Perplexity’s hybrid AI model runs sensitive queries locally on laptops using Apple Neural Engine, Qualcomm Snapdragon X, or Intel Core Ultra processors, with non-sensitive requests still processed in the cloud.
- The company says on-device inference can deliver responses in under two seconds for many common tasks, matching cloud latency for less complex queries.
- This move aligns with the EU AI Act and GDPR requirements, reducing data transfer risks and potentially lowering legal compliance costs for enterprises using Perplexity.
- Perplexity will open-source its hybrid inference toolkit by Q3 2025, allowing third-party developers to integrate local-cloud splitting into their own apps.
- The hybrid AI initiative follows a $500 million funding round in early 2025, valuing Perplexity at over $3 billion and giving it resources to compete with Google and OpenAI on privacy features.
Frequently Asked Questions
Hybrid AI is an approach that splits artificial intelligence processing between local hardware (such as a laptop's CPU or neural engine) and cloud servers. Queries that contain sensitive or private data are handled on-device, while less sensitive requests can be processed in the cloud for speed and scale.
Perplexity's hybrid AI analyzes each user query in real time. If the query involves personal or confidential data, it is processed on the user's laptop using built-in AI accelerators. Non-sensitive queries are sent to Perplexity's cloud servers. The system dynamically chooses the best path to balance privacy, latency, and accuracy.
Perplexity aims to address growing privacy concerns and regulatory requirements like GDPR and the EU AI Act. By keeping sensitive data on-device, the company reduces the risk of data breaches and simplifies compliance. Local processing also reduces cloud costs and can improve response times for simple queries.
On-device AI keeps user data local, strengthening privacy and security. It reduces dependence on internet connectivity, lowers cloud computing costs, and can provide faster response times for common tasks. It also helps companies comply with data residency laws that restrict cross-border data transfers.
Perplexity claims that hybrid AI improves security by not transmitting sensitive data over the internet. However, security experts note that on-device models can still be vulnerable to malware that extracts data from local memory. Overall, the approach reduces the attack surface compared to full cloud processing.
Hybrid AI significantly enhances user privacy because personal queries never leave the device. This minimizes exposure to cloud leaks, third-party data sharing, or government requests for cloud-stored data. However, the local model itself must be secured to prevent extraction attacks.
Topics
Original source
www.cnet.com
Discussion
Join the discussion
Sign in to post a comment or reply.
No comments yet. Be the first to share your thoughts!