ClareNow
Search
ClareNow
Toggle sidebar
AI ↑ Positive

Claude Voice Mode Gets an Upgrade, Now Powered by New Models

You can now tell Claude to work with connected tools with your voice.

CNET 3 min read 6/10
Claude Voice Mode Gets an Upgrade, Now Powered by New Models
Key Takeaways
  • Claude's voice mode now allows users to command the AI to interact with connected tools like web search, code execution, and file retrieval through speech.
  • The upgrade is powered by new, undisclosed Anthropic models—likely variants of Claude 3.5 Sonnet optimized for real-time voice and tool orchestration.
  • Voice-activated tool use reduces friction for accessibility users and hands-free scenarios, directly competing with ChatGPT's voice mode and Google's Gemini Live.
  • Anthropic's move builds on its March 2024 Claude 3 launch and subsequent model updates that improved reasoning, speed, and multi-step tool usage.
  • Enterprise and professional users can now trigger automations via voice commands, potentially increasing productivity in field work, healthcare, and remote collaboration.
Anthropic has quietly rolled out a significant upgrade to Claude's voice mode, now powered by new models that allow the AI assistant to respond to voice commands for interacting with connected tools. This means users can speak instructions to Claude—such as asking it to search the web, analyze data, or retrieve information from apps—without typing a single word. The update transforms Claude from a conversational chatbot into a hands-free productivity tool, placing it in direct competition with voice-enabled features from OpenAI's ChatGPT and Google's Gemini.

The upgrade leverages Anthropic's latest model improvements, likely including Claude 3.5 Sonnet or a specialized variant optimized for voice and real-time tool orchestration. While Claude already offered voice input and output, the new capability extends to tool-use actions—essentially letting Claude execute external functions just by hearing a command. For knowledge workers, developers, and accessibility users, this reduces friction and opens workflows previously limited to text-based prompts.

Anthropic has been refining Claude's architecture since the launch of Claude 3 in March 2024, with subsequent updates to speed, reasoning, and safety. The company introduced a voice mode in its mobile app earlier this year, but it was mostly for conversational Q&A. This upgrade marks a leap: your voice can now trigger Claude to run code, search the internet, or pull data from connected services like Google Drive or Slack.

The exact models powering this feature have not been disclosed, but Anthropic's model cards indicate that Claude 3.5 Sonnet excels at multi-step reasoning and tool usage—a natural fit for voice-activated workflows. The integration likely uses automatic speech recognition (ASR) with low latency, passed through a language model that interprets intent and invokes the appropriate tool via Anthropic's tool-use API. Industry analysts note that voice as a primary interface for AI agents is the next frontier, and Anthropic's move signals its intent to compete on both capability and user experience.

Broader implications are significant: enterprises that rely on Claude for automation can now add voice triggers, reducing dependency on screens and keyboards. That's a boon for field workers, medical professionals, and anyone multitasking. However, it also raises questions about security—since voice commands could be overheard or mimicked. Anthropic has not detailed authentication measures, but given its focus on safety, it is likely layered with device-level verification.

Looking ahead, this upgrade sets the stage for continuous voice interaction with AI agents that manage complex tasks. Expect Anthropic to refine contextual memory and tool chaining. Competitors will accelerate their own voice-plus-tool offerings. The milestone to watch is when Claude can complete end-to-end tasks—like booking a flight or generating a report—purely by voice. For now, this upgrade is a strong step toward that future.

Frequently Asked Questions

Claude voice mode is a feature of Anthropic's Claude AI assistant that allows users to speak questions and commands instead of typing. The latest upgrade enables voice commands to trigger connected tools like web search and data analysis.

With the upgrade, Claude can perform actions such as searching the internet, executing code, retrieving information from integrated apps, and more—all activated by voice. This expands Claude's role from conversational assistant to hands-free productivity tool.

Anthropic has not disclosed specific model names, but the upgrade is based on new models likely derived from Claude 3.5 Sonnet, optimized for low-latency speech recognition and multi-step tool reasoning.

Both support voice input and output. Claude's key differentiator is its ability to act on voice commands to use external tools (e.g., code execution, web search), while ChatGPT's voice mode focuses primarily on conversation without extensive third-party tool integration.

Yes, Claude voice mode is available through the Claude mobile app for iOS and Android. The new tool-use capabilities via voice are rolling out to users in supported regions.

Anthropic emphasizes safety and is expected to include device-level authentication. However, voice commands could be overheard, so enterprises should consider environment controls. Specific security details have not been fully disclosed.

Original source

www.cnet.com

Read original

Discussion

Join the discussion

Sign in to post a comment or reply.

No comments yet. Be the first to share your thoughts!

Sign in
Enter your email to receive a one-time sign-in code. No password needed.
Email address