ElevenLabs Pushes Beyond Voice Into Enterprise AI Workflows

ElevenLabs announced on November 11 that businesses will be able to fine-tune selected open-source language models and its voice models using data from live deployments. The announcement, made at the company's New York Summit, pairs the customization program with a new ElevenAI workplace app and a partner program covering more than 550 partners across 44 countries.

The move extends ElevenLabs beyond voice generation and transcription into software for managing customer conversations and employee work. For HR and workplace-technology leaders, the most immediate item is ElevenAI, a meeting app that listens to spoken conversations, including in-person meetings, and produces notes, summaries and action items. Free early access opened with the announcement.

What did the CEO say about enterprise ambitions?

CEO Mati Staniszewski framed the products as a broader enterprise deployment push. Conversational agents would become "critical infrastructure for every enterprise, as essential as cloud or payments" within a few years, he said.

That claim sets a high bar, and the execution challenge is twofold: moving previewed and early-access products into broader production use, and progressing Marketplace browsing to purchases through existing ElevenLabs commitments, planned to start in 2027.

How will model customization work?

The customization program begins in the coming months. Businesses will work with ElevenLabs researchers to tune models for their own customers and operating context, selecting optimization metrics such as customer satisfaction or reliability. Because the data comes from live deployments, companies can keep refining models as interactions accumulate rather than relying only on a general industry model.

ElevenLabs already applies the domain-specific approach through Scribe v3 Medical, a healthcare transcription model built to recognize specialized terminology. Staniszewski said a domain-optimized financial-services model is also in development.

A previewed Interaction Engine addresses conversation routing. It manages turn-taking and interruptions and can assign different language models to different parts of an exchange — a cheaper model for triage, a frontier model for complex tasks. The design keeps routine exchanges from requiring a frontier model at every step and is intended to limit token use.

What do Memory, Routines and ElevenAI do?

ElevenAgents, the platform for deploying voice and chat agents, will add two forthcoming features:

• Memory will recognize returning authenticated customers and distill each conversation into a structured record of preferences, constraints and future occasions, while leaving the CRM system as the primary customer record. A customer who prefers Spanish and can only talk after 5 p.m. would not need to repeat those details on the next call.
• Routines is designed to automate multi-step work before, during and after conversations, connecting with existing tools and systems. Examples include pre-screening a mortgage applicant and calling back within minutes, reminding patients about visits and offering canceled slots to waitlisted patients, emailing reports, writing to a CRM or initiating calls.

For employees, ElevenAI can also provide live assistance and pass context between people and agents. ElevenLabs says the app takes meeting notes with participants' consent and includes notice and consent mechanisms — the compliance detail HR teams will scrutinize before any rollout. Dictation and meeting notes use Scribe v3, the company's recorded-audio transcription model covering 102 languages; the separate Scribe v3 Live variant handles low-latency, real-time audio.

How deep do the partner and infrastructure ties run?

The partner roster includes Google Cloud, IBM, Deloitte, DXC and Genesys. The new Partner Program lets consultancies, systems integrators, software vendors and agencies integrate ElevenAgents into enterprise technology stacks or work with ElevenLabs' forward-deployed engineers on complex deployments. An alliance with McKinsey and QuantumBlack, AI by McKinsey, pairs the platform with McKinsey's enterprise-transformation work.

The accompanying Marketplace initially offers a curated catalog of partner-built applications for healthcare, financial services, insurance, education and retail. On infrastructure, NVIDIA's Nemotron 3.5 Super VL is available in ElevenAgents, and ElevenLabs plans to add 15 MW of NVIDIA Vera Rubin compute capacity on top of existing Blackwell Ultra systems, aimed at large deployments with security or data-residency requirements.

The companies also disclosed an on-premises voice agent for Centralna e-Rejestracja, the central appointment system in Poland's national e-Health platform, with EasyCall supporting delivery. The agent calls patients who only have landlines to remind them about appointments and help them reschedule. The central system handles 40 million appointments annually and has no-show rates of 10% to 20%, according to ElevenLabs; the deployment uses NVIDIA Confidential Computing to keep citizen data and audio within government infrastructure.

What should employers watch next?

The strategy now depends on more than model performance. Tuning and Memory draw on data accumulated in live use, Routines connects conversations to business systems, and the partner program and Marketplace create routes into enterprises. Whether purchases through existing commitments actually begin in 2027 will be the clearest test of adoption.