AI research and products that transform how we interact with technology. Leading foundational models powering ElevenAgents, @ElevenCreative, and ElevenAPI.
Joined January 2022
- Tweets1.9K
- Following11
- Followers211K
- Likes1.5K
Pinned Tweet
Today at ElevenLabs Summit NYC, we shared what we’re building next for agents. Here’s what we announced:
Fine-tuning: In the coming months, enterprises can work with our team to continually fine-tune our Text to Speech and Speech to Text models, as well as open-source LLMs, on their own data.
Interaction Engine: A new system that picks the right LLM for each moment of a conversation. It uses less expensive models for simple requests and frontier models for complex ones like refunds, so you get the right outcome without overspending on tokens.
Memory in ElevenAgents: Agents remember what gets mentioned in passing, so businesses can act on it.
Routines in ElevenAgents: Agents can now run operations before and after conversations, like pre-screening a mortgage applicant and calling them back, or texting about a confusing bill before it turns into a dispute.
ElevenAI: A new AI assistant for work that lets you dictate into any app, takes meeting notes, passes context between agents and people, and provides live assistance during calls.
“My ultimate goal is to have people stop pressing zero and yelling ‘human’ on the phone and instead say, ‘AI agent.’”
@ashleyekramer joined @MTSlive to talk about why people will soon prefer talking to an AI agent over waiting on hold.
ElevenAgents works for your customers. ElevenAI works for your team.
At ElevenLabs Summit we previewed a new AI assistant for work that lets you dictate into any app, takes meeting notes, passes context between agents and people, and provides live assistance during calls.
Open for early access today.
With Memory, agents can remember. Now they'll be able to follow through, too.
Routines in ElevenAgents handle the work before and after conversations, like pre-screening a mortgage applicant and calling back within minutes, or texting customers to explain a confusing bill before it turns into a dispute.
No one likes to repeat themselves. That’s why we’re bringing Memory to ElevenAgents.
Agents remember what gets mentioned in passing, so businesses can act on it.
At the ElevenLabs Summit, @mati previewed Interaction Engine, a new system that composes and orchestrates the models behind conversational agents.
It uses less expensive models for simple requests and frontier models for complex ones like refunds, so you get the right outcome without overspending on tokens.
Enterprises will soon be able to fine-tune the models behind their voice agents.
Every industry has its own context and language. In the coming months, enterprises can bring their own data and work with our team to fine-tune Text to Speech, Speech to Text, and open-source LLMs.
Each model can be tuned towards the outcomes you measure, such as customer satisfaction or reliability, and will keep improving with each interaction.
A great voice agent has to understand you, sound human, and respond fast.
In the last month, we launched three models: Scribe v3 for transcription accuracy, Eleven v4 for expressive speech, and Eleven Realtime for speed.
Scribe v3 Live is available in ElevenAgents today, and both models are available in ElevenAPI. Scribe v3 is also the default in the ElevenLabs app.
Learn more: elevenlabs.io/blog/scribe-v3
Scribe v3 has the best transcription and diarization (labeling who said what, when) accuracy of any model we tested.
Scribe v3 Live supports diarization for the first time and makes 43% fewer errors than its predecessor. Turn detection now uses the whole conversation rather than silence alone. A new key term library holds up to 10,000 terms, enough for a full legal or medical vocabulary, and Scribe v3 supports transcript edits in plain English.
In ElevenAgents, @Eneco’s voice agent captured Dutch postal codes correctly on the first try 40% more often.
Introducing Scribe v3 and Scribe v3 Live: our most accurate Speech to Text models yet.
Built for real-world audio, Scribe excels in situations with extreme background noise, knows pauses from the end of sentences, and keeps track of who said what in a busy meeting.
Campaigns run over phone calls and WhatsApp today, with email and SMS coming soon.
Learn more: elevenlabs.io/blog/elevenage…
With Campaign Manager, you set the rules for each campaign.
Choose the days and hours when your agent can reach out, and cap how many times it tries each person. And if someone asks not to be contacted, your agent stops and logs it.
2
7
2,604
Every campaign shows the whole funnel, from enrollment to outcome.
See how many contacts have hit the goal, how many haven’t been reached yet, and who needs your attention.
1
4
1,287
After each step, Campaign Manager decides what to do next.
Say you’re running a calling campaign. If someone doesn’t pick up, it tries again later. If they ask for a call back on Thursday at 4 pm, it calls back then. And if they give a different point of contact, it calls that person next.
Introducing ElevenAgents Campaign Manager, built to help the teams who run outbound campaigns achieve their outcomes.
Give it your contacts and a goal, like a qualified lead or a confirmed appointment. It follows up with each contact over time to get there, carrying context between every touch.
Andy Kelly, EVP of Global Brand Partnerships at @iHeartMedia, is coming to ElevenLabs Summit NYC on November 11.
He joins Dustin Myers of @FOXSports and Alex George for an ElevenProductions conversation on bringing AI content to audiences around the world.
Apply to join: elevenlabs.io/summit/new-yor…
ElevenAgents now integrates natively with @Genesys Cloud, @Amazon Connect, @Five9 and @NICELtd.
Bring the most natural voice agents into the call flows you already run.
On another platform? ElevenAgents connects over SIP to any phone system.
elevenlabs.io/blog/elevenage…
