Overview

The Phone agent mode allows you to configure your Agent to be a phone calling maestro! You can set up your Agent to perform outbound calls, where it leverages your Agent’s configured Tools in real-time during the call.

How do I change my Agent to the Phone agent mode?

You can create a new Phone Agent, or convert your normal Agent to a Phone Agent. To convert your normal Agent to a Phone Agent, follow these steps.
  1. Open your Agent, and click ‘Advanced’ to head to your Advanced Settings
  2. Then, click ‘Phone Call’ on the Agent mode dropdown
  3. Then, head to the new ‘Phone Mode’ section in the sidebar to configure your Settings
In order for your Agent to work, it’ll need to be part of a multi-agent system, where a Parent agent will send it info such as a number to call, info about the customer they’re calling, etc. We recommend using a Workforce to do this.

Phone Agent settings

Greeting

First message mode

You can configure how the agent behaves at the start of the call. The options to choose from are:
  • Agent speaks first with a message generated by the model
  • Agent speaks first with a message generated by you
  • Agent waits for the user to speak first

First message

Set the first thing your Agent says to start the conversation.

First message interruptions

You can toggle this on to allow the user to interrupt the agent’s first message

Outbound phone number

You can select a phone number provider and configure your outbound phone number. There are three options available:

Provided by Relevance

You can pick a phone number provided by Relevance AI.

Twilio

If you have integrated Twilio in ‘Integrations & App Keys’, you can select a Twilio phone number.

Based on country code

Your Phone Agent will automatically select the appropriate phone number based on the country code of the number it is calling. Configure mappings for specific countries, and set a default fallback for all other numbers.

Voice and transcription

Voice provider

Pick the service powering your Agent’s voice on calls. We support ElevenLabs only currently.

Voice model

Select the voice model your Agent will use when speaking

Agent voice

Select the voice your Agent will use when speaking

Voice speed

Adjust the speaking speed of the agent’s voice

Background sound

Add a background sound to the call

Transcriber provider

Select the service for speech recognition. We support Deepgram only currently.

Transcriber model

Select the model for speech recognition

Transcriber language

Select the language for speech recognition

Background denoising

Enable background noise reduction while the user is speaking

Built-in tools

End call

Allow the agent to end the call when appropriate

Call Timeout

Silence timeout (seconds)

Number of seconds of silence before ending the call (max 3600 seconds)

Voicemail

Voicemail detection

Enable the agent to detect and respond to voicemail and set the message it will say when it detects voicemail

Recording

Audio recording

Enable recording of the phone call

Summary

Summary prompt

Enable automatic generation of call summaries and customize the prompt used to generate call summaries

Follow along on YouTube

In this video, our Product Manager, Josh Jackson, will show you how to create your own Voice Agent in Relevance AI.