Choose a model
Open an agent, open the Intelligence pill, and choose a model. The picker is served from Vocily’s live catalogue and lists the model’s provider and its per-minute rate - there are no marketing descriptors.
The list is ordered cheapest first. The model is used by the live voice pipeline and by the agent’s
browser and test experiences. Choices are validated server-side, so a model shown as coming soon
cannot be activated by editing the request or configuration directly.
Sarvam-105B is post-trained for real-time dialogue and voice-agent workloads, which makes it
a strong fit for Indian-language agents. The model catalogue changes as models ship; the picker in
your workspace is always the current list.
Tune response parameters
Temperature and Max Tokens live under the pill’s gear.Temperature
Temperature controls how much variation the model can use when producing a response. The slider runs from0 to 2 and starts new agents at 0.4.
- Lower values make the agent more focused and repeatable.
- Higher values allow more creative variation, but can make a tightly scripted agent less consistent.
Some models ignore temperature. A few models in the catalogue only accept their default
temperature and reject any other value, so changing the slider has no effect on them. If tone is
not responding to the setting, that is why - change the instructions in Response
Style instead, or pick a different model.
Max Tokens
Max Tokens sets the maximum response length for one model turn. It accepts64 to 4096 and
defaults to 256.
Keep this limit aligned with the channel:
- Phone agents usually work best with short replies and a modest limit.
- An agent that needs to explain several options may need a larger limit.
- A larger limit does not require the agent to use all of it; your prompt should still say how concise the response should be.
A practical starting point
- Start on the default - GPT-5.4 Nano, Temperature
0.4, Max Tokens256. - Make the response style in Agent Core explicit: keep phone replies short, ask one question at a time, and do not invent facts.
- Test the same path in Chat, Talk, or Call.
- Move up the list only when a tested flow needs more from the model - each step costs more per minute, and the rate is shown next to the model in the picker.
Backup model
Also under the gear: a backup model, used for the rest of the call if the main model’s provider stops responding.- It is from a different vendor. What fails is almost never one model - the vendor is unreachable, the key is rejected, the region is down - and every model behind that vendor fails with it. The picker only lists other vendors’ models.
- It latches, like the speech and voice backups. Once the agent switches to the backup, it stays there until the call ends, so a provider that is down costs one pause rather than one on every turn.
- The caller hears a pause, and nothing else. Nothing is torn down, so there is no announcement and no language reset - a language model call is a request and a response, not a live connection.
The request is rebuilt for the backup, not replayed. Models differ in what they accept -
response-length parameters, temperature, structured output - so Vocily reconstructs the call from
the backup model’s own specification. Where the backup cannot honour something the main model
could, the agent falls back to prose rather than failing the turn.
Save and verify
Select Save Changes after changing the model or parameters. Then test a representative path:- Ask a straightforward question to check latency and tone.
- Give the agent an ambiguous request to check whether it asks for clarification.
- If the agent has tools, test both a successful action and a failed action.