The first rule of building with Ultravox: “It’s all prompting”.

Everything that your agents do is based on the prompt instructions you give them. It’s tempting then to write very complicated, verbose prompts. The problem with that approach is that the more instructions we provide in the prompt, the less well the model does at attending to the various instructions.