LLM Providers for a Voice Agent
The LLM writes the answers of the call. Micdrop wraps it in an
agent, which keeps the conversation, runs the tools and decides when
the call ends. It is passed to the server as agent.
- AI SDK, any model of the Vercel AI SDK, such as Claude, Gemini, Grok, Llama on Groq or a local model on Ollama
- OpenAI, GPT models through the Responses API
- Gemini, Gemini Flash models through the Interactions API
- Mistral, Mistral models through Mistral AI’s API
Hosted and open weight language models differ in tool call accuracy, delay before the first word and price. The local LLM guide runs the agent on your own machine with Ollama.
Your own
Any other model plugs in by extending the Agent class, and
FallbackAgent switches to another provider when one fails.