Mistral

Mistral AI implementation for @micdrop/server.

This package provides an AI agent implementation using Mistral AI’s API and a real-time speech-to-text implementation using Mistral’s Voxtral realtime transcription.

Installation

npm install @micdrop/mistral

Mistral Agent

Usage

import { MistralAgent } from '@micdrop/mistral'
import { MicdropServer } from '@micdrop/server'

const agent = new MistralAgent({
  apiKey: process.env.MISTRAL_API_KEY || '',
  model: 'mistral-large-latest',
  systemPrompt: 'You are a helpful assistant',
})

// Use with MicdropServer
new MicdropServer(socket, {
  agent,
  // ... other options
})

Options

Option	Type	Default	Description
`apiKey`	`string`	Required	Your Mistral AI API key
`model`	`string`	`'mistral-large-latest'`	Mistral AI model to use
`systemPrompt`	`string`	Required	System prompt for the agent
`maxRetry`	`number`	`3`	Maximum number of retries on API failures
`retryDelay`	`number`	`500`	Delay in milliseconds between retries
`maxSteps`	`number`	`5`	Maximum number of steps (for tool calls)
`autoEndCall`	`boolean \| string`	`false`	Auto-detect when user wants to end call
`autoSemanticTurn`	`boolean \| string`	`false`	Handle incomplete user sentences
`autoIgnoreUserNoise`	`boolean \| string`	`false`	Filter meaningless user sounds
`extract`	`ExtractJsonOptions` \| `ExtractTagOptions`	`undefined`	Extract structured data from responses
`onBeforeAnswer`	`function`	`undefined`	Hook called before answer generation - return `true` to skip generation
`settings`	`object`	`{}`	Additional Mistral AI API parameters

Available Models

Mistral AI offers several models you can choose from:

ministral-8b-latest - Fast and efficient 8B parameter model (default)
mistral-large-latest - Most capable model for complex tasks
mistral-small-latest - Balanced performance and cost
codestral-latest - Specialized for code generation

Settings Object

The settings parameter accepts any additional options from the Mistral AI Chat Completions API:

const agent = new MistralAgent({
  apiKey: process.env.MISTRAL_API_KEY || '',
  systemPrompt: 'You are a helpful assistant',
  settings: {
    temperature: 0.7, // Controls randomness (0-1)
    max_tokens: 1000, // Maximum tokens in response
    top_p: 0.9, // Nucleus sampling parameter
    random_seed: 42, // For reproducible outputs
    safe_prompt: false, // Enable/disable safety filtering
  },
})

Advanced Features

The Mistral Agent supports advanced features for improved conversation handling:

Auto End Call: Automatically detect when users want to end the conversation
Semantic Turn Detection: Handle incomplete sentences for natural flow
User Noise Filtering: Filter out meaningless sounds and filler words
Extract Value from Answer: Extract structured data from responses
Tools: Add custom tools to the agent

Mistral STT (Speech-to-Text)

Real-time transcription using Mistral’s Voxtral realtime models.

Usage

import { MistralSTT } from '@micdrop/mistral'
import { MicdropServer } from '@micdrop/server'

const stt = new MistralSTT({
  apiKey: process.env.MISTRAL_API_KEY || '',
})

// Use with MicdropServer
new MicdropServer(socket, {
  stt,
  // ... other options
})

Options

Option	Type	Default	Description
`apiKey`	`string`	Required	Your Mistral AI API key
`model`	`string`	`'voxtral-mini-transcribe-realtime-2602'`	Realtime transcription model to use
`encoding`	`MistralAudioEncoding`	`'pcm_s16le'`	Audio encoding of the incoming stream
`targetStreamingDelayMs`	`number`	Optional	Target streaming delay in milliseconds
`connectionTimeout`	`number`	`5000`	Timeout in milliseconds for WebSocket connection
`transcriptionTimeout`	`number`	`4000`	Timeout in milliseconds to wait for transcription
`retryDelay`	`number`	`1000`	Delay in milliseconds between reconnection attempts
`maxRetry`	`number`	`3`	Maximum number of reconnection attempts before failing

The Micdrop client streams 16kHz PCM16 mono audio, which matches Voxtral’s default input format, so no resampling is required.