mistral-small-latest
Auto-routermistral/mistral-small-latest
Context
128K
Max output
128K
Input / 1M
$0.10
Output / 1M
$0.30
Cached / 1M
Free
Cutoff
01 Jan, 2025
About this model
Lightweight, fast, and proficient in over 80 programming languages.
Best suited for
- Fast, low-latency tasks, function calling, lightweight edge deployment, simple summarization, and high-volume customer service triage.
Built-in tools
Hosted by the gateway — enable them per request without wiring your own endpoint.
Capabilities
Vision
Accepts images alongside text in the same message.
Tools
Native function calling, so agents can invoke your endpoints.
System prompt
Honours a dedicated system role, separate from the user turn.
Supported parameters
creativity_levelControls the creativity of responses. Higher values (e.g., 0.7) increase creativity; lower values (e.g., 0.2) make responses more predictable.
max_tokensMax Tokens LimitSpecifies the maximum number of text units (tokens) allowed in a response, limiting its length.
probability_cutoffProbability Cutoff (Top P)Focuses on the most likely words based on a percentage of probability.
repetition_penaltyThe `frequency_penalty` controls how often the model repeats itself, with higher positive values reducing repetition and negative values encouraging it.
novelty_penaltyDiscourages responses that are too similar to previous ones.
stopThis parameter tells the model to stop generating text when it reaches any of the specified sequences (like a word or punctuation)
toolsLists tool definitions or capabilities available to the model.
tool_choiceDecides whether to use tools or just the model for generating responses.
response_typeDefines the format or type of the generated response.
parallel_tool_callsEnables parallel execution of tools, allowing multiple tools to run simultaneously.
streamSends the response in real-time as it's being generated.