Models / Open weights
Power reasoning, tool use, and long-running agent workloads through OpenAI- and Anthropic-compatible APIs.
01 / Model catalog
Access models from the top open-source labs through a single, unified Inference API. Pay only for the tokens you use.
Gemma 4 31B
gemma-4-31b
Google's 31B open model, served at BF16 precision for vision, coding, and tool use with a 32K-token context window.
Input
$0.30
/ M tokens
Cache read
$0.15
/ M tokens
Output
$0.40
/ M tokens
Context
32K
tokens
Max output
8K
tokens
Serving
Serverless
Pay per token
02 / Production workloads
Prism serves open-weight models through one reliable inference API built for long tool traces, large context windows, and production-scale agent workloads.
Speculative decoding and batching shaped around code generation, not general chat.
Batched serving across a GPU fleet so a customer agent can stay in a tight loop.
Redundant serving paths keep inference available when individual workers or GPUs go offline.
03 / Deploy