This model offers four times the context length of gpt-3.5-turbo, allowing it to support approximately 20 pages of text in a single request at a higher cost. Training data: up to Sep 2021.
Modalities
In / Out Price
$3 / $4per 1M
Context
16K
Released
Aug 28, 2023
Knowledge Cutoff
Sep 2021
Different companies host the same model. OpenRouter routes your request to one of them based on the routing mode you pick — Balanced (price + speed), Nitro (fastest), or Exacto (highest tool-calling accuracy).
The average price customers actually pay for this model, next to the prices providers post. Caching and discounts mean the price actually paid is often well below the listed one.
Throughput is how fast the model writes (tokens per second — higher is better). Latency is total round-trip time (lower is better). TTFT is time-to-first-token — how long before you see anything appear (lower is better).
Uptime is the percentage of the past 3 days that at least one provider was responding to requests. Availability is the percentage of time that inference was successfully served. OpenRouter continuously monitors and uses the next-best provider when one returns an error.
Public apps that send the most traffic to this model. Good signal for what real production workloads look like — and a hint at which use cases this model is best suited for.
Token volume and request traffic to this model over time.
Drop-in code to call this model. OpenRouter's API is OpenAI-compatible — most SDKs work by just swapping the base URL. The only thing that changes between models is the model slug below.
This model offers four times the context length of gpt-3.5-turbo, allowing it to support approximately 20 pages of text in a single request at a higher cost. Training data: up to Sep 2021.
GPT-3.5 Turbo 16k costs $3.00/M input tokens and $4.00/M output tokens.
GPT-3.5 Turbo 16k has a 16,385 token context window. It supports up to 4,096 completion tokens.
Yes. GPT-3.5 Turbo 16k accepts tools and tool_choice for function calling. It also supports structured outputs via a JSON schema in response_format.
GPT-3.5 Turbo 16k is served by 2 providers on OpenRouter: OpenAI and Azure. Requests are routed to the best available provider, with automatic failover to the others, and you can pin or exclude providers with provider routing.
GPT-3.5 Turbo 16k was released on August 28, 2023. Its knowledge cutoff is September 30, 2021.
| $3.00 | $4.00 | 0.77s | 6 tps | ||
| $3.00 | $4.00 | 0.42s | 7 tps |
Throughput
7tok/s
P50, best across providers
Latency
0.41s
P50, best provider
100.00%
100.00%
When an error occurs in an upstream provider, we can recover by routing to another healthy provider, if your request filters allow it. You can access per-provider uptime data programmatically through the Endpoints API. Learn more about our load balancing and customization options.
