Automatic model routing based on request characteristics.
LLM Gateway routes requests to the best providers that are able to handle your prompt size and parameters.
Automatic model routing based on request characteristics. You can access it through LLM Gateway's OpenAI-compatible API with automatic provider routing, fallback, and cost analytics.
Auto Route uses non-token pricing (for example per request, per second, or per page). The provider cards above show the exact current rates for each provider.
Auto Route is served by LLM Gateway through LLM Gateway. Requests are automatically routed to the best available provider, with fallback when a provider has issues.
Yes. Auto Route supports both tool (function) calling and structured JSON outputs through LLM Gateway.
Auto Route was released on January 1, 2024.