Vercel AI Gateway

Vercel's AI Gateway is a hosted routing layer that Vercel announced as generally available, "providing a single unified API to access hundreds of AI models with transparent pricing and built-in observability". One API key covers text, image, video, speech and embeddings across providers, with automatic retries to another provider when one fails, spend monitoring, and "No markup on tokens. Tokens cost the same as they would from the provider directly, with zero markup, including with Bring Your Own Key (BYOK)". Client access is through the AI SDK (a TypeScript toolkit for React, Next.js, Vue, Svelte and Node.js) or the AI SDK for Python, plus OpenAI Chat Completions, OpenAI Responses and Anthropic Messages compatible endpoints. Caveats: the Python SDK is still "in public beta" and needs Python 3.12 or later, the Gateway itself is a closed hosted service tied to a Vercel account key or OIDC token, and the docs still cross-link the older "AI Gateway is now in Beta" changelog entry, which can mislead a quick read about the product's current status.