LLM gateway — bring your own provider keys

Keep your AI features up when a model provider goes down.

Switchyard gives your apps one OpenAI-compatible endpoint. Behind it, an alias tries your primary model first and falls back to the next provider on errors, timeouts or rate limits — using your own keys, with per-key limits and logs.

  • Free: 1,000 requests a month
  • No markup on tokens
  • Prompts not stored by default
Step 1 of 5Create an alias: try your primary model first, then a backup
All 5 steps in this demo (example data, recorded in the real app)

How it changes your week

Before and after Switchyard.

The manual way

  1. Provider SDKs and keys scattered across services
  2. Hand-written retry-and-fallback code in every app, slightly different each time
  3. One provider outage or 429 becomes your outage
  4. No single place to see which model answered, how fast, and at what token count

With Switchyard

  1. Change the base URL and key once; any OpenAI SDK keeps working
  2. Aliases like “smart” try up to five provider/model targets in order
  3. On 5xx, 429, timeouts or unreachable providers, the next target answers
  4. Every request logged with provider, model, status, latency, tokens and tries

In the demo the primary provider is deliberately unreachable (a local test setup), so you can see the fallback happen.

What you get

Three things you get on day one.

Automatic fallback

An alias is an ordered list of provider and model targets; your code only knows the alias.

How: moves on when a target returns 5xx or 429, times out (you set the per-attempt timeout) or can’t be reached; 4xx errors come back to you unchanged.

Two lines to switch

Keep your OpenAI SDK, LangChain or curl calls; change the base URL and key.

How: OpenAI-compatible chat completions with streaming; Anthropic requests and streams are translated to the OpenAI format.

See every request, not the content

Usage per alias and per key, and a log entry for every call.

How: model, provider, status, latency, tokens and number of tries; prompt and response content only if an admin turns it on.

Try it now — no sign-up

See the change in your code.

Pick your client and an alias name. This is the whole migration: a new base URL, a gateway key, and the alias as the model name.

  • Works with existing OpenAI SDKs
  • Streaming (SSE) supported
  • Per-key rate limits

Start free — no card

Client

Everything included

The rest of the toolkit.

Keys stay with us, encrypted

Provider keys are encrypted at rest and never sent back to your apps.

Per-key limits

Requests per minute per gateway key, with a workspace default.

Usage by alias and key

Requests and tokens this month, broken down so you know who used what.

CSV logs

Download request logs as CSV; the whole workspace as JSON.

Direct addressing

Skip aliases when you want: call provider/model directly.

Team access

Invite teammates with their own login and role.

Pricing

Start free. Upgrade when it pays for itself.

Free: 1,000 requests and 1M tokens a month, 2 providers, 5 aliases, 7-day logs — no card needed. Pro is $49 a month for 200,000 requests. You pay your providers directly; no overage charges from us.

Free

$0 /month

  • 1,000 requests / month
  • 1M tokens / month
  • 2 provider connections
  • 5 model aliases
  • 7-day request logs
  • Bring your own provider keys
Start free
Most popular

Pro

$49 /month

  • 200,000 requests / month
  • 200M tokens / month
  • 20 provider connections
  • 200 model aliases
  • 30-day request logs
  • Everything in Free
Start free, upgrade anytime

Prices exclude VAT. UAE customers pay 5% VAT. All prices are in US dollars. Questions? WhatsApp us

FAQ

Before you sign up.

Do you charge for tokens?
No. You use your own provider keys and your provider bills you directly. Your plan covers gateway requests and tokens per month, with no markup.
Do you store my prompts?
Not by default. Logs keep model, provider, status, latency and token counts. Admins can turn content logging on for new requests. Logs are deleted after 7 days on Free and 30 days on Pro.
Which providers work?
Anthropic, OpenAI, and any provider with an OpenAI-compatible chat completions API.
What happens at my plan limit?
Requests get HTTP 402 with a clear error code until the 1st (UTC) or an upgrade. Failed requests don’t count. We email owners at 80%, and you are never charged overage.
Can I cancel, export or delete?
Cancel any time from Billing. The JSON export includes providers (without keys), aliases, settings and logs. Deleting the workspace deletes stored provider keys immediately.
Are prices including VAT?
Prices are in US dollars and exclude VAT; UAE customers pay 5% VAT.
What isn’t included?
No embeddings, image or audio endpoints, no response caching and no prompt management yet — chat completions (with streaming) only.

One endpoint. Every provider. Fewer outages.

Connect two providers, create an alias, change your base URL. Free, no card.