Documentation
One key, one bill, every major LLM provider. Everything you need to integrate NemoRouter into your application — auth, credits, observability, and guardrails.
NemoRouter is a managed LLM gateway that gives your team one API key to access 240+ models across six provider clouds — Alibaba US, OpenAI, AWS Bedrock, Azure Foundry, Google Vertex AI, and Anthropic — with budget enforcement, guardrails, and smart routing in the request path. One key, one bill, total control — for every team and every autonomous agent. More providers land on a rolling basis. New here? Start with Why NemoRouter for the enterprise pitch, then follow the Quick Start to make your first API call.
Request flow
What happens inside NemoRouter when your app calls a model.
Your application
OpenAI SDK · sk-nemo-…
Nemo Backend
FastAPI
- Auth · virtual key
- Reserve credits
- Guardrails
- A/B routing
- Prompt templates
- Provider routing
Providers
- OpenAI
- Anthropic
- Vertex
- Bedrock
- Azure
response ↩ read cost · settle credits · log · stream back
Onboarding
From sign-up to your first API call in six steps.
Sign up
Supabase Auth
Verify email
magic-link or pwd
Choose plan
Tier 1 · 2 · 3
Set up team
Default auto-created
Create key
sk-nemo-… (once)
First call
x-nemo-* headers
One org per user · Default team auto-created · key shown once
Architecture
The services in the request path and where data lives.
Your application
Nemo Backend · FastAPI :8090
Nemo concerns
- Auth · Guardrails · A/B · Prompts
- Credits (reserve + settle)
- Supabase nemo schema · RLS
Provider router (in-process)
- Cost tracking · Provider routing
- Fallback chains · Spend
- Postgres public schema (Prisma)
Providers
OpenAI · Anthropic · Google Vertex AI · AWS Bedrock · Azure Foundry · …
What happens inside NemoRouter when your app calls a model.
Start here
- Why NemoRouter — the enterprise pitch: multi-tenancy, RLS, credits, observability, guardrails, fallbacks
- Introduction — what NemoRouter is and how it fits into your stack
- Quick Start — your first API call in under 5 minutes
- Authentication — how virtual keys work and how to manage them
Explore
- Playground — test any model interactively from your browser
- Guides — practical walkthroughs for common tasks
- API Reference — every endpoint, request, and response
- SDKs — official client libraries in Python, Node.js, and more
Cross-surface
Need to leave the docs and look around the product? The footer below has every surface — or open one inline: