LiteLLM on Railway

Open-source AI gateway: one OpenAI-compatible API for 100+ LLMs, with keys and spend tracking on Railway.

Official site · License: MIT (outside enterprise/) · 21 Railway templates

Deploy LiteLLM on RailwayCompare templates

LiteLLM is an open-source AI gateway. It puts OpenAI, Anthropic, Gemini, Bedrock, Azure, OpenRouter and 100+ other model providers behind one OpenAI-compatible API, so applications can switch models without code changes.

Run as a proxy, it adds virtual API keys, teams, budgets, rate limits, load balancing and fallbacks, and records spend per key, user and team. It is a common way to give internal tools such as n8n, Open WebUI or coding assistants a single controlled endpoint.

LiteLLM is MIT licensed outside its enterprise/ directory, which has a separate enterprise licence.

What LiteLLM can do

  • OpenAI-compatible API across 100+ providers
  • Virtual keys with budgets and rate limits
  • Spend tracking per key, user and team
  • Admin UI at /ui
  • Load balancing and failover across deployments
  • Response cache and shared router state in Redis

What people use it for

  • One internal LLM endpoint for several apps
  • Per-team budgets and usage reporting
  • Switching between model providers without code changes
  • Failover across providers or API keys

Videos

What is LiteLLM and Why it is the Leading Open Source LLM Gateway? · LiteLLM AI Gateway
LiteLLM - Simplify AI API Management With One Library · Better Stack
LiteLLM: Free Open Source Gateway to Manage All Your LLM Providers · Elestio

Running LiteLLM on Railway

On Railway, the LiteLLM template deploys the official litellm-database image v1.104.2 as a public service, with Postgres 18 for models, keys, teams, budgets and spend logs and Redis 8.2 for the response cache and shared rate-limit state. The master key, salt key and Admin UI password are generated at deploy time. Cost follows the proxy's CPU and memory, plus Postgres and Redis; provider usage is billed separately by each provider.

LiteLLM templates on Railway

LiteLLM v1 AI Gateway with Spend TrackingMaintained by Tracklayer
LiteLLM is an open-source AI gateway that puts OpenAI, Anthropic, Gemini, Bedrock and 100+ other providers behind one OpenAI-compatible API. This template runs the LiteLLM proxy v1
4 deployments
Deploy
LiteLLM by Will
LiteLLM: LLM router, virtual keys, budgets, cost tracking, guardrails
348 deployments
Deploy
LiteLLM Proxy | Open Source OpenRouter Alternative by an independent creator
Self Host LiteLLM. Cost tracking, gateway for 100+ LLMs, chat UI & more
88 deployments
Deploy
LiteLLM by an independent creator
Self-hosted LLM gateway with models, keys, caching, and routing
62 deployments
Deploy
LiteLLM by an independent creator
Unified LLM gateway — route to 100+ providers through one OpenAI-compatible
56 deployments
Deploy
LiteLLM by an independent creator
Secure, low-cost LiteLLM AI gateway: one API for 100+ LLMs, with budgets
10 deployments
Deploy
LiteLLM Gateway + Postgres by an independent creator
OpenAI-compatible LLM gateway with Postgres, virtual keys, spend tracking
9 deployments
Deploy
LiteLLM — AI Gateway by an independent creator
One gateway for 100+ AI models, ready to deploy in just 1 click.
8 deployments
Deploy
LiteLLM & One API Alternative — CoAI Gateway by an independent creator
Self-hosted AI & LLM gateway with UI,analytics,billing and API Managment.
5 deployments
Deploy
LiteLLM Proxy by an independent creator
LLM proxy for Claude, GPT & Gemini with keys, budgets & caching
5 deployments
Deploy
LiteLLM by an independent creator
One API for every AI model, with keys, budgets and usage
3 deployments
Deploy
LiteLLM Proxy — Self-Hosted AI Gateway for 100+ LLMs by an independent creator
Self-host an AI gateway for 100+ LLMs with spend tracking & budgets.
3 deployments
Deploy
LiteLLM | (Just Updated) AI Gateway, Add Models in the UI, Zero Required Keys by an independent creator
LiteLLM AI gateway. Keys auto-set, add models in UI, saved in Postgres
1 deployments
Deploy
LiteLLM | LLM Router and AI Gateway for 100+ APIs by an independent creator
One OpenAI-style API for every LLM, with keys, budgets and spend logs
1 deployments
Deploy
LiteLLM | Open Source OpenAI-Compatible LLM Gateway by an independent creator
OpenAI-compatible proxy for 100+ LLM providers, with keys and budgets
1 deployments
Deploy
Litellm-Novita-ai by an independent creator
Litellm setup connected to novita.ai to execute open source models
1 deployments
Deploy
9Router vs LiteLLM by an independent creator
Coding-tool AI router compared with the LiteLLM proxy
0 deployments
Deploy
AI Gateway + Observability (LiteLLM × Langfuse) by an independent creator
[Sep'26] LiteLLM gateway + Langfuse tracing, pre-wired. 100+ LLMs
0 deployments
Deploy
Langfuse LiteLLM by an independent creator
Log every LiteLLM proxy call to your own Langfuse
0 deployments
Deploy
Langfuse v4 + LiteLLM by an independent creator
LiteLLM gateway: every LLM call traced in Langfuse v4, no code changes
0 deployments
Deploy
LiteLLM by an independent creator
Open-source AI gateway: one OpenAI API for 100+ LLMs, keys and budgets
0 deployments
Deploy

Tracklayer templates are listed first. Other LiteLLM templates follow, ordered by total deployments on Railway. How this works.

Deployment numbers as of 2026-11-20.

Questions about LiteLLM

How do I log in to the Admin UI?

Open https://your-domain/ui and sign in as admin with the generated UI_PASSWORD from the LiteLLM service variables. Keep LITELLM_MASTER_KEY for administration and create virtual keys for applications.

Do I need a provider API key?

Yes, at least one. Add it when creating a model in the Admin UI, or set an optional variable such as OPENAI_API_KEY or ANTHROPIC_API_KEY. Provider usage is billed by the provider.

Is the Redis cache used for every request?

No. By default caching is opt-in per request (LITELLM_CACHE_MODE=default_off). Set the variable to default_on to cache by default.

How do I upgrade or scale?

Change the version tag in services/litellm/Dockerfile and redeploy; migrations run on start. Raise NUM_WORKERS or add replicas for throughput. Never change LITELLM_SALT_KEY after adding models.

Which licence applies?

LiteLLM is MIT outside its enterprise/ directory, which has a separate enterprise licence. The template does not enable enterprise features.

Guides

Similar apps

Tracklayer maintains the templates marked as such; LiteLLM is a trademark of its owners and this site is not affiliated with them.