Best templates for running open LLMs on Railway
Ollama, vLLM and other servers for running open-weight language models on Railway, ranked by total deployments.
Ranked by total deployments on Railway, as of 2026-11-19. How we rank.
Featured by Tracklayer (our own template)
n8n 2 AI Agent Stack (Ollama + Qdrant)
A queue-mode n8n 2 stack with a local Ollama model and a Qdrant vector database on one private Railway network. It is for people who want AI agent workflows without sending data to external LLM APIs. Includes a webhook processor, workers, task runners and a demo chat workflow.
Deploy on RailwayThe ranking
| # | Template | Category | DeploymentsDeploys | 7 days |
|---|---|---|---|---|
| 1 | Ollama A powerful and user-friendly platform for running LLMs | AI/ML | 1,355 | – |
| 2 | Ollama [Updated Jun '26] [Jun '26] Self-host your own LLM model server with a single click. | AI/ML | 212 | – |
| 3 | LibreChat | Self-Hosted AI Chat with Multi-Provider Support 1-Click LibreChat deploy (OpenAI, Anthropic, Google, Ollama, RAG API) | AI/ML | 184 | – |
| 4 | n8n 2 AI Agent Stack (Ollama + Qdrant)Tracklayer n8n queue mode with workers, local LLMs via Ollama and Qdrant memory. | Automation | 12 | – |
| 5 | Open WebUI + Ollama Private AITracklayer Private AI chat: run open models with web search, RAG and multiple users. | AI/ML | 4 | – |
Quick answers
What is the most deployed Local LLMs template on Railway?
Ollama by Jack, with 1,355 deployments as of 2026-11-19.
How many Local LLMs templates are ranked here?
5 widely used templates, ranked by total deployments on Railway. The top 3 are Ollama, Ollama [Updated Jun '26], LibreChat | Self-Hosted AI Chat with Multi-Provider Support.
Which Local LLMs template does Tracklayer maintain?
n8n 2 AI Agent Stack (Ollama + Qdrant), maintained by Tracklayer, the publisher of this directory. It has 12 deployments as of 2026-11-19.
Side by side
| Template | Creator | Deployments | Services | Health |
|---|---|---|---|---|
| Ollama | Jack | 1,355 | 2 | 92% |
| Ollama [Updated Jun '26] | Heimdall | 212 | 1 | 71% |
| LibreChat | Self-Hosted AI Chat with Multi-Provider Support | Heimdall | 184 | 5 | 80% |
| n8n 2 AI Agent Stack (Ollama + Qdrant) | Tracklayer | 12 | 10 | – |
| Open WebUI + Ollama Private AI | Tracklayer | 4 | 5 | – |