Self Hosted AI Starter Kit

Self Hosted AI Starter Kit: Complete self-hosted AI stack, LLM, RAG, vector DB, and tools

Deploy from this page: TryDirect provisions the server, starts the services, generates the deployment credentials and wires the 4 containers together. Nothing is shared between deployments and no secrets ship with the stack.

What's included

Service	Port	Description
app	5678 (public)	n8nio/n8n:2.43.6
postgres	internal	Database
ollama	internal	LLM runtime
qdrant	internal	Vector database

What you configure

• Domain (commonDomain): the hostname the stack is served on
• Defaults provided: DB_POSTGRESDB_DATABASE, DB_POSTGRESDB_HOST, DB_POSTGRESDB_USER, DB_TYPE, N8N_DEFAULT_BINARY_DATA_MODE, N8N_DIAGNOSTICS_ENABLED and 4 more ship prefilled and can be adjusted in the deploy form

All 4 credentials (passwords and keys) are generated per deployment and stored in your project's secret store.

Requirements

• A cloud account connected to TryDirect (the deploy form provisions

the server) or one of your own servers

• A server that fits 4 containers (4 GB RAM or more recommended)
• A DNS record for the domain you set in the deploy form

Alternative: deploy with the Stacker CLI

Everything above also works from the command line:

git clone https://github.com/trydirect/awesome-selfhosted-stacker.git
cd awesome-selfhosted-stacker/stacker-projects/self-hosted-ai-starter-kit

# Generate secrets
cp .env.example .env
./scripts/generate-secrets.sh

# Deploy
stacker deploy