Your own swarm of models…
just one at a time.
How it works
-
01
Your app asks for a model.
One OpenAI-compatible endpoint. Put whichever model you like in the
modelfield — the app has expectations; we do not shame them. -
02
The scheduler decides.
Model already loaded? Tokens flow. Not loaded? It stops the current model container, boots yours, and feeds the weights into your very small GPU.
-
03
Your app thinks nothing happened.
Requests queue, responses proxy through, and from the outside all ten of your models appear to exist simultaneously. They do. Sort of.
One honest caveat: swapping models takes seconds to minutes, depending on model size and how fast your disk is. Requests wait in the queue meanwhile. If you want everything answering at once, that's what more VRAM is for — or a generous sponsor.
Capabilities
- Model groups — run exclusively, or co-locate several when VRAM allows.
- Conversation affinity — one chat stays on the loaded model instead of causing swaps during tool calls.
- Router profiles — auto-ordered fallback chains, or manually switch models on the profile your harness is using.
- Cloud providers — aggregate all your API keys from different services behind unswarm, so you never have to visit multiple websites to fetch new keys when testing a new harness or app.
- Benchmarks — compare runtimes on your own hardware, with saved prompts.
- Usage analytics — latency percentiles, token heatmap, CSV export, live tail.
- Cost tracking — per-token pricing, per-provider subscriptions, or “my power bill was $XX this month.”
- API keys — scoped access control with per-key usage.
- Multi-machine — Go agents dial out to the control plane over WebSocket. No inbound ports.
- Live metrics — GPU (NVIDIA, AMD, Intel), CPU and RAM, straight from
/proc.
One control plane.
As many boxes as you own.
Agents connect out to the control plane over WebSocket — the control plane never dials into your machines.
Quick start
git clone https://github.com/atretador/unswarm.git
cd unswarm
docker compose up -d --build
docker exec -i unswarm-backend-1 dotnet exec -- unswarm-admin set-password --username admin --password YourPasswordBackend, frontend and database in one box to start; add agents when you buy more computers. Development setup (.NET 10 · Go · React 19) is in the README.