About
The business's window on the machines that run its models: every node running maluos-local-llm-server on one set of screens — the fleet's health, each node's queue live, the run history with its numbers (queue wait, time to first token, tokens per second, load time, fallbacks), token usage by period, key, model and lane, the models on each node (pull, warm, unload, keep warm, the cloud fallback a model may take), the keys callers hold and the policies the node enforces. Operators act on the queue and the models; the LLM Ops Expert answers and proposes, the Fleet Watcher writes the morning note, and the usage is shared with the ledger. It never serves an inference and never speaks to Ollama — only to nodes.
This is an application of the MaluDB Business OS. It runs on your office's server, not on a desktop. People open it from the OS launcher after a super-admin grants them access; on an enrolled MaluOS Desktop it also appears in the MaluApps window as a launcher.
Install
On a MaluDB Business OS server
- Sign in to the OS as a super-admin and note the domain the kernel serves.
sudo git clone https://github.com/maludb/maludb-os-sovereign-llm-manager /srv/apps/sovereign_llm_managerphp /var/www/bin/app_install.php plan /srv/apps/sovereign_llm_manager --by <super-admin email> --domain <domain>- Read the plan. It is read-only and lists the database, virtual host, services and agent the installer will create.
sudo php /var/www/bin/app_install.php apply /srv/apps/sovereign_llm_manager --by <super-admin email> --domain <domain>- The application appears in the launcher for everyone who is granted access, and its expert agent is hired in Agent HR.
Downloads
| File | For | Size | |
|---|---|---|---|
| Source (zip) | any | Get | |
| Source (tar.gz) | any | Get |