MaluApps, by Kinetic Seas

Inference Gateway

One door to local and cloud models, with per-user policy and budgets.

Utilities apt package Stable Version 0.5.2 MIT
Install on MaluOS
sudo apt install maluos-gateway
Source on GitHub

About

A daemon on a Unix socket (and optionally a token-protected TCP port) that serves the OpenAI and Ollama APIs, identifies callers by their Linux uid and MaluDB principal, resolves tiers and aliases to backend models under per-principal policy, schedules the single local GPU and routes to cloud backends under egress ceilings and budgets. Every MaluOS application and agent talks to models through it.

What it does

  • OpenAI and Ollama compatible APIs
  • Caller identity from peer credentials
  • Tiers, aliases and per-principal policy
  • Local GPU scheduling and cloud egress ceilings

Install

On MaluOS

  1. Part of every MaluOS install. Manage it with maluctl:
  2. maluctl gateway status
  3. maluctl gateway ollama install

Not on MaluOS? Add the repository first: curl -fsSL https://apt.maluos.com/bootstrap/install-maluos.sh | sudo bash. Packages are signed with the MaluOS archive key; how to verify.

Downloads

FileForSize
maluos-gateway 0.5.2 (.deb, all) MaluOS / Ubuntu 26.04 all 65 KB Get

More utility apps

All utilities

Local LLM Server

A node that serves local models to a business, managed by the Sovereign LLM Manager.

Utilities Source Early development

maluctl agent

Make an agent real on the host in one step: user, principal, policy, service.

Utilities apt package v0.5.2

Secret Vault

Per-user credentials for humans and agents, with a usage ledger.

Utilities apt package v0.4.2

Claude Token Counter

A live terminal dashboard of your Claude Code token usage and cost.

Utilities Source