Field noteNov 7, 20265 min read1 source

llamawatch: self-hosted dashboard for local LLM fleets, agents and spend

In one minute

llamawatch is a self-hosted dashboard for monitoring local language-model servers, hardware, jobs, spending and agent runs from one interface. For teams operating their own inference fleet, its notable move is bringing operational visibility and approval controls alongside chat rather than treating them as separate tools.

What changed: Llamawatch introduces a self-hosted dashboard for operating local LLM fleets, tracking agents and spend.

What happened

The llamawatch GitHub repository describes a Python dashboard for people running their own language models. Its quick start creates a virtual environment, installs the package with pip, runs llamawatch init to scan the machine for model backends and hardware, then starts the service. The dashboard opens at http://localhost:8400/studio by default. The project lists Python 3.10 or newer and an AGPL-3.0-or-later license.

The Monitor page combines model and machine status. It can show active model names, inference slots, CPU and memory, temperatures, disk, GPU utilization and VRAM, inference speed, latency percentiles, network throughput, Docker containers and background agent status. The project supports llama.cpp, Ollama and any server exposing the standard OpenAI-compatible models and chat endpoints. Multiple machines can be added to a fleet using key-based SSH from the dashboard host. The README calls four or five machines the “sweet spot” for viewing a fleet at a glance, while noting that larger fleets can be browsed by scrolling.

Other pages extend the dashboard into operations. Jobs brings together systemd user timers, cron entries and research runs, and allows users to manage their own timers. Approvals lets operators choose Allow, Ask or Block rules for actions including shell commands, services, containers, jobs and agents; it also records changes in a searchable audit trail. The Agents page is read-only and replays runs, including Claude Code sessions, Codex rollouts and research runs, with steps, duration and token use. Spend tracks paid API usage beside tokens produced locally; users enter prices themselves rather than relying on guessed rates.

The optional Research page can use a configured local model or online API to produce a cited report with findings, confidence, arguments for and against, verification gaps and follow-up questions. It requires the research extra and a Chromium installation. Optional integrations, including web search, knowledge-base and document browsing, are off by default. The repository says dashboard auth is off by default, but without a password dangerous actions are restricted to a direct localhost connection. Network binding or proxy access requires a password; the project explains that proxied requests are treated as remote.

What the archive adds

New Runtime’s earlier coverage has examined other self-hosted tools, including Kwant’s multi-agent runtime (October 24, 2026). That release focused on handoffs, routines and approvals, while llamawatch is a new event centered on operating local-model fleets and observing agent activity. The overlap is in self-hosting and operational control, not a direct product continuation.

Trend signal

This is a modest fit with AI-native organizations move toward review and orchestration: llamawatch exposes approval rules and agent-run replays, putting operator review next to execution. It does not establish adoption or demonstrate that review time or accepted outcomes improve, so the connection is an interface-level signal rather than evidence of an organizational shift.

Why it matters

Local inference often leaves teams to assemble separate tools for model health, host monitoring, scheduled work and agent activity. A single self-hosted interface can make it easier to see whether a backend is serving requests, whether a machine is constrained, what an agent did, and which actions are awaiting approval. The spend ledger also offers a useful accounting convention: compare paid API charges with local tokens, while keeping prices explicit rather than pretending they can be inferred.

The trade-off is that consolidation puts sensitive operational controls in one application. A dashboard that can open a terminal and control Docker is not merely a monitoring page. Teams should treat its authentication and network boundary as part of deployment, test it on localhost first, and set a password before exposing it through a network, proxy or tunnel. Its value will depend on whether the integrations match a team’s actual backends and how reliably those views represent production state.

Limits and uncertainty

The repository describes capabilities and shows demo data in its screenshots and walkthroughs; those demonstrations are not independent evidence of reliability or production performance. The README does not establish how the dashboard behaves under load, how much operational overhead it adds, or whether its metrics remain accurate across varied hardware and backend versions. Fleet monitoring depends on SSH access and configuration, and spend prices are entered by users. Security controls are described by the project, but have not been independently audited here.

Skill to build now

Before putting an operations dashboard on a shared network, map every action it can perform and define an approval policy. For llamawatch, start with localhost, configure a password before enabling network or proxy access, then decide which action categories should be automatically allowed, require approval, or remain blocked. Validate those choices with a harmless test job and inspect the audit trail before connecting real agents or machines.

Reader takeaway

llamawatch is an open-source, self-hosted attempt to bring local-model fleet monitoring, agent visibility, approvals and spend accounting into one dashboard. Its strongest practical appeal is operational consolidation; its most important deployment detail is that the same interface can execute commands and control containers, so access controls deserve attention before convenience.

Evidence / sources

  1. 1github.com/Huzy85/llamawatch
All Field Notes

Next reads

Read next

Open the graph
  1. 01topicClaudeExplore the claude topic hub.
  2. 02topicClaude CodeExplore the claude-code topic hub.
  3. 03topicCodexExplore the codex topic hub.
  4. 04archiveField NotesOpen the latest editorial analysis.
  5. 05sourcesSourcesSee the original sources this archive cites.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract