Turn NVIDIA GPUs you own into a private, OpenAI-compatible LLM API. vLLM v0.32.0 and llama.cpp b11719 behind one port, a key per app, honest per-GPU monitoring, and coding agents on your own cards.
About
LM Warden turns NVIDIA GPUs you own into a private LLM API that works like a hosted one: a base URL, a key, and the OpenAI client library you already use. It runs vLLM v0.32.0 and llama.cpp b11719, unmodified, behind one published port and a browser console, and adds what a bare…
