r/selfhosted • u/Suspicious-Tutor-881 • 9h ago
Release (AI) GPT-Load: a self-hosted AI gateway with reversible text redaction
Hi, I'm the author of GPT-Load, an MIT-licensed AI gateway with 7,000+ GitHub stars.
It manages API keys and supported subscription accounts in one place. Your clients connect through the gateway, which handles credential scheduling, automatic failover, access controls, request logs, and usage tracking.
It runs with Docker Compose or as a single Go binary, includes a web UI, and uses SQLite by default. You don't need a separate database to get started.
One feature I'd particularly like feedback on is reversible request redaction.
Configurable regex rules replace or encrypt matching text locally before it reaches an upstream service. If the model returns intact, valid ciphertext, GPT-Load can restore the original values in response text and client-side tool arguments.
For example, an email address can be encrypted before reaching the model, then restored when the model includes that ciphertext in a tool call returned to your client. The rules apply to supported text fields; image and file contents aren't covered.
There's also an optional, experimental JEV guardrails integration. It reviews outgoing text against custom rules and can warn or block on matches. It uses an external review service, is disabled by default, and failed or incomplete reviews may still allow requests through.
You host the gateway, not the cloud models behind it. Cloud providers still receive the processed requests, and you need your own upstream access.
GitHub: https://github.com/tbphp/gpt-load
Docs: https://www.gpt-load.com
I'd appreciate feedback on the Docker setup and how reversible redaction behaves with the clients you use.
AI disclosure: AI helped draft this post.



