Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

980 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

SBproxy

SBproxy

Last modified: 2026-07-28

SBproxy is an open source Enterprise AI Gateway for API, MCP and agent, and AI model traffic. Every feature in this repository ships under Apache-2.0.

Start here

Install a release on Linux or Apple Silicon macOS:

curl -fsSL https://download.sbproxy.dev | sh
export PATH="$HOME/.local/bin:$PATH"
sbproxy --version

The installer writes to ~/.local/bin by default. Keep the export in your shell profile if that directory was not already on PATH. Linux amd64, Linux arm64, and Apple Silicon macOS arm64 have release archives. Intel Macs can use the Linux image in Docker or build from source. See the runtime manual for the complete install matrix and checksums.

Run the credential-free gateway example next. It starts a local upstream, puts an API behind the gateway, adds an MCP tool, then sends a local OpenAI-compatible completion through the same listener.

git clone https://github.com/soapbucket/sbproxy
cd sbproxy

Follow the getting-started guide.

Choose your job

If you need to Start with
Understand the parts of a gateway Core concepts
Put an existing HTTP API behind policy API-estate guide
Run a local model Run your first managed model
Route to hosted models AI gateway reference
Expose or federate MCP tools MCP gateway
Run the Kubernetes operator Operator quickstart
Upgrade a running deployment Upgrade guide

Install alternatives

Homebrew:

brew tap soapbucket/tap
brew install sbproxy

Docker. The published image has no default configuration command, so mount the file and name the command:

docker pull soapbucket/sbproxy:latest
docker run --rm -p 8080:8080 \
  -v "$PWD/sb.yml:/etc/sbproxy/sb.yml:ro" \
  soapbucket/sbproxy:latest serve -f /etc/sbproxy/sb.yml

Build from source when you need a local development binary:

make build-release
target/release/sbproxy --version

Documentation and examples

Documentation index groups the guides by first run, traffic type, operations, and reference material. The examples/ directory contains complete configurations. For the configuration schema, use configuration.md; for the command surface, use manual.md.

Acknowledgments

SBproxy is built on the work of several open source projects. Thanks to:

  • Pingora - the HTTP proxy framework this gateway's data plane runs on.
  • vLLM and llama.cpp - the inference engines the model host drives.
  • OWASP Core Rule Set - the WAF rule set the waf policy is built against.
  • LiteLLM - model_prices_and_context_window.json, the pricing and context-window dataset the AI gateway consumes for cost accounting.
  • quick-xml and wasmtime - the XML parser and the WebAssembly runtime behind the scripting surface.

Contributing and license

See CONTRIBUTING.md for the contributor workflow. SBproxy is released under Apache License 2.0. See NOTICE and TRADEMARKS.

About

Self-hosted AI gateway and LLM proxy. OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock and 60+ providers, or serve vLLM/llama.cpp on your GPUs. Keys, budgets, guardrails, semantic cache, MCP

Topics

Resources

Code of conduct

Contributing

Security policy

Stars

Watchers

Forks

Releases

Used by

Contributors

Languages