QuectoProxy

Share your model with keys and limits

Put it in front of a model server you run, give each person or app its own key, and see who used what. Conversations are never stored.

How to start

You need Docker and a model server it can reach, such as llama.cpp, vLLM or Ollama.

Run it with Docker

Make an admin password, keep it somewhere safe, then start it.

git clone https://github.com/jesdga95/quecto-proxy && cd quecto-proxy
echo "QUECTO_ADMIN_PASSWORD=$(openssl rand -base64 24)" > .env && cat .env
docker compose up -d --build

Connect an app

Sign in at localhost:11313/admin and make a key. Then give any app that speaks the OpenAI API this address and the key.

http://your-host:11312/v1

Free and open source

Quecto Proxy is MIT licensed. The code and the full guide are on GitHub.