Proxy mode
mcp serve starts a single MCP server that aggregates all your configured backends. Any MCP-compatible client connects once and gets access to every tool from every server in your servers.json.
The problem
Without proxy mode, every LLM tool (Claude Code, Cursor, Windsurf, etc.) needs its own copy of your MCP server configuration. Add a new server? Update it in 3 places. Change a token? Same. The config drifts, breaks, and wastes time.
There's another problem: resource waste. When you configure MCP servers with command in mcpServers, each client session spawns its own copy of every server process. Open 5 Claude Code sessions and you get 5 copies of every MCP server — easily 3-4 GB of RAM wasted on duplicate processes.
Stdio vs HTTP: when to use each
"command": "mcp", "args": ["serve"]
Each session spawns a new proxy (which spawns all backends)
Simple, but duplicates everything per session
"type": "sse", "url": "http://…/mcp/sse"
All sessions share one persistent proxy
One process, one set of backends, zero duplication
Recommendation: Run mcp serve --http as a persistent service (systemd, launchd, etc.) and point all your clients to it via SSE. This gives you a single set of backend connections shared across every session, every client, every terminal.
Don't wrap an HTTP backend in a stdio bridge
The table above is about how clients reach the proxy. The same choice exists one layer down, between the proxy and each backend, and it has a wrong answer.
If a backend already speaks MCP over HTTP, declare it as HTTP. No child process:
Reaching for a stdio bridge like mcp-remote instead adds a Node process per backend, plus its cold start, and hands your auth to a tool built for a different job. Those bridges exist to give stdio-only clients access to remote servers; they typically prefer their own OAuth flow over the header you passed, and that flow wants a browser. In a container there isn't one, so discovery hangs until it hits the 30s cap and the backend vanishes from tools/list (symptoms).
mcp already is the HTTP client. Adding a bridge in front of it means two MCP implementations negotiating with each other so that one of them can talk to a third.
Keep stdio for backends that genuinely ship no HTTP endpoint.
How it works
Client announces itself — either
server/discover(MCP 2026-07-28) orinitialize(every earlier revision). Both answer immediately with the same capabilities (tools, resources, prompts)Client calls
tools/list,resources/list, orprompts/list— the proxy returns items instantly from persistent cache (tools) or discovery (resources/prompts), aggregated across all backends. Each item is namespaced with{server}__prefix.Client calls
tools/call,resources/read, orprompts/get— the proxy reconnects the target backend on demand (if it was shut down), routes the request, and tracks usage for adaptive timeout
On step 3 the proxy speaks to the backend as itself, with the credential from that server's config. A backend that records an author per user needs to know which caller asked instead — see forwarding caller identity.
Protocol revisions
mcp serve speaks MCP 2026-07-28 and every earlier revision it knows, on the same endpoint. It advertises, newest first: 2026-07-28, 2025-11-25, 2025-06-18, 2025-03-26, 2024-11-05.
What it accepts:
server/discover— the 2026-07-28 replacement for the handshake. Returns the list above assupportedVersions, pluscapabilities, plus the proxy'sserverInfounder_meta["io.modelcontextprotocol/serverInfo"](not at the top level, whereinitializeputs it).initialize— still served, for every client that predates 2026-07-28. The proxy echoes back the revision the client asked for (when it's one we speak) instead of the newest one, so a 2025-06-18 client isn't told something it can't parse. A client that sends noprotocolVersiongets the newest, exactly as before.Per-request revision — a 2026-07-28 client declares its revision in
params._metaon each request. Absent means a legacy client and is never an error; present-but-unknown is rejected with-32022.MCP-Protocol-Version/Mcp-Method/Mcp-Nameheaders — validated only when present. Legacy clients send none of them and are not penalized. A header that contradicts the body is rejected with-32020, because that means a gateway routed or metered on a lie. BothMcp-MethodandMcp-Nameare decoded first when they arrive in the Base64 sentinel form=?base64?…?=(which is how a tool name or resource URI that isn't header-safe travels); a sentinel that won't decode is itself a rejection. AMCP-Protocol-Versionnaming a revision we don't speak is rejected with-32022, the same as one declared inparams._meta— otherwise a future date would silently select 2026-07-28 semantics.
What it puts in responses for a client that declared the new revision — either in params._meta or via MCP-Protocol-Version. A client that declared neither gets exactly the bytes it got before this revision existed; these fields don't exist in the revision it negotiated, and a client validating results against a closed schema is a real client:
resultTypeon every result, plusserverInfounder_meta.ttlMsandcacheScope: "private"ontools/list,prompts/list,resources/list,resources/readandserver/discover. The scope is always private: those results are ACL-filtered per identity, so a shared cache would hand one identity another's tool list.Deterministic ordering of
tools/list,prompts/listandresources/list, so the same set of primitives always serializes identically.HTTP status codes the 2026-07-28 transport pins:
-32020and-32022answer400, and an unknown method answers404— the last one only for a client that declared the new revision, since every legacy client has always received-32601on a200and still does.
tools/call, resources/read and prompts/get are relayed to the backend, so a backend that answers with an interim input_required result (Multi Round-Trip Request) passes through intact, along with the inputResponses / requestState the client sends on the retry. The relay is not blind: whatever ttlMs / cacheScope a backend puts on such a result is stripped, because the proxy — not the backend — is the one that knows the answer was ACL-filtered. An input_required is preserved for every client, including a legacy one — dropping it would report an unfinished exchange as finished.
Backends are untouched by any of this: the proxy talks to each one with whatever revision that backend negotiated. A backend that never went past initialize gets no _meta and no Mcp-Method / Mcp-Name / MCP-Protocol-Version headers either — one hop cannot be half on each revision. The only exception is the server/discover probe that asks the backend which revision it speaks, a method that did not exist before 2026-07-28.
Concurrency model
The proxy is built to be the orchestration layer for N concurrent clients sharing the same set of backend processes. This is the whole point of the project — without it, every editor session and every chat window spawns its own copy of every MCP server, multiplying RAM, CPU, and API rate-limit cost by the number of clients.
The guarantees the proxy makes:
One backend = one OS process, regardless of how many clients are connected. 5 clients hitting
slackshare a singleslack-mcp-serverchild.Calls to different backends run in parallel. Two clients calling
sentry__search_issuesandgithub__list_reposat the same time do not block each other.Calls to the same backend also run in parallel. The stdio transport multiplexes JSON-RPC requests on a single pipe via id matching, so 5 clients all hitting
slack__conversations_repliessimultaneously fan out and back through the same process — none of them serializes on the others.A slow or hung backend only delays the requests targeting it. The rest of the proxy keeps moving.
A dead client only loses its own request. TCP keepalive (30s/10s) on the HTTP listener detects half-open sockets from crashed editors within ~60s, and
MCP_PROXY_REQUEST_TIMEOUT(default 120s) is a final hard bound at the request boundary.No orphan backends. Every spawned child is registered with
kill_on_drop, so a panicked task, a cancelled request, or a stalled graceful shutdown all converge on the same outcome: the child gets reaped.
You can verify the orchestration on a running proxy with /health:
backends_connected should never grow with active_clients — that's the win.
Namespacing
Tools, resources, and prompts are prefixed with the server name using double underscore (__) as separator:
Tool
sentry
search_issues
sentry__search_issues
Resource
sentry
issue://123
sentry__issue://123
Prompt
slack
summarize
slack__summarize
Descriptions are also prefixed: [sentry] Search for issues in Sentry.
This prevents collisions when two servers expose items with the same name or URI.
Stdio mode (default)
That's it. It reads the same servers.json (or $MCP_CONFIG_PATH) and connects to everything.
Diagnostics go to stderr:
A few things to note about reaping:
A backend is never reaped before its first request until
max_idle_timeouthas elapsed since connect (warm-up grace). You won't see "shutting down idle backend: X (... 0 reqs)" inside the first few minutes after start anymore — the proxy waits for X to actually be used before considering it idle.When the reaper does fire, all eligible backends shut down in parallel — 8 idle backends take ~5s, not 8 × 5s.
If a backend's graceful shutdown stalls past 5s, you'll see
shutdown timed out — force-killed via drop. The child is guaranteed reaped viakill_on_drop; the proxy never leaks orphan processes.
HTTP mode
Expose the proxy as an HTTP server so multiple developers can share a single MCP endpoint:
This starts an HTTP server on 127.0.0.1:8080 (localhost only, by default).
Custom bind address
Security: Non-loopback addresses require the
--insecureflag. Without TLS, binding to0.0.0.0exposes the proxy to the network in plaintext. Use a reverse proxy (nginx, Caddy) with TLS in production.
Endpoints
POST
/mcp
JSON-RPC 2.0 request/response (Streamable HTTP)
GET
/mcp
SSE stream (same as /mcp/sse, for backward compatibility)
GET
/mcp/sse
SSE stream (old HTTP+SSE transport)
GET
/health
Health check (JSON)
The proxy supports both the Streamable HTTP transport and the older HTTP+SSE transport for backward compatibility. See Protocol revisions for which MCP revisions each speaks.
Deprecation: MCP 2026-07-28 formally deprecates the HTTP+SSE transport with a 12-month removal window. The proxy keeps serving it unchanged and logs a warning on connect — nothing is gated. Move clients to
POST /mcpwhen you can.
POST /mcp
Send any MCP JSON-RPC request and get the response. Supports both requests (with id) and notifications (without id):
When used with an SSE session (?session_id=<uuid>), responses are delivered via the SSE stream and the POST returns 202 Accepted.
GET /mcp/sse
SSE endpoint for clients that use the old HTTP+SSE transport (protocol version 2024-11-05). On connect, the server sends an endpoint event with the URL to POST requests to:
JSON-RPC responses are delivered as message events on the SSE stream. The connection stays open with periodic pings (every 15 seconds) to keep it alive. Sessions are cleaned up automatically when the client disconnects.
GET /health
Returns the proxy status, including backend pool size and live client sessions:
active_clients is the number of SSE sessions currently registered. Combined with backends_connected, this is the metric that proves the proxy is doing its job: N clients sharing M backends, not N × M processes. If you ever see backends_connected grow proportionally to active_clients, something is wrong (clients should be hitting the proxy, not bypassing it to spawn their own backends).
Reloading a running proxy
The proxy reads servers.json once, at boot. To pick up an mcp add, an edit to the file or a changed serverAuth without restarting (which kills every stdio backend and every open session), reload it. Two ways in:
SIGHUPon the process.mcp reloadfinds local proxies and sends it for you.POST /reloadfor a proxy you reach over the network.mcp reload --url <url>calls it.
Both run the same reload. The new config is parsed and validated whole before anything changes. If it is rejected (bad JSON, a serverAuth that does not build), the proxy logs the error and keeps serving the old config. Backends whose config did not change keep their process and usage stats. See mcp reload for what is reloaded and what still needs a restart.
POST /reload
Only available when serverAuth.adminRoles lists at least one role. Without it the route answers 404, on purpose: an operator who did not opt in gets no write endpoint and no hint that one exists.
404
Disabled: adminRoles is empty or absent
401
No credentials, or credentials that did not authenticate
403
Authenticated, but no role in adminRoles
200
Reloaded
500
The new config was rejected. The proxy keeps serving the previous one
A 500 answers {"reloaded": false, "error": "<message>"}, and the proxy logs the same error on stderr. A 403 answers {"error": "reload requires one of serverAuth.adminRoles"}. A 404 answers {"error": "not found"}, byte for byte what the router's fallback answers for any unrouted path, so a probe learns nothing about whether the route exists.
added, changed, removed
Server names in the diff between the old and new config
tools
Tools published after the reload
requires_restart
Changes that were not applied because they are fixed at boot. Values are "audit.output" and "serverAuth.providers.oauth_as"
Two security decisions worth knowing:
A tool grant never implies reload. An identity with
*on every tool still gets403unless one of its roles is inadminRoles."*"inadminRolesis not a wildcard. It matches only a role literally named*.
Reloads are audited as config/reload, with the caller's identity.
Graceful shutdown
The HTTP server shuts down cleanly on SIGTERM or SIGINT (Ctrl+C). It stops accepting new connections, finishes in-flight requests, and disconnects all backends.
Team setup
Run one proxy server on shared infrastructure. Every developer connects to it:
Tokens stay on the server. Developers just connect. For a deeper look at the enterprise use case, see Enterprise token management.
Client configuration
Claude Code (stdio)
In your Claude Code MCP settings (.claude/mcp.json or via Claude Code settings):
Claude Code (HTTP — shared server)
Use the SSE transport type pointing to the /mcp/sse endpoint:
Note: The Streamable HTTP transport (
type: "http") requires OAuth which is not yet supported. Usetype: "sse"for now.
Cursor (stdio)
In .cursor/mcp.json:
Cursor (HTTP — shared server)
Windsurf
In your Windsurf MCP config:
Any MCP client (generic stdio)
Any client that supports stdio transport can use it. The proxy speaks standard JSON-RPC 2.0 over MCP protocol on stdin/stdout.
Any MCP client (HTTP)
Any client that supports HTTP transport can connect to the HTTP endpoint:
Persistent tool cache
The proxy caches discovered tools in a local ChronDB database so that subsequent startups serve tools instantly — no need to wait for backends to connect.
How it works
On startup, the proxy loads cached tools and serves them immediately. A background task then connects to real backends to refresh the cache. If a backend's configuration changes (detected via SHA-256 hash), its cached entry is invalidated and re-discovered.
First run with no cache: tools/list falls back to blocking full discovery (connecting to all backends before responding). However, tools/call uses per-server lazy discovery — it infers the target backend from the namespaced tool name and discovers only that server, so it avoids triggering full discovery of unrelated backends, though it can still be delayed if another discovery is already in progress.
Cache invalidation
The cache is invalidated per-backend when:
The backend's config in
servers.jsonchanges (command, args, url, env, etc.)The backend is removed from config (cache entry is ignored)
Cache location: ~/.config/mcp/db/ (shared database with audit logs, separated by key prefix).
Lazy initialization and idle shutdown
The proxy does not keep all backends running permanently. It uses a lazy initialization strategy combined with adaptive idle shutdown to minimize resource usage.
How it works
Startup — No backends are connected. Cached tools are loaded from the local database and served immediately.
Background refresh — The proxy connects to all backends in the background, refreshes tool lists, and updates the cache. Clients are not blocked.
Idle shutdown — A background task checks every 30 seconds for idle backends. If a backend exceeds its idle timeout, it is shut down. Its tools remain visible in
tools/list.On-demand reconnect — When
tools/calltargets a disconnected backend, the proxy reconnects it transparently, refreshes the tool cache, and forwards the request.
Usage statistics (request count, frequency) are preserved across reconnections, so the adaptive timeout algorithm maintains continuity.
Adaptive timeout tiers
The default idle timeout is adaptive. The proxy classifies each backend by its usage frequency:
Hot
> 20
5 min
Warm
5–20
3 min
Cold
< 5
1 min
Backends with fewer than 2 requests use the minimum timeout (default: 1 min).
Configuring idle timeout
Per-backend in servers.json:
"adaptive" (default)
Usage-based timeout with automatic tier assignment
"never"
Keep alive forever (old behavior)
"<duration>"
Fixed timeout (e.g. "2m", "30s", "1h")
See the config file reference for full details.
Why this matters
With 10 MCP servers configured and 3 Claude Code sessions open:
Before: 30 backend processes running permanently (~3-4 GB RAM)
After: Only the backends you're actively using stay alive. Idle ones are shut down within 1-5 minutes and reconnected on demand.
Error handling
Backend fails to connect — logged to stderr, skipped. Other backends still work.
Backend disconnected (idle shutdown) —
tools/callreconnects the backend transparently. If reconnection fails, returns an MCP error with context.Backend disconnects mid-session —
tools/callreturns an MCP error with context about which backend failed.Unknown tool — returns a JSON-RPC error with the unknown tool name.
Malformed JSON-RPC — HTTP mode returns a parse error with details. Stdio mode silently ignores.
The proxy never crashes because one backend is down. It degrades gracefully.
Authentication
The proxy supports server-side authentication for HTTP mode. Authentication is configured via serverAuth in servers.json.
No auth (default)
By default, no authentication is required. This is suitable for local development and stdio mode.
Schema.
serverAuth.providersis aVec<String>. List one or many — the proxy runs them as a chain, accepting the first identity that validates. Empty list (or omitted) = anonymous (NoAuth). The legacyprovider: "..."single-string field is no longer accepted; configs that still carry it boot asNoAuth.
Bearer token auth
Static token-to-user mapping. Each token maps to a subject identity:
Clients pass the token in the Authorization header:
Forwarded user auth
Trusts a reverse proxy header (e.g. X-Forwarded-User). Only use behind a trusted proxy that sets this header:
OAuth Authorization Server
Lets Claude.ai, ChatGPT, Cursor and other AI clients connect as Custom Connectors via OAuth 2.0 + Dynamic Client Registration. Combine with bearer to keep static tokens working for local dev on the same instance:
Full setup, security notes, and troubleshooting in the OAuth AS how-to.
Access control (ACL)
The ACL supports two schemas: a role-based schema (recommended) and a legacy schema (for backward compatibility). Detection is automatic based on the JSON keys present.
Role-based schema (recommended)
Define reusable roles with server-aware, read/write-aware grants:
How it works:
roles— Map of role name to a list of grants. Roles are reusable and referenced by subjects.subjects— Map of subject identifier to{ roles, extra }. Roles reference entries in the top-levelrolesmap.extrais a per-subject list of additional grants.Evaluation is union-based — collect all grants from all roles the identity has (token roles + subject config roles + extra). If any grant with
deny: truematches, access is denied. Otherwise, if any allow grant matches, access is allowed. No match falls back todefault.Order doesn't matter — unlike the legacy schema, rules are not position-sensitive.
Grant fields:
server
string or string[]
Server alias(es) to match. "*" matches any server.
access
"read" | "write" | "*"
Access level (see below)
tools
string[]
Optional tool name globs to narrow the grant. Empty = all tools.
resources
string[]
Optional resource URI globs to narrow the grant. Empty = all resources. Enforced on resources/list (filtering) and resources/read (gating).
prompts
string[]
Optional prompt name globs to narrow the grant. Empty = all prompts. Enforced on prompts/list (filtering) and prompts/get (gating).
deny
bool
If true, turns this into an explicit deny that always wins over allows
Access expansion:
The access field interacts with the tool classifier (read/write/ambiguous):
access
Read tools
Write tools
Ambiguous tools
"read"
allowed
denied
denied
"write"
denied
allowed
allowed
"*"
allowed
allowed
allowed
When strictClassification: true, ambiguous tools are blocked entirely — regardless of access level (including "*"). This forces explicit classification overrides in the server config before ambiguous tools can be used.
Deny always wins:
The dev role has full access to github, except gh_repo_delete is explicitly denied.
Legacy schema
The original flat rules list, still fully supported. Detected when rules is present in the ACL config:
Rules are evaluated in order — first match wins. If no rule matches, the default policy applies.
Legacy ACL fields:
subjects— list of user subjects to match (supports*wildcard)roles— list of roles to match (supports*wildcard)tools— list of tool name patterns (supports*wildcards: prefixsentry__*, suffix*_issues, contains*admin*, multiplesentry__*_admin__*, exact match, or*for all)policy—allowordeny
Both subjects and roles must match for a rule to apply. Empty subjects or roles means "match all".
Schema detection
roles (as object) or subjects (as object)
Role-based
rules (as array)
Legacy
Both rules and roles/subjects
Config error (fails loudly)
Neither
Legacy with default allow
Note: Stdio mode always uses anonymous identity. ACL rules still apply but the subject is always "anonymous".
ACL enforcement points
The ACL is enforced at every dispatch point in the proxy:
tools/list— The response is filtered to only include tools the identity is allowed to call. A tool the identity cannot reach is invisible in the listing.tools/call— The request is checked against the ACL before it reaches the backend. Denied requests return a JSON-RPC error (-32603) with the subject and tool name.resources/list— Filtered to only include resources matching the identity's grants.resources/read— Checked against the ACL before forwarding to the backend.prompts/list— Filtered to only include prompts matching the identity's grants.prompts/get— Checked against the ACL before forwarding to the backend.
This dual enforcement (listing filter + request gate) applies to all three categories. An unauthorized identity can't discover names via listing and can't bypass the filter by guessing names.
Legacy schema behavior for resources/prompts: Listing is always allowed regardless of the default policy. Only resources/read and prompts/get respect default: deny. This ensures legacy users migrating from tools-only configs don't lose visibility into what's available.
Request timeout
Each client request has a hard upper bound of 120 seconds (configurable via MCP_PROXY_REQUEST_TIMEOUT). If a backend takes longer, the client gets a JSON-RPC error and the in-flight request is dropped. Other concurrent clients are unaffected.
Discovery retry with backoff
When a backend fails to connect during discovery, the proxy applies exponential backoff: 30s → 60s → 120s → 240s (capped at 300s). This prevents a flaky backend from repeatedly stealing the discovery lock and blocking healthy backends. After the backoff expires, the proxy retries on the next tools/call or discovery cycle. Success clears the backoff. Backoff is checked per-backend — a tools/call targeting a healthy server is never delayed by another server's backoff state.
Security considerations
Localhost-only by default
HTTP mode binds to 127.0.0.1 by default. This is safe for local development — only processes on the same machine can reach it.
Non-loopback binding
To expose the proxy on the network, you must explicitly opt in:
The --insecure flag acknowledges the risk of plaintext HTTP on a network interface.
Production deployment
For production, put a reverse proxy in front:
This gives you:
TLS termination
Authentication (bearer tokens or forwarded user)
Rate limiting
Access logging
Token isolation
Backend tokens (Slack, GitHub, etc.) live in servers.json on the proxy server. They are never exposed to clients. Only tool results are forwarded.
Environment variables
All standard mcp env vars apply:
MCP_CONFIG_PATH
~/.config/mcp/servers.json
Custom config file path
MCP_TIMEOUT
60
Timeout in seconds for backend connections
MCP_PROXY_REQUEST_TIMEOUT
120
Hard upper bound (seconds) per client request in proxy mode
MCP_CLASSIFIER_CACHE
~/.config/mcp/tool-classification.json
Path to the tool classification cache
See environment variables reference for full details.
Observability (OpenTelemetry)
mcp serve natively emits traces and metrics via OTLP when OTEL_EXPORTER_OTLP_ENDPOINT is set. Default-off; standard OTel env vars only. See observability guide for span attributes, metrics list, Honeycomb / Tempo / collector recipes, and escape hatches for production rollback.
When to use each mode
Single session, quick test
mcp serve (stdio)
Multiple sessions on same machine
mcp serve --http + SSE clients
Team sharing one MCP endpoint
mcp serve --http + SSE clients
CI/CD pipeline calling tools
mcp serve --http + curl
Production with auth & TLS
mcp serve --http + reverse proxy
Calling one tool from a script
mcp <server> <tool> directly
If you regularly open multiple Claude Code sessions, use HTTP mode as a persistent service. Stdio mode spawns a full copy of every backend per session — HTTP mode shares one.
Last updated
Was this helpful?