Put a local inference endpoint behind an authenticated gateway
Jump & context
Week 7: Parameter-Bound Approvals, Inter-Agent Bus, Production Containers & Inference Serving
The five hours
- 01
Concepts & system design
60 min· read · map the mechanismR03 — OWASP API Authentication & Misconfiguration
R26 — vLLM authentication & exposure guidance
Read the assigned sections; map the mechanism, threat model and trade-offs.
- 02
Project implementation
120 min· build · integrate · debugPlace the local inference endpoint behind an authenticated API gateway that enforces tenant routing and request identity propagation.
Build, integrate, debug and improve the increment in the active project.
- 03
Security lab
60 min· attack your own systemTest unauthenticated requests, forged tenant headers, and direct probing of
/health,/metrics, and/adminroutes for unintended sensitive disclosure.Test the abuse case, failure path, authorization bypass or resource limit.
- 04
Verification & evidence
30 min· test · record evidenceGateway authentication and tenant-routing integration tests.
Add or run regression tests; record the 9-point evidence record.
- 05
Deliberate practice & Socratic review
30 min· explain aloud · update gapsAnswer the 8 Socratic questions without notes: What? Why? How? What if? Why not? How can I prove it? Where can it break? What have I learned?
Re-explain the hardest concept aloud, inspect one edge case, update the gap log.
- total5 h
Read today · inside the concepts block
R03 R26BOLA (API1), Broken Auth (API2), Unrestricted Resource Consumption (API4), SSRF (API7), Misconfiguration (API8).
Serving architecture, OpenAI-compatible server, authentication, concurrency flags, and production deployment.
Read only the named sections needed for today's task. Reading sits inside the 60-minute concepts block; it is not extra time.
Free resources for this day
5 curated- docsLiteLLM · ~10 min readLife of a Request
Traces one request through virtual-key auth, per-key/user/team rate limits and router selection before it reaches the model, the exact hop sequence your authenticated gateway inserts.
R26checked 2026-11-11 - videoMd Junaid Alam · ~20 minLiteLLM Tutorial Part 3 | Proxy Gateway, Local Models, Guardrails & Virtual Keys
Sets up the proxy as a gateway in front of a local model and issues virtual keys, so the model endpoint is never called with the caller's own credential.
R26checked 2026-11-11 - videoAlejandro AO · ~20 minTutorial: Auth for Remote MCP Servers (Step by Step) | OAuth 2.1 with ScaleKit
Builds an authenticating front door in FastAPI that validates tokens and maps scopes per route before forwarding, the same pattern for propagating request identity inward.
R03checked 2026-11-11 - articleFusionAuth · ~15 min readJWT authorization in a microservices gateway
Shows the gateway validating the caller then minting and forwarding a token with tenant and role claims, which is how identity and tenant routing reach the model server.
R03checked 2026-11-11 - labLiteLLM · ~30 min hands-onGetting Started Tutorial - LiteLLM Docs
Runs gateway plus Postgres via compose, creates a scoped virtual key and serves a request through the gateway, the fastest way to stand up the authenticated proxy in front of your local vLLM.
R26checked 2026-11-11
Evidence record · 9-point standard
A lab is complete only when it produces evidence. Installing PyRIT, Garak, Presidio or TransformerLens is not completion. Saved on this device only.
Day notes
emptyThe two source formulations
verbatim · nothing summarisedProject & Stage Target
P3 & Shared Infra | M4, S0
Core Implementation
Place the local inference endpoint behind an authenticated API gateway that enforces tenant routing and request identity propagation.
Security Lab
Test unauthenticated requests, forged tenant headers, and direct probing of /health, /metrics, and /admin routes for unintended sensitive disclosure.
Verification & Evidence
Gateway authentication and tenant-routing integration tests.
Read Today (60m Concepts Block)
R03 (OWASP API Authentication & Misconfiguration), R26 (vLLM authentication & exposure guidance).
---