Tutorial1 min readDraft
AI gateway policy workshop
Design and test identity-aware request, routing, inspection, egress, and approval policy cases.
Last content review 2026-08-03Included in SAI-240
Scenario
Design a gateway for an internal assistant that can use a local model, an approved external endpoint for low-sensitivity tasks, private retrieval, and one approval-based tool.
Tasks
- Map actor, workload, gateway, model, retrieval, tool, identity, policy, and evidence boundaries.
- Define the identity envelope and delegated authority at every hop.
- Build a decision table for prompts, files, destinations, tools, responses, and administrative actions.
- Create inspection cases including encoding, streaming, mixed permissions, adversarial text, and false-positive handling.
- Define local-first routing, allowed egress, capacity failure, endpoint verification, and deny behavior.
- Identify and close bypass paths.
- Specify evidence minimization, release tests, rollback, and incident response.
Deliverables
Submit the boundary diagram, identity and delegation flow, policy table, inspection test set, egress/route design, bypass review, evidence schema, release decision, and exception procedure.
Passing work does not depend on a language model to authorize access and never converts service unavailability into uncontrolled egress.