SovAIHub
ModulesSAI-110
SAI-110 table of contents
Concept2 min readContent reviewed

Prioritize threats and residual risk

Rank scenarios using explicit likelihood, impact, exposure, detectability, control strength, and uncertainty criteria.

Last content review 2026-08-03Included in SAI-110

Before you start

Module prerequisites: SAI-100. Check the exercise-specific tools and environment before running commands.

Module outcomes: Draw system and data-flow boundaries; Identify AI-specific threats and abuse paths; Translate threat scenarios into control requirements. This lesson contributes to that sequence.

Prioritize decisions, not fear

Threat prioritization directs engineering and assurance effort. It should make assumptions and uncertainty visible rather than manufacture precise numbers unsupported by evidence.

Evaluate consistent factors

For each scenario, assess:

  • Impact: consequence to people, mission, data, security, operations, finances, reputation, or obligations.
  • Likelihood or feasibility: required capability, access, complexity, opportunity, and known exposure.
  • Reach and scale: number of users, records, systems, tenants, devices, or downstream decisions affected.
  • Detectability: probability and speed of reliable detection.
  • Recoverability: ability and time required to contain, reverse, restore, and verify recovery.
  • Existing control strength: design coverage, bypass paths, test evidence, and operational maturity.
  • Uncertainty: missing architecture, threat, behavior, or incident data.

Use qualitative levels with defined criteria. Do not compare scores created from different definitions.

Distinguish inherent and residual risk

Inherent risk describes the scenario before considering controls. Residual risk describes what remains after specific implemented and verified controls.

Planned controls do not reduce current residual risk until implemented and tested. Record them as treatment actions.

Select a treatment

For every material scenario, choose and justify one or more treatments:

  • Avoid the activity or remove the capability.
  • Reduce likelihood, reach, or impact through controls.
  • Transfer a defined responsibility through an accepted arrangement without pretending accountability disappeared.
  • Accept the residual risk through the authorized owner.
  • Investigate uncertainty before deciding.

Use Write effective control objectives for treatment requirements.

Residual-risk record

Scenario ID:
Inherent assessment and rationale:
Implemented controls and test evidence:
Residual assessment and uncertainty:
Treatment decision:
Authorized owner:
Conditions and expiration:
Monitoring and review trigger:
Recovery obligation:

Prioritization review

Challenge whether high-impact low-frequency scenarios were dismissed, whether privileged and supply-chain access was underestimated, and whether missing detection was incorrectly treated as low likelihood.

Reassess when intended purpose, data, models, tools, permissions, providers, interfaces, deployment boundaries, threat intelligence, incidents, or control evidence changes materially.

Module worked example

A retrieved document contains instructions to disclose a private file.

Apply the control
Treat the text as untrusted input and identify the separate file-access and egress controls that must deny the action.
Expected result
The threat register connects the abuse case to enforcement, a negative test and residual risk.
Troubleshooting
If the mitigation is only a prompt instruction, identify what prevents the side effect outside the model.

Practice and completion check

Choose one control from this lesson. Identify its actor, target, enforcement point and expected result. Describe an allowed case and a denied or failed case. For a runnable exercise, retain observed output and separate it from expected output. Record unresolved limitations before marking the lesson complete.

Your lesson progress

Completion is self-reported learning progress; it does not certify practical competence.

Status: Not marked

My learning

Loading your learning record…