stage S114h
Compliance, Auditing & Governance (NIST RMF, EU AI Act)
Map technical controls to NIST AI RMF (`Govern`, `Map`, `Measure`, `Manage`) and EU AI Act risk tiers. Maintain an RFC 8785 canonicalized, SHA-256 hash-chained trajectory ledger (`D11`) with strict retention and privacy redaction rules.
Stage detail
When: Basic auditability Weeks 5--8; formal framework work after the core project is stable.
- Learn the purpose and high-level structure of NIST AI RMF and the EU AI Act. Applicability depends on jurisdiction, use case, provider/deployer role, and risk category; this is not legal advice.
- Understand SOC 2 as an organizational control/audit framework, not a library.
- Record security events: authenticated principal, agent identity, tool, resource, authorization decision, approval reference, timestamp, outcome, and correlation ID.
- Use append-only or tamper-evident audit design where justified; define retention, access, deletion, and privacy controls.
- Do not store every raw prompt/retrieved document forever. Balance auditability with data minimization, privacy, and retention.
- Add bias/fairness evaluation when relevant to the product's users and decisions.
Practice: build an audit trail for tool calls and approvals. Store hashes/references to sensitive payloads where possible; restrict access and document retention. Test that ordinary application APIs cannot modify audit records.
Do not learn yet: claim "immutable" because a database table is append-only, or attempt SOC 2 certification as an individual project.
Study days for this stage
11- 55Study NIST AI RMFW10S11R31 R32
- 56Design privacy-aware audit recordsW10S11D11R27 R38
- 74End-to-End Cross-Project Attack ChainW13S1S11R05 R31 R39
- 87Review memory/checkpoint provenanceW15S11M6D10D11R24 R41
- 93Prioritize findings by impact and exploitabilityW16S8S11D8D11D12R31 R42
- 94Design incident severity levels for data exposureW16S11M10R31 R42
- 98Incident Playbooks & Tabletop ExerciseW17S11R27 R31 R42
- 99Review EU AI Act concepts relevant to the intended use caseW17S11R31 R32
- 100Build a third-party inventoryW17S11M1D12R36 R37 R43 R44
- 101Enterprise Audit & Retention PolicyW17S11M8D8D11D12R27 R31 R38 R42
- 102Complete a governance/risk review with ownersW17S11R31 R32 R44