Review privacy
Jump & context
Week 14: Project 1 Release Candidate & Project 2 Hardening Sprint (RAG Platform)
The five hours
- 01
Concepts & system design
60 min· read · map the mechanismR16 — Presidio
R17 — NIST Privacy
R18 — Opacus/DP trade-offs
Read the assigned sections; map the mechanism, threat model and trade-offs.
- 02
Project implementation
120 min· build · integrate · debugAudit
P2privacy end-to-end:D4PII tokenization during document ingestion and query time, embedding inversion exposure, membership-inference assumptions, retention TTLs, deletion propagation (D10), and audit log minimization.Build, integrate, debug and improve the increment in the active project.
- 03
Security lab
60 min· attack your own systemVerify
D4token mappings cannot cross tenants during RAG retrieval and measure how PII masking affects retrieval recall and citation precision.Test the abuse case, failure path, authorization bypass or resource limit.
- 04
Verification & evidence
30 min· test · record evidenceP2privacy trade-off report and cross-tenant PII/deletion test suite.Add or run regression tests; record the 9-point evidence record.
- 05
Deliberate practice & Socratic review
30 min· explain aloud · update gapsAnswer the 8 Socratic questions without notes: What? Why? How? What if? Why not? How can I prove it? Where can it break? What have I learned?
Re-explain the hardest concept aloud, inspect one edge case, update the gap log.
- total5 h
Read today · inside the concepts block
R16 R17 R18Analyzer, anonymizer, custom PII recognizers, and probabilistic detection false-positive/negative limits.
Identify-P, Govern-P, Control-P, Communicate-P, and Protect-P lifecycle controls.
Differential privacy PrivacyEngine, gradient clipping, noise multiplier, $(\epsilon, \delta)$ accounting, and utility trade-offs.
Read only the named sections needed for today's task. Reading sits inside the 60-minute concepts block; it is not extra time.
Free resources for this day
5 curated- docsNIST · frameworkNIST Privacy Framework
The Identify-P, Govern-P, Control-P, Communicate-P, Protect-P functions give the vocabulary for mapping each privacy control (retention TTL, deletion propagation, log minimisation) to a lifecycle outcome.
R17checked 2026-11-11 - videoGoogle TechTalksDP-SGD Privacy Analysis is Tight!
Shows that the DP-SGD upper bound is matched by a concrete adversary, which is the right lens for stating what membership-inference resistance your training assumptions actually buy.
R18checked 2026-11-11 - videoSprintML-Lab04. Privacy II: Differential Privacy for Machine Learning (DPSGD and PATE)
Contrasts DP-SGD with PATE and explains the privacy/utility trade-off, so the audit can justify the chosen noise multiplier and epsilon instead of quoting a number.
R18checked 2026-11-11 - articleACL Anthology (EMNLP 2023) · paperText Embeddings Reveal (Almost) As Much As Text
Recovers 92% of 32-token inputs from their embeddings via iterative correction, which is the concrete basis for treating stored vectors as sensitive as the source text in the embedding-inversion exposure review.
R17R18checked 2026-11-11 - labOpacus (Meta) · notebook tutorialBuilding a text classifier with Differential Privacy
Runs PrivacyEngine with max_grad_norm, noise_multiplier, and epsilon reporting on a real fine-tune, so the audit's (epsilon, delta) claim is reproduced rather than copied from a model card.
R18checked 2026-11-11
Evidence record · 9-point standard
A lab is complete only when it produces evidence. Installing PyRIT, Garak, Presidio or TransformerLens is not completion. Saved on this device only.
Day notes
emptyThe two source formulations
verbatim · nothing summarisedProject & Deliverable Target
Project 2 Hardening | `D4` (PII Gateway) & `D10` (Vector Scrubber) | S5, M7
Core Implementation
Audit P2 privacy end-to-end: D4 PII tokenization during document ingestion and query time, embedding inversion exposure, membership-inference assumptions, retention TTLs, deletion propagation (D10), and audit log minimization.
Security Lab
Verify D4 token mappings cannot cross tenants during RAG retrieval and measure how PII masking affects retrieval recall and citation precision.
Verification & Evidence
P2 privacy trade-off report and cross-tenant PII/deletion test suite.
Read Today (60m Concepts Block)
R16 (Presidio), R17 (NIST Privacy), R18 (Opacus/DP trade-offs).
---