Study differential privacy
Jump & context
Week 8: Background Jobs, SSRF, Economic Abuse, Advanced Privacy (DP/MI) & Telemetry
The five hours
- 01
Concepts & system design
60 min· read · map the mechanismR18 — Opacus documentation: PrivacyEngine, clipping, epsilon/delta
R17 — NIST Privacy Framework
Read the assigned sections; map the mechanism, threat model and trade-offs.
- 02
Project implementation
120 min· build · integrate · debugStudy Differential Privacy (DP-SGD): dataset adjacency, per-sample gradient clipping, Gaussian noise multiplier, (ε, δ) privacy budget accounting, and utility degradation.
Build, integrate, debug and improve the increment in the active project.
- 03
Security lab
60 min· attack your own systemRun a documented Opacus (or equivalent) DP training experiment on a small local dataset; compare accuracy and loss across two ε budgets vs. non-private training. *(Do not claim production privacy from a tutorial).*
Test the abuse case, failure path, authorization bypass or resource limit.
- 04
Verification & evidence
30 min· test · record evidenceDP experiment report comparing (ε, δ) settings vs. task utility.
Add or run regression tests; record the 9-point evidence record.
- 05
Deliberate practice & Socratic review
30 min· explain aloud · update gapsAnswer the 8 Socratic questions without notes: What? Why? How? What if? Why not? How can I prove it? Where can it break? What have I learned?
Re-explain the hardest concept aloud, inspect one edge case, update the gap log.
- total5 h
Read today · inside the concepts block
R17 R18Identify-P, Govern-P, Control-P, Communicate-P, and Protect-P lifecycle controls.
Differential privacy PrivacyEngine, gradient clipping, noise multiplier, $(\epsilon, \delta)$ accounting, and utility trade-offs.
Read only the named sections needed for today's task. Reading sits inside the 60-minute concepts block; it is not extra time.
Free resources for this day
5 curated- docsOpacus (official docs)Tutorials
Official DP-SGD tutorials wiring PrivacyEngine, per-sample gradient clipping, noise multiplier, and epsilon accounting into a real training loop.
R18checked 2026-11-11 - videoPyTorch FoundationDifferential Privacy on PyTorch | PyTorch Developer Day 2020
Explains the PrivacyEngine attach step and what clipping plus Gaussian noise do to the gradient, including the utility cost of a tighter epsilon.
R18checked 2026-11-11 - articleOpenMinedDifferentially Private Deep Learning in 20 lines of code
A minimal end-to-end DP-SGD run that prints the privacy budget spent, useful as the smallest reproducible harness for comparing epsilon against accuracy.
R18checked 2026-11-11 - repoMeta PyTorch (GitHub)meta-pytorch/opacus
Source and examples for the accountant and per-sample gradient machinery, including how the noise multiplier is derived from target epsilon and delta.
R18checked 2026-11-11 - articleMukul RathiDeep Learning with Differential Privacy (DP-SGD Explained)
Walks dataset adjacency, L2 clipping of per-sample gradients, and the noise-multiplier-to-epsilon relationship with the math, which is what the day asks you to reason about rather than just call.
R18checked 2026-11-11
Evidence record · 9-point standard
A lab is complete only when it produces evidence. Installing PyRIT, Garak, Presidio or TransformerLens is not completion. Saved on this device only.
Day notes
emptyThe two source formulations
verbatim · nothing summarisedProject & Stage Target
All Projects | M7
Core Implementation
Study Differential Privacy (DP-SGD): dataset adjacency, per-sample gradient clipping, Gaussian noise multiplier, (ε, δ) privacy budget accounting, and utility degradation.
Security Lab
Run a documented Opacus (or equivalent) DP training experiment on a small local dataset; compare accuracy and loss across two ε budgets vs. non-private training. *(Do not claim production privacy from a tutorial).*
Verification & Evidence
DP experiment report comparing (ε, δ) settings vs. task utility.
Read Today (60m Concepts Block)
R18 (Opacus documentation: PrivacyEngine, clipping, epsilon/delta), R17 (NIST Privacy Framework).
---