Clean Training Baseline
Synthetic Backdoor Experiment
Jump & context
Week 5: RAG ACLs, PII UUID Gateway, Training-Data Poisoning & Agent/MCP Foundations
The five hours
- 01
Concepts & system design
60 min· read · map the mechanismR19 — Hugging Face Datasets lineage & cards
R20 — Model Cards for Model Reporting paper
R45 — NIST AI 100-2 training-time poisoning
R05 — MITRE ATLAS backdoor techniques
Read the assigned sections; map the mechanism, threat model and trade-offs.
- 02
Project implementation
120 min· build · integrate · debugContrast training/fine-tuning data poisoning with RAG poisoning. Establish a clean baseline on a small local model/classifier task; record dataset lineage, seed, and checkpoint hashes.
Run a controlled synthetic trigger/backdoor poisoning experiment on your local toy task. Measure clean accuracy vs. trigger activation rate and false positives. *(Never extrapolate toy metrics as universal foundation-model laws).*
Build, integrate, debug and improve the increment in the active project.
- 03
Security lab
60 min· attack your own systemNo separate task text for this block on day 27 — the sourced work sits in the block above. Keep the time box.
Test the abuse case, failure path, authorization bypass or resource limit.
- 04
Verification & evidence
30 min· test · record evidenceReproducible training-poisoning lab notebook/script with clean vs. poisoned evaluation metrics.
Add or run regression tests; record the 9-point evidence record.
- 05
Deliberate practice & Socratic review
30 min· explain aloud · update gapsAnswer the 8 Socratic questions without notes: What? Why? How? What if? Why not? How can I prove it? Where can it break? What have I learned?
Re-explain the hardest concept aloud, inspect one edge case, update the gap log.
- total5 h
Read today · inside the concepts block
R05 R19 R20 R45ML attack tactics/techniques: prompt injection, data poisoning, model extraction, and exfiltration.
Dataset loading, revision pinning, dataset cards, and data provenance tracking.
Model Cards for Model Reporting (Mitchell et al.): intended use, limitations, training data, and disaggregated evals.
Adversarial Machine Learning: A Taxonomy and Terminology of Attacks and Mitigations (evasion, poisoning, privacy, abuse).
Read only the named sections needed for today's task. Reading sits inside the 60-minute concepts block; it is not extra time.
Free resources for this day
5 curated- docsHugging Face Datasets Documentation · reference docsDatasets - Hugging Face
Covers load_dataset with revision pinning, dataset cards and streaming, which is how you record dataset lineage and a fixed revision for the clean baseline.
R19checked 2026-11-11 - articlearXiv (Mitchell et al.) · research paper[1810.03993] Model Cards for Model Reporting
Defines intended use, limitations, training data and disaggregated evaluation as reporting obligations, the template for documenting the baseline's data and checkpoint hashes.
R20checked 2026-11-11 - docsMITRE · knowledge baseMITRE ATLAS™
Catalogues poisoning and backdoor techniques by tactic and life-cycle stage, letting you place your synthetic trigger experiment against real-world attack patterns.
R05checked 2026-11-11 - videoLeevaExplains · 3 minBackdoor (Trojan) Attacks on Neural Networks: BadNets Explained
Explains the BadNets mechanism of a trigger pattern mapped to a target label, the exact design for your controlled trigger-poisoning toy experiment.
R05checked 2026-11-11 - videoZero to Builder: Cloud, AI & Blockchain · 10 minData Poisoning and Backdoors in LLM Training Explained
Contrasts weight-level poisoning during training with retrieval-time corpus poisoning, the distinction the day asks you to make explicit before measuring clean accuracy versus trigger rate.
R05R45checked 2026-11-11
Evidence record · 9-point standard
A lab is complete only when it produces evidence. Installing PyRIT, Garak, Presidio or TransformerLens is not completion. Saved on this device only.
Day notes
emptyThe two source formulations
verbatim · nothing summarisedProject & Stage Target
P2 | M2 (Training & Fine-Tuning Security)
Focus 1 (Clean Training Baseline — Orig. Day 34)
Contrast training/fine-tuning data poisoning with RAG poisoning. Establish a clean baseline on a small local model/classifier task; record dataset lineage, seed, and checkpoint hashes.
Focus 2 (Synthetic Backdoor Experiment — Orig. Day 35)
Run a controlled synthetic trigger/backdoor poisoning experiment on your local toy task. Measure clean accuracy vs. trigger activation rate and false positives. *(Never extrapolate toy metrics as universal foundation-model laws).*
Verification & Evidence
Reproducible training-poisoning lab notebook/script with clean vs. poisoned evaluation metrics.
Read Today (60m Concepts Block)
R19 (Hugging Face Datasets lineage & cards), R20 (Model Cards for Model Reporting paper), R45 (NIST AI 100-2 training-time poisoning), R05 (MITRE ATLAS backdoor techniques).
---