Skip to content
Roadmap0/111
not startedstudy day 3 of 6 · covers original days 34 & 35

Clean Training Baseline

Synthetic Backdoor Experiment

P2 RAG platformM2
not started0/5 blocks
0/5
Jump & context

Week 5: RAG ACLs, PII UUID Gateway, Training-Data Poisoning & Agent/MCP Foundations

The five hours

  1. 01

    Concepts & system design

    60 min

    R19 — Hugging Face Datasets lineage & cards

    R20 — Model Cards for Model Reporting paper

    R45 — NIST AI 100-2 training-time poisoning

    R05 — MITRE ATLAS backdoor techniques

    Read the assigned sections; map the mechanism, threat model and trade-offs.

  2. 02

    Project implementation

    120 min

    Contrast training/fine-tuning data poisoning with RAG poisoning. Establish a clean baseline on a small local model/classifier task; record dataset lineage, seed, and checkpoint hashes.

    Run a controlled synthetic trigger/backdoor poisoning experiment on your local toy task. Measure clean accuracy vs. trigger activation rate and false positives. *(Never extrapolate toy metrics as universal foundation-model laws).*

    Build, integrate, debug and improve the increment in the active project.

  3. 03

    Security lab

    60 min

    No separate task text for this block on day 27 — the sourced work sits in the block above. Keep the time box.

    Test the abuse case, failure path, authorization bypass or resource limit.

  4. 04

    Verification & evidence

    30 min

    Reproducible training-poisoning lab notebook/script with clean vs. poisoned evaluation metrics.

    Add or run regression tests; record the 9-point evidence record.

  5. 05

    Deliberate practice & Socratic review

    30 min

    Answer the 8 Socratic questions without notes: What? Why? How? What if? Why not? How can I prove it? Where can it break? What have I learned?

    Re-explain the hardest concept aloud, inspect one edge case, update the gap log.

  6. total5 h

Read today · inside the concepts block

R05 R19 R20 R45

Read only the named sections needed for today's task. Reading sits inside the 60-minute concepts block; it is not extra time.

Free resources for this day

5 curated
  • docsHugging Face Datasets Documentation · reference docs
    Datasets - Hugging Face

    Covers load_dataset with revision pinning, dataset cards and streaming, which is how you record dataset lineage and a fixed revision for the clean baseline.

    R19checked 2026-11-11
  • articlearXiv (Mitchell et al.) · research paper
    [1810.03993] Model Cards for Model Reporting

    Defines intended use, limitations, training data and disaggregated evaluation as reporting obligations, the template for documenting the baseline's data and checkpoint hashes.

    R20checked 2026-11-11
  • docsMITRE · knowledge base
    MITRE ATLAS™

    Catalogues poisoning and backdoor techniques by tactic and life-cycle stage, letting you place your synthetic trigger experiment against real-world attack patterns.

    R05checked 2026-11-11
  • videoLeevaExplains · 3 min
    Backdoor (Trojan) Attacks on Neural Networks: BadNets Explained

    Explains the BadNets mechanism of a trigger pattern mapped to a target label, the exact design for your controlled trigger-poisoning toy experiment.

    R05checked 2026-11-11
  • videoZero to Builder: Cloud, AI & Blockchain · 10 min
    Data Poisoning and Backdoors in LLM Training Explained

    Contrasts weight-level poisoning during training with retrieval-time corpus poisoning, the distinction the day asks you to make explicit before measuring clean accuracy versus trigger rate.

    R05R45checked 2026-11-11

Evidence record · 9-point standard

0/9

A lab is complete only when it produces evidence. Installing PyRIT, Garak, Presidio or TransformerLens is not completion. Saved on this device only.

Day notes

empty

The two source formulations

verbatim · nothing summarised

Project & Stage Target

P2 | M2 (Training & Fine-Tuning Security)

Focus 1 (Clean Training Baseline — Orig. Day 34)

Contrast training/fine-tuning data poisoning with RAG poisoning. Establish a clean baseline on a small local model/classifier task; record dataset lineage, seed, and checkpoint hashes.

Focus 2 (Synthetic Backdoor Experiment — Orig. Day 35)

Run a controlled synthetic trigger/backdoor poisoning experiment on your local toy task. Measure clean accuracy vs. trigger activation rate and false positives. *(Never extrapolate toy metrics as universal foundation-model laws).*

Verification & Evidence

Reproducible training-poisoning lab notebook/script with clean vs. poisoned evaluation metrics.

Read Today (60m Concepts Block)

R19 (Hugging Face Datasets lineage & cards), R20 (Model Cards for Model Reporting paper), R45 (NIST AI 100-2 training-time poisoning), R05 (MITRE ATLAS backdoor techniques).

---