Skip to content
Roadmap0/111
not startedstudy day 3 of 6 · covers original days 143 & 144

Consolidated Security Portfolio

Final Socratic Oral Defense & Next-Study Roadmap

P1 AssistantP2 RAG platformP3 Agent systemS10S12D1D2D3D4D5D6D7D8D9D10D11D12
not started0/5 blocks
0/5
Jump & context

Week 19: (Final 3 Study Days): Project 3 Clean-Room Acceptance, Portfolio Packaging & Final Oral Defense

The five hours

  1. 01

    Concepts & system design

    60 min

    R28 — PyRIT

    R31 — NIST AI RMF

    R34 — TransformerLens limits

    R35 — NVD

    R42 — NIST GenAI Profile

    Read the assigned sections; map the mechanism, threat model and trade-offs.

  2. 02

    Project implementation

    120 min

    Assemble the top-level Master Portfolio Index linking: the 3 flagship repos, the 12 embedded security deliverables (D1–D12), the implemented agentic capabilities, the S12 public CVE teardown report, the S10 mechanistic interpretability reproducibility report, the D8 CI/CD security gate logs, and the D12 supply-chain SBOM manifests.

    Conduct a closed-book 90-minute oral defense aloud: explain the architecture, design alternatives, failure modes, attack reproductions, and residual risks for P1, P2, and P3 (D1–D12). Record any hesitation in your gap log and create a prioritized post-555h continuation plan (e.g., GPU/vLLM inference benchmarking, TTFT/ITL/KV-cache optimization, and targeted outreach).

    Build, integrate, debug and improve the increment in the active project.

  3. 03

    Security lab

    60 min

    No separate task text for this block on day 111 — the sourced work sits in the block above. Keep the time box.

    Test the abuse case, failure path, authorization bypass or resource limit.

  4. 04

    Verification & evidence

    30 min

    Published Master Portfolio Repository + recorded oral defense notes. 555-Hour Roadmap Complete!

    Add or run regression tests; record the 9-point evidence record.

  5. 05

    Deliberate practice & Socratic review

    30 min

    Answer the 8 Socratic questions without notes: What? Why? How? What if? Why not? How can I prove it? Where can it break? What have I learned?

    Re-explain the hardest concept aloud, inspect one edge case, update the gap log.

  6. total5 h

Read today · inside the concepts block

R28 R31 R34 R35 R42

Read only the named sections needed for today's task. Reading sits inside the 60-minute concepts block; it is not extra time.

Free resources for this day

5 curated
  • docsTransformerLensOrg (Neel Nanda) · Docs + tutorial index
    TransformerLens Documentation

    Covers HookedTransformer, the residual stream, ActivationCache, Logit Lens, and activation patching, the toolkit your S10 reproducibility report uses to make a causal claim about a specific head or layer.

    R34checked 2026-11-11
  • videoInternational Association for Safe & Ethical AI · 25 min
    An Introduction to Mechanistic Interpretability – Neel Nanda | IASEAI 2025

    Frames what interpretability can and cannot establish today, including the limits of current methods, which is exactly the honesty bar for a reproducibility report you will defend aloud.

    R34checked 2026-11-11
  • videoFIRST · 58 min
    CISA’s Known Exploited Vulnerabilities (KEV) Catalog

    Two CISA analysts explain what KEV is and is not, how a CVE gets added, and how it feeds SSVC prioritisation — the exploitation signal that outranks raw CVSS in your portfolio's risk story.

    R35checked 2026-11-11
  • articleFOSSA · 10 min read
    Using the CISA KEV Catalog

    Lays out the three KEV inclusion criteria and a layered triage order (direct dependency, CVSS floor, fix available, KEV, then EPSS), which is a defensible method to cite for D12 findings.

    R35checked 2026-11-11
  • labTransformerLens Documentation · Runnable notebook
    Transformer Lens Main Demo Notebook

    Runs run_with_cache, then activation patching on the IOI task with a clean/corrupted metric, producing the layer-by-position patching grid you need to reproduce and defend a circuit claim.

    R34checked 2026-11-11

Evidence record · 9-point standard

0/9

A lab is complete only when it produces evidence. Installing PyRIT, Garak, Presidio or TransformerLens is not completion. Saved on this device only.

Day notes

empty

The two source formulations

verbatim · nothing summarised

Project & Deliverable Target

Consolidated Security Portfolio & Final Oral Defense | All Deliverables `D1`–`D12`

Focus 1 (Consolidated Security Portfolio — Orig. Day 143)

Assemble the top-level Master Portfolio Index linking: the 3 flagship repos, the 12 embedded security deliverables (D1–D12), the implemented agentic capabilities, the S12 public CVE teardown report, the S10 mechanistic interpretability reproducibility report, the D8 CI/CD security gate logs, and the D12 supply-chain SBOM manifests.

Focus 2 (Final Socratic Oral Defense & Next-Study Roadmap — Orig. Day 144)

Conduct a closed-book 90-minute oral defense aloud: explain the architecture, design alternatives, failure modes, attack reproductions, and residual risks for P1, P2, and P3 (D1–D12). Record any hesitation in your gap log and create a prioritized post-555h continuation plan (e.g., GPU/vLLM inference benchmarking, TTFT/ITL/KV-cache optimization, and targeted outreach).

Verification & Evidence

Published Master Portfolio Repository + recorded oral defense notes. 555-Hour Roadmap Complete!

Read Today (60m Concepts Block)

R28 (PyRIT), R31 (NIST AI RMF), R34 (TransformerLens limits), R35 (NVD), R42 (NIST GenAI Profile).

---