Privacy-Aware Observability
CI Security Linting, SCA & Secret Scanning
Jump & context
Week 8: Background Jobs, SSRF, Economic Abuse, Advanced Privacy (DP/MI) & Telemetry
The five hours
- 01
Concepts & system design
60 min· read · map the mechanismR27 — OpenTelemetry traces & sensitive-data redaction
R17 — Privacy logging
R36 — Syft/Grype/Trivy
R43 — OpenSSF Scorecard checks
Read the assigned sections; map the mechanism, threat model and trade-offs.
- 02
Project implementation
120 min· build · integrate · debugImplement OpenTelemetry structured logs, distributed traces, latency histograms, token/cost counters, and error metrics (
C8diagnostic inputs). Enforce automatic secret/PII redaction and retention TTLs on logs.Add SAST/security linting (
ruff/bandit), dependency vulnerability scanning (pip-audit/grype), lockfile verification, and secret scanning (gitleaks/trufflehog) to GitHub Actions (or local CI runner).Build, integrate, debug and improve the increment in the active project.
- 03
Security lab
60 min· attack your own systemNo separate task text for this block on day 48 — the sourced work sits in the block above. Keep the time box.
Test the abuse case, failure path, authorization bypass or resource limit.
- 04
Verification & evidence
30 min· test · record evidenceRedacted telemetry verification test + CI run catching a deliberately seeded test secret and vulnerable package.
Add or run regression tests; record the 9-point evidence record.
- 05
Deliberate practice & Socratic review
30 min· explain aloud · update gapsAnswer the 8 Socratic questions without notes: What? Why? How? What if? Why not? How can I prove it? Where can it break? What have I learned?
Re-explain the hardest concept aloud, inspect one edge case, update the gap log.
- total5 h
Read today · inside the concepts block
R17 R27 R36 R43Identify-P, Govern-P, Control-P, Communicate-P, and Protect-P lifecycle controls.
Traces, spans, context propagation, semantic conventions, and redacting sensitive attributes.
CycloneDX/SPDX SBOM generation, container image scanning, dependency vulnerability detection, and scanner limits.
Automated supply-chain checks: pinned dependencies, least-privilege CI tokens, branch protection, and signed releases.
Read only the named sections needed for today's task. Reading sits inside the 60-minute concepts block; it is not extra time.
Free resources for this day
5 curated- docsOpenTelemetry (official docs)Handling sensitive data
First-party guidance on scrubbing secrets and PII before export, including the collector redaction processor that deletes attributes outside an allowlist.
R27checked 2026-11-11 - videoLightstep is now ServiceNow Cloud ObservabilityContext Propagation makes OpenTelemetry awesome
Explains how trace and span context propagates across service and job boundaries, which is how a background ingestion job's spans join the originating request trace.
R27checked 2026-11-11 - videoDevOps & AI ToolkitDistributed Tracing Explained: OpenTelemetry & Jaeger Tutorial
Builds traces with nested spans and attributes and exports them to Jaeger, the concrete harness for latency histograms, error metrics, and token counters.
R27checked 2026-11-11 - articleBetter StackThe Missing Guide to OpenTelemetry Semantic Conventions
Shows how to use collector processors to redact sensitive attributes from logs, traces, and metrics, i.e. enforcing redaction centrally instead of per service.
R27checked 2026-11-11 - repoGitleaks (GitHub)Protect your secrets using Gitleaks-Action
A drop-in CI job that scans commits for secrets and fails the build, the secret-scanning leg of the SAST/dependency/secret CI block.
R27checked 2026-11-11
Evidence record · 9-point standard
A lab is complete only when it produces evidence. Installing PyRIT, Garak, Presidio or TransformerLens is not completion. Saved on this device only.
Day notes
emptyThe two source formulations
verbatim · nothing summarisedProject & Stage Target
All Projects (C8) | M8 (AI-SDLC)
Focus 1 (Privacy-Aware Observability — Orig. Day 61)
Implement OpenTelemetry structured logs, distributed traces, latency histograms, token/cost counters, and error metrics (C8 diagnostic inputs). Enforce automatic secret/PII redaction and retention TTLs on logs.
Focus 2 (CI Security Linting, SCA & Secret Scanning — Orig. Day 62)
Add SAST/security linting (ruff/bandit), dependency vulnerability scanning (pip-audit/grype), lockfile verification, and secret scanning (gitleaks/trufflehog) to GitHub Actions (or local CI runner).
Verification & Evidence
Redacted telemetry verification test + CI run catching a deliberately seeded test secret and vulnerable package.
Read Today (60m Concepts Block)
R27 (OpenTelemetry traces & sensitive-data redaction), R17 (Privacy logging), R36 (Syft/Grype/Trivy), R43 (OpenSSF Scorecard checks).
---