Observability, Incident Response, and SREs

flowchart TB
    User[User request] --> API[API trace]
    API --> Compiler[Compiler trace]
    Compiler --> Scheduler[Scheduler trace]
    Scheduler --> Runtime[Runtime trace]
    Runtime --> QPU[QPU telemetry]
    QPU --> Results[Result artifacts]
    Results --> Stats[Statistical analysis]
    Stats --> User

    Calibration[Calibration store] -. context .-> Compiler
    Calibration -. context .-> QPU
    Incidents[Incident log] -. context .-> Scheduler
    Incidents -. context .-> Stats

flowchart LR
    Metrics[Metrics] --> Latency[Latency]
    Metrics --> Traffic[Traffic]
    Metrics --> Errors[Errors]
    Metrics --> Saturation[Saturation]
    Metrics --> Quality[Quality]
    Metrics --> Uncertainty[Uncertainty]
    Metrics --> Repro[Reproducibility]

sequenceDiagram
    participant U as User client
    participant A as API
    participant C as Compiler
    participant S as Scheduler
    participant R as Runtime
    participant P as Post-processor

    U->>A: submit with trace_id
    A->>C: compile span
    C->>S: schedule span
    S->>R: execute span
    R->>P: post-process span
    P->>U: result with trace_id

flowchart TD
    Health[Health check] --> API[API reachable]
    Health --> Queue[Queue accepting jobs]
    Health --> Compiler[Compiler target loaded]
    Health --> Cal[Calibration fresh]
    Health --> Bench[Canary circuits pass]
    Health --> Storage[Result storage writable]
    Health --> Policy[Policy engine available]
    API --> Status[Composite status]
    Queue --> Status
    Compiler --> Status
    Cal --> Status
    Bench --> Status
    Storage --> Status
    Policy --> Status

flowchart TB
    Incident[Incident] --> Platform[Platform incident]
    Incident --> Compiler[Compiler incident]
    Incident --> Scheduler[Scheduler incident]
    Incident --> Device[Device incident]
    Incident --> Data[Data incident]
    Incident --> Scientific[Scientific validity incident]

flowchart TB
    Program[Continuous cybersecurity risk management] --> Govern[Govern]
    Program --> Identify[Identify]
    Program --> Protect[Protect]
    Program --> Detect[Detect]
    Program --> Respond[Respond]
    Program --> Recover[Recover]
    Govern --> Learn[Lessons and improvement]
    Identify --> Learn
    Protect --> Learn
    Detect --> Learn
    Respond --> Learn
    Recover --> Learn
    Learn --> Program

flowchart TD
    Defect[Defect discovered] --> Scope[Compute affected scope]
    Scope --> Runs[Find affected runs]
    Runs --> Severity[Classify severity]
    Severity --> Notify[Notify owners]
    Notify --> Reprocess{Can reprocess?}
    Reprocess -- yes --> ReprocessRuns[Reprocess from raw data]
    Reprocess -- no --> Rerun[Rerun experiments]
    ReprocessRuns --> Reports[Update trust reports]
    Rerun --> Reports
    Reports --> Closure[Close incident]

flowchart TD
    Alert[Readout error alert] --> Confirm[Confirm with canary data]
    Confirm --> Localize[Localize affected qubits]
    Localize --> Active[Find active jobs using qubits]
    Active --> Pause{Pause queue?}
    Pause -- yes --> Hold[Hold affected jobs]
    Pause -- no --> Warn[Attach warning to results]
    Hold --> Recal[Run recalibration]
    Warn --> Recal
    Recal --> Verify[Verify benchmark recovery]
    Verify --> Resume[Resume or keep degraded]

flowchart LR
    SLO[SLO] --> Service[Service SLO]
    SLO --> Quality[Quality SLO]
    SLO --> Evidence[Evidence SLO]
    Service --> ErrorBudget[Operational error budget]
    Quality --> ErrorBudget
    Evidence --> ErrorBudget
    ErrorBudget --> Decisions[Release and admission decisions]

flowchart TD
    Incident[Incident] --> Timeline[Timeline]
    Incident --> Technical[Technical root cause]
    Incident --> Impact[Impacted workloads]
    Incident --> Evidence[Evidence quality]
    Incident --> Actions[Corrective actions]
    Actions --> Tests[New tests]
    Actions --> Runbooks[Updated runbooks]
    Actions --> Policy[Policy changes]

flowchart LR
    Telemetry[Telemetry] --> Context[Experiment context]
    Context --> Diagnosis[Diagnosis]
    Diagnosis --> Action[Operational action]
    Action --> Trust[Trustworthy platform]