High level diagram

All services can be run locally in docker or in a k8s cluster.

Dispatcher is streaming live comments and submissions from Reddit to the two corresponding services that simply save them to a database. The grafana stack can be spinned up locally and OpenTelemetry is sending logs, metrics and traces.

    graph TD

    subgraph services-namespace[services namespace]
        dispatcher(dispatcher service) --> comment(comment-service) & submission(submission-service) --> database(MongoDB)
    end

    subgraph agent-namespace[agent namespace]
        otel[opentelemetry]
    end

    subgraph grafana-namespace[grafana namespace]
        otel --> prom[Prometheus] & loki[Loki] & tempo[Tempo] -.-> grafana-admin[Grafana admin] & grafana-anonymous[Grafana anonymous]
    end

    services-namespace -->|MELT| otel

    reddit[Reddit API] -. comments
submissions.-> dispatcher


    classDef k8s-object fill:#326ce5,stroke:#fff,stroke-width:4px,color:#fff;
    classDef cluster fill:#fff,stroke:#bbb,stroke-width:2px,color:#326ce5;
    classDef edgeLabel background-color:#fff,font-size:9pt;

    class dispatcher,comment,submission,database,otel,tempo,loki,prom,grafana-admin,grafana-anonymous k8s-object;
    class reddit,user cluster;