Editions Modules Use Cases Architecture Community Download Get Started →

Worker

conduvia-worker — Egress data plane — execute sink tasks, deliver to endpoints, retry with backoff, DLQ routing.

Layer 2 — Data Plane

conduvia-worker

Workers consume from Kafka and execute delivery to configured sinks. Retry lanes use separate Kafka topics with attempt counters in headers. The TenantConfigResolver resolves per-tenant delivery credentials at sink runtime using an in-process TTL cache with encrypted backing store. Circuit breakers prevent hammering failing endpoints.

Full architecture reference →
  • Sink task execution for Arka, HTTP, and S3 targets
  • Bounded retry: immediate → 5m → 30m → 2h → terminal
  • Three failure lanes: retry / DLQ / quarantine
  • Circuit breaker per delivery target
  • TenantConfigResolver for per-tenant credential resolution
  • Post-transform and target contract validation
  • Failure classification: transient vs terminal
← Back to all modules