• Python 89.6%
  • Makefile 7.5%
  • Dockerfile 2%
  • Jinja 0.6%
  • Shell 0.3%
Find a file
Repository files (latest commit first)
Filename Latest commit message Latest commit date
John "Preston" Mille ec972ad00d
Bump to 0.6.0-post0
2025-06-14 09:22:27 +01:00
.codebuild Adding CodeBuild for images push to public ECR 2023-03-21 06:33:11 +00:00
docs Add ignore_pased and ignore_unnassigned to relate to tasks as well as connectors (#3) 2023-10-05 10:19:04 +01:00
kafka_connect_watcher Bump to 0.6.0-post0 2025-06-14 09:22:27 +01:00
tests Add Backoff Retry Logic (#4) 2025-04-09 16:24:18 +01:00
.dockerignore Initial commit 2023-01-20 21:58:17 +00:00
.editorconfig Initial commit 2023-01-20 21:58:17 +00:00
.gitignore Initial commit 2023-01-20 21:58:17 +00:00
.pre-commit-config.yaml License change to Apache 2.0 as this is Apache Kafka after all 2025-06-14 09:21:18 +01:00
configuration.example.yaml Working scan & publish to EMF 2023-01-25 15:59:35 +00:00
docker-compose.yaml Update to 0.6.0 2025-04-10 13:53:05 +01:00
Dockerfile Update to 0.6.0 2025-04-10 13:53:05 +01:00
entrypoint.sh Adding SNS notificatons 2023-03-20 17:46:24 +00:00
LICENSE License change to Apache 2.0 as this is Apache Kafka after all 2025-06-14 09:21:18 +01:00
Makefile Fixing up SNS sessions 2023-04-17 16:34:52 +01:00
poetry.lock License change to Apache 2.0 as this is Apache Kafka after all 2025-06-14 09:21:18 +01:00
pyproject.toml Bump to 0.6.0-post0 2025-06-14 09:22:27 +01:00
README.rst Adding SNS notificatons 2023-03-20 17:46:24 +00:00

===========================================
Kafka Connect Watcher
===========================================

Service that will actively probe and monitor your Kafka connect clusters using the Connect API.
It can report metrics to AWS CloudWatch (Prometheus coming) using `AWS EMF`_ to allow creating alerts
and alarms.

Features
=========

* Scan multiple clusters at once
* Implement different remediation rules
* Include/Exclude lists for connectors to evaluate/ignore

Roadmap
=========

* Prometheus support
* Multiple channels of alerts (i.e. webhooks)


Systems recommendations
------------------------------

When using multiple clusters, we recommend to provide multiple CPUs to the service as it
has multi-threading enabled, allowing for parallel processing of clusters & their respective connectors.


.. _AWS EMF: https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/CloudWatch_Embedded_Metric_Format_Specification.html