GoKawiilAthena is a lightweight Change Data Capture (CDC) solution that streams changes from Microsoft SQL Server to Apache Kafka. Built in Golang, it supports SASL-authenticated Kafka brokers and provides a straightforward setup experience. Unlike alternatives such as Debezium, which can be complex to configure and manage. Athena offers greater simplicity and operational ease. It automatically manages CDC setups, publishes database changes to a single Kafka topic, and delivers a clean, intuitive event format that is easy for downstream consumers to understand and process.
⚡ How things work
Creates a message for changes like create , update , delete for rows in MSSQL database tables to a single Kafka topic.
, , for rows in MSSQL database tables to a single Kafka topic. Athena only creates messages for all new table changes. Existing ones are ignored.
Kafka topic have to be created before hand. Unlike Debezium, Athena will not create the topic own it's own.
All CDC setups in MSSQL is automatically done by Athena when setup command is run.
command is run. By default, Athena will poll for changes for all tables, you can use the skippedTables option in the config.json to ignore any tables.
🌀 Simple Installation
You can download the pre-compiled binaries from the Github releases page and copy them to the desired location. After that you can follow the below steps in order.
Create a config.json file in the root folder where you but the Athena binary. Here is the format of the JSON file. Fill all the credentials also.
... continue reading