Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Associated JBoss community project(s): Debezium

Porting the Debezium Cassandra Connector to Debezium Server

Summary of idea:

Debezium is an open-source platform for change data capture (CDC) and lets you stream data change events out of a variety of databases such as MySQL, Postgres, SQL Server, MongoDB and others. The idea of this proposal is to port the existing stand-alone main class for the Debezium Cassandra connector to Debezium Server as its runtime environment.

Your mission, should you decide to accept it, will be:

  • Implement an outbound adaptor for Debezium Server which sends change events to Apache Kafka (similar to the existing adaptors for Apache Pulsar, Amazon Kinesis, Google Cloud Pub/Sub etc.)
  • Replace the existing stand-alone main class with the Debezium Server runtime
    • Adapt Debezium Server, so that it not only can be used with the Kafka Connect based Debezium connectors, but also with the Cassandra connector implementation
    • Replace means of configuration with those of Debezium Server (application.properties file, etc.)
    • Update tests and documentation accordingly
  • Optional: Refactor the Cassandra connector implementation to make use of Debezium's common connector framework as far as possible
  • Create a demo (e.g. as a video) and blog post show-casing how the connector can be used after this re-implementation

See Jira issue DBZ-2098 for further details of this project idea.

Knowledge prerequisite: Java, Git, Maven; ideally Cassandra

Github repo: https://github.com/debezium/debezium

Skill level: Intermediate/Advanced

Contact(s) Gunnar Morling (gmorling AT redhat DOT com)

Associated JBoss community project(s): Debezium