Kafka connect container in the same module as testcontainers-kafka

[sfc-gh-japatel]

Hello testcontainers community,
Thank you for this amazing contributions and this toolkit which allows easier testing.

There have been lot of other libraries for kafka connect test container. It would be good if KC container is built into testcontainers-kafka module itself.

Here are the open source libraries which are available for Kafka Connect (KC)

• https://github.com/findinpath/testcontainers-kafka-connect/
• https://github.com/christophschubert/cp-testcontainers

As an end user, it would be great to have a one stop location for all my test containers. Having multiple dependencies for testing kafka and kafka connect seems overkill.

[kiview]

Hi @sfc-gh-japatel, thanks for bringing this to our attention.

testcontainers-kafka-connect seems to see the need for using fixed ports (https://github.com/findinpath/testcontainers-kafka-connect/blob/master/src/test/java/com/findinpath/testcontainers/KafkaContainer.java#L55), which is something we strongly advocate against. This seems to be not the case for cp-testcontainers, so from a first look, this might be the more appropriate approach.

I currently can't assess how much work would be required on our side to add support for Kafka Connect to our Kafka module. It is definitely something, where I would value input from the maintainers of the 3rd party libraries.

[sfc-gh-japatel]

Thank you @kiview for the quick response. Would you be pinging the right folks from kafka module for the feedback/thoughts?

[kiview]

This would be @christophschubert from cp-testcontainers and @findinpath from testcontainers-kafka-connect.

Besides, if those libraries generally work fine for your use case, we strongly encourage you to continue using them for the time being.