Skip to content

Added e2e tests for DR #27401

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 3 commits into
base: dev
Choose a base branch
from
Open

Added e2e tests for DR #27401

wants to merge 3 commits into from
+128 −6

Conversation

mmaslankaprv
Copy link
Member

@mmaslankaprv mmaslankaprv commented Aug 28, 2025 •
edited
Loading

Added first e2e cluster linking test.

Backports Required

  • none - not a bug fix
  • none - this is a backport
  • none - issue does not exist in previous branches
  • none - papercut/not impactful enough to backport
  • v25.2.x
  • v25.1.x
  • v24.3.x

Release Notes

  • none

@mmaslankaprv mmaslankaprv marked this pull request as draft August 28, 2025 15:06
@mmaslankaprv mmaslankaprv force-pushed the dr-cg-mirror-test branch 3 times, most recently from 34ecd7b to 440f954 Compare August 28, 2025 15:30
@mmaslankaprv
Copy link
Member Author

/dt

@mmaslankaprv mmaslankaprv force-pushed the dr-cg-mirror-test branch 2 times, most recently from 11b3aa8 to 78842fd Compare August 29, 2025 07:20
@mmaslankaprv
Copy link
Member Author

/dt

@vbotbuildovich
Copy link
Collaborator

vbotbuildovich commented Aug 29, 2025 •
edited
Loading

Retry command for Build#71595

please wait until all jobs are finished before running the slash command

/ci-repeat 1
tests/rptest/tests/cluster_linking_e2e_test.py::ShadowLinkBasicTests.test_consumer_groups_mirroring
tests/rptest/tests/cluster_linking_e2e_test.py::ShadowLinkBasicTests.test_can_not_create_more_than_one_link

@mmaslankaprv
Copy link
Member Author

/dt

@vbotbuildovich
Copy link
Collaborator

vbotbuildovich commented Aug 29, 2025 •
edited
Loading

Retry command for Build#71600

please wait until all jobs are finished before running the slash command

/ci-repeat 1
tests/rptest/tests/cluster_linking_e2e_test.py::ShadowLinkBasicTests.test_consumer_groups_mirroring
tests/rptest/tests/cluster_linking_e2e_test.py::ShadowLinkBasicTests.test_can_not_create_more_than_one_link
tests/rptest/tests/cluster_linking_e2e_test.py::ShadowLinkBasicTests.test_create_simple_link

@vbotbuildovich
Copy link
Collaborator

CI test results

test results on build#71600
test_class test_method test_arguments test_kind job_url test_status passed reason
ShadowLinkBasicTests test_can_not_create_more_than_one_link null integration https://buildkite.com/redpanda/redpanda/builds/71600#0198f54a-8084-4a22-9788-b75067cb3a6d FAIL 0/1
ShadowLinkBasicTests test_consumer_groups_mirroring null integration https://buildkite.com/redpanda/redpanda/builds/71600#0198f54a-8085-4f30-88e9-a70b06f0dfd8 FAIL 0/1
ShadowLinkBasicTests test_create_simple_link null integration https://buildkite.com/redpanda/redpanda/builds/71600#0198f54a-8085-4b41-8eaa-c3bbc7aa0293 FAIL 0/1
RandomNodeOperationsTest test_node_operations {"cloud_storage_type": 2, "compaction_mode": "sliding_window", "enable_failures": false, "mixed_versions": true, "with_iceberg": false} integration https://buildkite.com/redpanda/redpanda/builds/71600#0198f547-9013-4b88-86bd-b75d6f0aa20f FLAKY 20/21 upstream reliability is '100.0'. current run reliability is '95.23809523809523'. drift is 4.7619 and the allowed drift is set to 50. The test should PASS

@andrewstucki andrewstucki mentioned this pull request Sep 5, 2025
Open
@mmaslankaprv
admin: added converter for consumer offsets mirroring config
065455b 
Signed-off-by: Michał Maślanka <[email protected]>
@mmaslankaprv
tests: added consumer group offsets mirroring test
81833ca 
Signed-off-by: Michał Maślanka <[email protected]>
@mmaslankaprv
cl/manager: create consumer offsets topic when link needs it
eb43a8a 
In empty Redpanda cluster `__consumer_offsets` topic is not initially
present. It is created only when the topic is accessed through Kafka
APIs.

In order for migration of consumer groups to work we require topic to be
present as it controls where the consumer group migration task is
running.

Added piece of code that creates the topic whenever a link with consumer
group migrations is created.

Signed-off-by: Michał Maślanka <[email protected]>
@mmaslankaprv mmaslankaprv marked this pull request as ready for review September 8, 2025 15:24
@mmaslankaprv mmaslankaprv changed the title [DRAFT] Added e2e tests for DR Added e2e tests for DR Sep 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@michael-redpanda michael-redpanda Awaiting requested review from michael-redpanda

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
area/build area/redpanda
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@mmaslankaprv @vbotbuildovich