Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

sarama produces messages in out-of-order when retries happen #11935

Closed
wk989898 opened this issue Dec 26, 2024 · 1 comment · Fixed by #11870 or #11977
Closed

sarama produces messages in out-of-order when retries happen #11935

wk989898 opened this issue Dec 26, 2024 · 1 comment · Fixed by #11870 or #11977
Assignees
@3AceShowHand @wk989898
Labels
affects-6.5 This bug affects the 6.5.x(LTS) versions. affects-7.1 This bug affects the 7.1.x(LTS) versions. affects-7.5 This bug affects the 7.5.x(LTS) versions. affects-8.1 This bug affects the 8.1.x(LTS) versions. affects-8.5 This bug affects the 8.5.x(LTS) versions. area/ticdc Issues or PRs related to TiCDC. severity/critical type/bug The issue is confirmed as a bug.

Comments

@wk989898
Copy link
Collaborator

we found sarama sends out-of-order messages when retries happen, and we think the issue causes this:

This could be reproduced by hacking codes. wk989898/sarama@d06ee56
@wk989898 wk989898 added type/bug The issue is confirmed as a bug. area/ticdc Issues or PRs related to TiCDC. affects-6.1 This bug affects the 6.1.x(LTS) versions. affects-6.5 This bug affects the 6.5.x(LTS) versions. affects-7.1 This bug affects the 7.1.x(LTS) versions. affects-7.5 This bug affects the 7.5.x(LTS) versions. affects-8.1 This bug affects the 8.1.x(LTS) versions. affects-8.5 This bug affects the 8.5.x(LTS) versions. labels Dec 27, 2024
@3AceShowHand 3AceShowHand mentioned this issue Dec 31, 2024
Merged
@3AceShowHand 3AceShowHand removed the affects-6.1 This bug affects the 6.1.x(LTS) versions. label Dec 31, 2024
@3AceShowHand
Copy link
Contributor

This affect release after v6.4.0

@ti-chi-bot ti-chi-bot bot closed this as completed in ca34dc8 Dec 31, 2024
This was referenced Dec 31, 2024
Merged
Merged
Merged
3AceShowHand added a commit to 3AceShowHand/tiflow that referenced this issue Jan 6, 2025
@3AceShowHand
kafka(ticdc): sarama do not retry if produce message failed to preven…
33147d9 
…t out of order (pingcap#11870)

close pingcap#11935
@3AceShowHand 3AceShowHand mentioned this issue Jan 6, 2025
Merged
ti-chi-bot bot pushed a commit that referenced this issue Jan 6, 2025
@3AceShowHand
kafka(ticdc): sarama do not retry if produce message failed to preven…
0cf6d84 
…t out of order (#11977)

close #11935
ti-chi-bot bot pushed a commit that referenced this issue Jan 7, 2025
@ti-chi-bot
kafka(ticdc): sarama do not retry if produce message failed to preven…
39e34e8 
…t out of order (#11870) (#11962)

close #11935
@wk989898 wk989898 mentioned this issue Jan 9, 2025
Open
ti-chi-bot bot pushed a commit that referenced this issue Jan 9, 2025
@ti-chi-bot
kafka(ticdc): sarama do not retry if produce message failed to preven…
4f11a8e 
…t out of order (#11870) (#11961)

close #11935
@ti-chi-bot ti-chi-bot mentioned this issue Jan 20, 2025
Merged
ti-chi-bot bot pushed a commit that referenced this issue Jan 22, 2025
@ti-chi-bot
kafka(ticdc): sarama do not retry if produce message failed to preven…
75a5066 
…t out of order (#11870) (#12026)

close #11935
ti-chi-bot pushed a commit to ti-chi-bot/tiflow that referenced this issue Feb 6, 2025
@3AceShowHand @ti-chi-bot
kafka(ticdc): sarama do not retry if produce message failed to preven…
a59d4e1 
…t out of order (pingcap#11870)

close pingcap#11935
@ti-chi-bot ti-chi-bot mentioned this issue Feb 6, 2025
Merged
ti-chi-bot bot pushed a commit that referenced this issue Feb 6, 2025
@ti-chi-bot
kafka(ticdc): sarama do not retry if produce message failed to preven…
4b35231 
…t out of order (#11870) (#12045)

close #11935
ti-chi-bot bot pushed a commit that referenced this issue Feb 11, 2025
@ti-chi-bot
kafka(ticdc): sarama do not retry if produce message failed to preven…
a085125 
…t out of order (#11870) (#11960)

close #11935
@wk989898 wk989898 mentioned this issue Feb 12, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@3AceShowHand 3AceShowHand

@wk989898 wk989898

Labels
affects-6.5 This bug affects the 6.5.x(LTS) versions. affects-7.1 This bug affects the 7.1.x(LTS) versions. affects-7.5 This bug affects the 7.5.x(LTS) versions. affects-8.1 This bug affects the 8.1.x(LTS) versions. affects-8.5 This bug affects the 8.5.x(LTS) versions. area/ticdc Issues or PRs related to TiCDC. severity/critical type/bug The issue is confirmed as a bug.
Projects
None yet
Milestone
No milestone
2 participants
@3AceShowHand @wk989898