Task Fails on pause request due to intermediate change in task status

[suraj-goel]

Description

• After upgrading to Druid-30, One task is occasionally failing per day.
• Task fails with the following exception:

Can't pause, task is not in a pausable state (state: [PAUSED])

• Logs were added to debug the issue: [rcca-25570] Add log lines in pause method confluentinc/druid#304
• Logs when the task failed:

Feb 12, 2025 @ 15:21:08.165	Pausing the task with state: [READING]

Feb 12, 2025 @ 15:21:08.165	Returning 409 conflict for task with state: [PAUSED]

• As per the above logs, status is changing during the evaluation of the if statement.

[kfaraz]

Thanks for reporting the issue, @suraj-goel !
I have seen a similar issue on some of our clusters as well.