Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add storage interface to store old user tasks executions #335

Open
abhishekmendhekar opened this issue Sep 20, 2018 · 1 comment
Open

add storage interface to store old user tasks executions #335

abhishekmendhekar opened this issue Sep 20, 2018 · 1 comment
Assignees
Labels
robustness Makes the project tolerate or handle perturbations.

Comments

@abhishekmendhekar
Copy link
Contributor

The following PR #304 adds support for UserTasks that enables tracking of active (async) user operations.

UserTasksManager maintains all old tasks in-memory for 6 hours before discarding all the completed tasks but by adding a storage interface these operations can be stored persistently. In the future, additional APIs can be added or direct calls to the store (could be SQL) to get historical data for analysis.

Ref #293

@efeg
Copy link
Collaborator

efeg commented Dec 5, 2018

As of today, the user_tasks endpoint returns the summary of recently completed and active tasks from various endpoints such as rebalance, remove_broker, and state. Using the relevant UUID in the header of the corresponding request, users can retrieve the response of a completed task.

The duration to keep such completed responses in memory is now controlled by two configurations: (1) completed.user.task.retention.time.ms (current: 6 hours) and (2) max.cached.completed.user.tasks (indirectly). The need for an API to store the historical data in a persistent store still exists.

@sudoa sudoa self-assigned this Feb 22, 2019
@efeg efeg added the robustness Makes the project tolerate or handle perturbations. label May 21, 2019
@efeg efeg removed the enhancement label Dec 31, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
robustness Makes the project tolerate or handle perturbations.
Projects
None yet
Development

No branches or pull requests

3 participants