Skip to content

Scalability improvements to the offline sender #456

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 8 commits into from
Jul 16, 2024

Conversation

alahiff
Copy link
Collaborator

@alahiff alahiff commented Jul 15, 2024

  1. Each time the sender is run all metrics & events updates are sent in one go for each run, rather than sending many tiny requests.
  2. The sender uses a thread pool to enable it to deal with more runs (ideally it would run continously instead but that's not possible on HPC login nodes).

@alahiff alahiff linked an issue Jul 15, 2024 that may be closed by this pull request
@alahiff alahiff requested a review from kzscisoft July 15, 2024 15:08
@kzscisoft kzscisoft merged commit 9845412 into dev Jul 16, 2024
5 checks passed
@kzscisoft kzscisoft deleted the 178-scalability-of-offline-sender-v2 branch July 16, 2024 13:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Scalability of offline sender
2 participants