Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Event pipeline benchmark suite #6

Open
ti-mo opened this issue Feb 16, 2019 · 0 comments
Open

Event pipeline benchmark suite #6

ti-mo opened this issue Feb 16, 2019 · 0 comments
Labels
performance Improving the performance and efficiency of the tool pipeline Accounting data pipeline
Milestone

Comments

@ti-mo
Copy link
Owner

ti-mo commented Feb 16, 2019

We need some benchmarks to establish the event throughput baseline of each component in the pipeline, as well as the pipeline itself.

Important areas to focus on:

  • picking binary events from a perf ring buffer and unmarshaling them into AcctEvents
  • for each sink provider, turning AcctEvents into the sink's native metric/document type
  • given a stream of randomly-generated AcctEvents, how many events can we deliver to certain numbers of registered dummy sinks?

Following this issue, there should be a performance pass to decrease the amount of allocations done in delivering an event.

@ti-mo ti-mo added pipeline Accounting data pipeline performance Improving the performance and efficiency of the tool labels Feb 16, 2019
@ti-mo ti-mo changed the title AcctEvent pipeline benchmark suite Event pipeline benchmark suite Feb 16, 2019
@ti-mo ti-mo added this to the 0.4.0 milestone Feb 16, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
performance Improving the performance and efficiency of the tool pipeline Accounting data pipeline
Projects
None yet
Development

No branches or pull requests

1 participant