Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

User defined executor - Several levels slow down test execution #826

Open
BenHaramboure opened this issue Feb 3, 2025 · 0 comments
Open

Comments

@BenHaramboure
Copy link

BenHaramboure commented Feb 3, 2025

Hi,

My team has rewritten some venom test scenarios with 2 levels of User defined executors ( a test scenario calls a user defined executor having the route, assertions...per step, this executor calls a second user defined executor having less specific data such as headers, certificates, high-level assertions) in order to :

  • have unified generic approach
  • avoid repeating code
  • lighten scenarios implementation

I've done a simple benchmark locally : simple http calls vs 2 levels of user defined executors with 4 calls each. It seems like time of parsing for the executors layers increases time by 6* (see screenshot below)

Image

As we have hundreds of API tests relying on venom executed frequently, the time of execution for those significantly increased (about times 7).

Is there anything we can do to improve the time of execution ? (those are mostly REST call, they shouldn't take more than tens of seconds each)

Thanks!

cc @gbahezre

@BenHaramboure BenHaramboure changed the title Custom executor - Several levels slow down test execution User defined executor - Several levels slow down test execution Feb 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant