Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Operation mode with batch job support but without a job registry or job tracker #1005

Open
soxofaan opened this issue Jan 17, 2025 · 0 comments

Comments

@soxofaan
Copy link
Member

soxofaan commented Jan 17, 2025

A functional deployment with full batch job support currently requires a job registry (e.g. EJR) and a regular (e.g. minutely) run of the job tracker.

These extra components can make it quite challenging to get a working deployment (e.g. in EOEPCA https://github.com/EOEPCA/roadmap/issues/332).

I wonder if it isn't feasible to have operation mode that does not require a job registry (nor a job tracker to keep that job registry up to date): just query the cluster API directly to get the state of a job.

This mode would probably not be recommended for production use cases, but having it available could lower the bar considerably to get a working deployment for testing purposes.

It could also provide a fallback code path when the EJR code path is broken for some reason (EJR down, job tracker not running)

@soxofaan soxofaan changed the title Operation mode with batch job support but without a job tracker Operation mode with batch job support but without a job registry or job tracker Jan 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant