Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add control over bundle "version in db" check in pasring loop #46130

Open
1 task done
jedcunningham opened this issue Jan 27, 2025 · 0 comments
Open
1 task done

Add control over bundle "version in db" check in pasring loop #46130

jedcunningham opened this issue Jan 27, 2025 · 0 comments
Assignees
@jedcunningham
Labels
AIP-66: DAG Bundle/Manifest area:core kind:meta High-level information important to the community

Comments

@jedcunningham
Copy link
Member

Body

Right now, in order to protect against multiple DAG processors becoming out of sync and parsing different versions of a bundle at the same time, we are constantly querying the db for the currently known bundle version. We, however, need a way to turn that down a bit, both for single DAG processor and multiple DAG processors.

Committer

  • I acknowledge that I am a maintainer/committer of the Apache Airflow project.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jedcunningham jedcunningham

Labels
AIP-66: DAG Bundle/Manifest area:core kind:meta High-level information important to the community
Projects
AIP-66: DAG Bundles & Parsing
Status: Todo
Milestone
No milestone
Development

No branches or pull requests
1 participant
@jedcunningham