feat: Add Airflow 3.2.1#803
Draft
NickLarsenNZ wants to merge 10 commits into
Draft
Conversation
Note: The metrics test broke because airflow no longer exports metrics from the webserver role. Instead, we check completion via the API.
Used for interacting with Vector API. Likely not needed, but handy if debugging the vector-aggregator tests for new versions.
11 tasks
Airflow 3.2 changes "migrating" to "migration"
Keeps getting OOMKilled in the logging test since Airflow 3.2
Later versions of Airflow don't emit metrics from the web server. These tests also never waited for a success, only checked creation. So that remains for now, and could be improved later.
I removed 12, even though it is supported by older versions that we support.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Part of stackabletech/docker-images#1489
Note
The metrics test broke because airflow no longer exports metrics from the webserver role.
Instead, we check initiation via the API. We could check for successful completion but it will increase the time taken for tests and will require adjusting the sleep/interations in the metrics script.
Also, the scheduler needed more memory in the logging test.
Test results can be found here: stackabletech/docker-images#1519