Skip to content

feat(hadoop): Add 3.5.0 and 3.4.3#1511

Merged
sbernauer merged 24 commits into
mainfrom
feat/hadoop-3.5.0
Jun 15, 2026
Merged

feat(hadoop): Add 3.5.0 and 3.4.3#1511
sbernauer merged 24 commits into
mainfrom
feat/hadoop-3.5.0

Conversation

@sbernauer

@sbernauer sbernauer commented May 27, 2026

Copy link
Copy Markdown
Member

Description

Part of #1494
Needs stackabletech/hdfs-utils#62

  • Add Hadoop 3.4.3 and 3.5.0
  • As all of the aws and azure lib collection is a clusterfuck, I remodeled it: The hdfs/hdfs image takes care of placing all cloud libs in /stackable/hadoop-cloud-libraries/, so that dependant images can easily pull them in. Side node: We now support 3 different Hadoop versions with 3 different naming conventions, argh.
  • I tried to be a good citizen and bump Hadoop 3.4.2 -> 3.4.3 in downstream images. However, this caused compilation failures. As this PR is big enough I left it for the downstream version bumps.

Definition of Done Checklist

Note

Not all of these items are applicable to all PRs, the author should update this template to only leave the boxes in that are relevant.

Please make sure all these things are done and tick the boxes

  • Changes are OpenShift compatible
  • All added packages (via microdnf or otherwise) have a comment on why they are added
  • Things not downloaded from Red Hat repositories should be mirrored in the Stackable repository and downloaded from there
  • All packages should have (if available) signatures/hashes verified
  • Add an entry to the CHANGELOG.md file
  • Integration tests ran successfully
TIP: Running integration tests with a new product image

The image can be built and uploaded to the kind cluster with the following commands:

boil build <IMAGE> --image-version <RELEASE_VERSION> --strip-architecture --load
kind load docker-image <MANIFEST_URI> --name=<name-of-your-test-cluster>

See the output of boil to retrieve the image manifest URI for <MANIFEST_URI>.

Comment thread hadoop/hdfs-utils/stackable/patches/0.6.0/patchable.toml Outdated
@sbernauer sbernauer changed the title feat: Add Hadoop 3.5.0 feat: Add Hadoop 3.5.0 and 3.4.3 May 27, 2026
@Techassi Techassi changed the title feat: Add Hadoop 3.5.0 and 3.4.3 feat(hdfs): Add 3.5.0 and 3.4.3 Jun 1, 2026
@Techassi Techassi changed the title feat(hdfs): Add 3.5.0 and 3.4.3 feat(hadoop): Add 3.5.0 and 3.4.3 Jun 1, 2026
@sbernauer sbernauer self-assigned this Jun 1, 2026
@sbernauer sbernauer moved this to Development: Waiting for Review in Stackable Engineering Jun 1, 2026
Comment thread .scripts/upload_new_boost_version.sh
Comment thread druid/boil-config.toml
NickLarsenNZ
NickLarsenNZ previously approved these changes Jun 2, 2026

@NickLarsenNZ NickLarsenNZ left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks fine. I didn't check in detail, but that should come out via testing.

I left a few comments for clarifications.

Comment thread hadoop/hadoop/Dockerfile
NickLarsenNZ
NickLarsenNZ previously approved these changes Jun 10, 2026

@NickLarsenNZ NickLarsenNZ left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@sbernauer sbernauer enabled auto-merge June 15, 2026 07:52
@sbernauer sbernauer added this pull request to the merge queue Jun 15, 2026
Merged via the queue into main with commit a1b64d5 Jun 15, 2026
3 checks passed
@sbernauer sbernauer deleted the feat/hadoop-3.5.0 branch June 15, 2026 07:52
@razvan razvan mentioned this pull request Jun 15, 2026
6 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Development: Waiting for Review

Development

Successfully merging this pull request may close these issues.

2 participants