Skip to content

Patch Hadoop Client API jar to avoid deprecated Java Security API#453

Merged
lbulej merged 3 commits intomasterfrom
issue/439
Oct 23, 2024
Merged

Patch Hadoop Client API jar to avoid deprecated Java Security API#453
lbulej merged 3 commits intomasterfrom
issue/439

Conversation

@lbulej
Copy link
Copy Markdown
Member

@lbulej lbulej commented Oct 9, 2024

Uses ASM to patch the UserGroupInformation class at build time and stores it in a version-specific directory of a newly created multi-release jar, where it will be picked up by Java 23+.

This is a temporary solution, but it may be a long-term temporary solution.

Fixes #439.

lbulej added 2 commits October 9, 2024 01:52
@lbulej
Patch Hadoop Client API jar to avoid deprecated Java Security API
f786eaf 
Uses ASM to patch UserGroupInformation class at build time and stores
it in a version-specific directory of a newly created multi-release
jar, where it will be picked up by Java 23+.
@lbulej
Patch Hadoop Client API also in JMH builds
6d955f2
@lbulej lbulej marked this pull request as ready for review October 9, 2024 08:54
@lbulej lbulej requested a review from farquet October 9, 2024 08:57
lbulej
lbulej commented Oct 16, 2024
View reviewed changes
lbulej
lbulej commented Oct 16, 2024
View reviewed changes
lbulej
lbulej commented Oct 16, 2024
View reviewed changes
@lbulej
Copy link
Copy Markdown
Member Author

lbulej commented Oct 18, 2024

I think we don't need jdk23 in the linux-jdks section, it is run in the linux section of the main workflow already. Also, we used to run the EA versions only in the ea-jdk worklflow set up for manual trigger, do we need to run it in the main workflow? It makes the main workflow larger again. If we were to compile only once, it would be fine, but this just makes it longer again.

If we are worried that we don't test on EA releases, we can make the ea-jdk to be something that is triggered on merges to master without any relation to PRs.

@vhotspur
Copy link
Copy Markdown
Member

vhotspur commented Oct 22, 2024

I have squashed the CI changes, hopefully it is ready now (runs on 23, extra jobs for LTS releases).

farquet
farquet approved these changes Oct 22, 2024
View reviewed changes
Copy link
Copy Markdown
Collaborator

@farquet farquet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@lbulej lbulej merged commit 838c1db into master Oct 23, 2024
@lbulej lbulej deleted the issue/439 branch November 11, 2024 12:41
@mur47x111
Copy link
Copy Markdown
Collaborator

mur47x111 commented Nov 12, 2024

We need a release including this patch. Currently we cannot run renaissance with latest JDK due to openjdk/jdk#21498

@lbulej
Copy link
Copy Markdown
Member Author

lbulej commented Nov 12, 2024

I'm pushing towards the release (I think that #456 and possibly #455 are the last to go in, unless something critical comes up).

@farquet farquet mentioned this pull request Nov 29, 2024
Closed
@lbulej lbulej mentioned this pull request Jul 16, 2025
Closed
@lbulej lbulej mentioned this pull request Sep 25, 2025
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@vhotspur vhotspur vhotspur left review comments

@farquet farquet farquet approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Spark benchmarks broken by JDK-8296244

4 participants

@lbulej @vhotspur @mur47x111 @farquet