TEZ-4677: Upgrades Tez to compile and run with JDK 25 by maheshrajus · Pull Request #482 · apache/tez

maheshrajus · 2026-04-15T08:17:20Z

Upgrades Tez source compilation target to JDK 25
Updates Yetus CI Docker image to JDK 25 for pre-commit testing

tez-yetus · 2026-04-15T08:18:00Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-482/1/console in case of problems.

maheshrajus · 2026-06-25T16:36:03Z

It looks like the Jenkinsfile and Dockerfile have changed and been optimized in the latest commits. I need to rebase with the latest changes and check on this task.

@Aggarwal-Raghav, if we want to test Tez with JDK 25, which fields in the latest Jenkinsfile and Dockerfile do we need to modify? As far as I can see in the latest changes, there are no fields related to the JDK version.

Aggarwal-Raghav · 2026-06-25T16:47:50Z

@maheshrajus , please check this.

build-tools/docker/Dockerfile basically the eclipse-temurin:21-jdk-noble
parent pom

<javaVersion>21</javaVersion>
<maven.compiler.release>21</maven.compiler.release>

in tez-dist/src/docker/Dockerfile docker image eclipse-temurin:21-jdk-ubi9-minimal — optional
build.yml is already handled in recent commits for github actions

tez-yetus · 2026-06-26T12:22:28Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-482/2/console in case of problems.

tez-yetus · 2026-06-26T16:59:10Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-482/3/console in case of problems.

tez-yetus · 2026-06-29T06:21:14Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-482/4/console in case of problems.

tez-yetus · 2026-06-29T08:34:12Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-482/5/console in case of problems.

Aggarwal-Raghav · 2026-06-29T09:08:53Z

@maheshrajus , now the spotbugs have failed because its incompatible with jdk25. I'll investigate it in some time to see which is better approach (maven-shading or apache pom version) from my perspective and share my findings as both have some tradeoffs in terms of error

Aggarwal-Raghav · 2026-06-29T09:54:05Z

This much of the patch should be enough. It is passing in local. Regarding ubi10 (RHEL10) in docker image, I don't have any strong opinion on that. Also update the README.md or other docs/md where JDK version, spotbugs tools etc. version are mentioned. For example:

tez/README.md

Lines 49 to 53 in 17d1549

    
           * JDK 21+ 
        
           * Maven 3.9.14 or later 
        
           * spotbugs 4.9.3 or later (if running spotbugs) 
        
           * ProtocolBuffer 3.25.5 
        
           * Hadoop 3.x

jdk25.patch

tez-yetus · 2026-06-29T11:58:43Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-482/6/console in case of problems.

tez-yetus · 2026-06-29T12:01:57Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-482/7/console in case of problems.

tez-yetus · 2026-06-29T13:44:18Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	4m 12s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+0 🆗	shelldocs	0m 0s		Shelldocs was not available.
+0 🆗	xmllint	0m 0s		xmllint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 7 new or modified test files.
			_ master Compile Tests _
+0 🆗	mvndep	0m 39s		Maven dependency ordering for branch
+1 💚	mvninstall	3m 6s		master passed
+1 💚	compile	2m 41s		master passed
+1 💚	checkstyle	2m 17s		master passed
+1 💚	javadoc	2m 39s		master passed
-1 ❌	spotbugs	0m 29s	/branch-spotbugs-tez-runtime-internals.txt	tez-runtime-internals in master failed.
-1 ❌	spotbugs	0m 29s	/branch-spotbugs-tez-runtime-library.txt	tez-runtime-library in master failed.
-1 ❌	spotbugs	0m 33s	/branch-spotbugs-tez-dag.txt	tez-dag in master failed.
-1 ❌	spotbugs	0m 22s	/branch-spotbugs-tez-tests.txt	tez-tests in master failed.
-1 ❌	spotbugs	0m 21s	/branch-spotbugs-root.txt	root in master failed.
+0 🆗	spotbugs	0m 19s		branch/tez-dist no spotbugs output file (spotbugsXml.xml)
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 11s		Maven dependency ordering for patch
+1 💚	mvninstall	2m 27s		the patch passed
+1 💚	codespell	1m 1s		No new issues.
+1 💚	compile	2m 33s		the patch passed
+1 💚	javac	2m 33s		root generated 0 new + 748 unchanged - 22 fixed = 748 total (was 770)
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	0m 19s		tez-runtime-internals: The patch generated 0 new + 0 unchanged - 2 fixed = 0 total (was 2)
+1 💚	checkstyle	0m 21s		tez-runtime-library: The patch generated 0 new + 43 unchanged - 2 fixed = 43 total (was 45)
+1 💚	checkstyle	0m 23s		The patch passed checkstyle in tez-dag
+1 💚	checkstyle	0m 14s		tez-tests: The patch generated 0 new + 72 unchanged - 2 fixed = 72 total (was 74)
+1 💚	checkstyle	0m 9s		The patch passed checkstyle in tez-dist
+1 💚	checkstyle	0m 35s		root: The patch generated 0 new + 139 unchanged - 6 fixed = 139 total (was 145)
+1 💚	hadolint	0m 0s		No new issues.
+1 💚	markdownlint	0m 1s		No new issues.
+1 💚	shellcheck	0m 0s		No new issues.
+1 💚	javadoc	0m 15s		tez-runtime-internals in the patch passed.
+1 💚	javadoc	0m 25s		tez-runtime-library generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)
+1 💚	javadoc	0m 20s		tez-dag in the patch passed.
+1 💚	javadoc	0m 15s		tez-tests in the patch passed.
+1 💚	javadoc	0m 18s		tez-dist in the patch passed.
+1 💚	javadoc	1m 0s		root generated 0 new + 5 unchanged - 1 fixed = 5 total (was 6)
+0 🆗	spotbugs	0m 17s		tez-dist has no data from spotbugs
			_ Other Tests _
+1 💚	unit	60m 59s		root in the patch passed.
+1 💚	asflicense	2m 11s		The patch does not generate ASF License warnings.
		102m 25s

Subsystem	Report/Notes
Docker	ClientAPI=1.55 ServerAPI=1.55 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-482/7/artifact/out/Dockerfile
Optional Tests	dupname compile unit asflicense codespell detsecrets hadolint shellcheck shelldocs javac javadoc xmllint markdownlint spotbugs checkstyle
uname	Linux 83053a08fe07 5.15.0-179-generic #189-Ubuntu SMP Tue May 5 18:20:56 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	tez-personality.sh
git revision	master / `17d1549`
Default Java	Eclipse Adoptium-25.0.3+9-LTS
Test Results	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-482/7/testReport/
Max. process+thread count	2106 (vs. ulimit of 5500)
modules	C: tez-runtime-internals tez-runtime-library tez-dag tez-tests tez-dist . U: .
Console output	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-482/7/console
versions	git=2.43.0 maven=3.9.15 hadolint=2.14.0 codespell=2.4.1 markdownlint=0.46.0 shellcheck=0.11.0
Powered by	Apache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

Aggarwal-Raghav · 2026-06-29T14:19:45Z

LGTM +1 for pom, Dockerfile changes. JDK25 changes look good. For checkstyle plese consult with a committer/PMC whether to do in this PR or separate?

maheshrajus · 2026-06-29T16:03:24Z

@Aggarwal-Raghav All checkstyle issues related to jdk 25 so better to include in this PR itself.

@abstractdog Could you please review the PR at your convenience?
Thank you !

tez-yetus · 2026-07-02T12:47:45Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-482/8/console in case of problems.

maheshrajus · 2026-07-02T12:48:33Z

@abstractdog spotbugs checked internally and they are running fine.

jdk25_spotbugs_report.txt

Could you please review the PR at your convenience?
Thank you !

tez-yetus · 2026-07-02T14:26:35Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	3m 13s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+0 🆗	shelldocs	0m 0s		Shelldocs was not available.
+0 🆗	xmllint	0m 0s		xmllint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 7 new or modified test files.
			_ master Compile Tests _
+0 🆗	mvndep	0m 36s		Maven dependency ordering for branch
+1 💚	mvninstall	2m 54s		master passed
+1 💚	compile	2m 31s		master passed
+1 💚	checkstyle	2m 10s		master passed
+1 💚	javadoc	2m 31s		master passed
-1 ❌	spotbugs	0m 27s	/branch-spotbugs-tez-runtime-internals.txt	tez-runtime-internals in master failed.
-1 ❌	spotbugs	0m 27s	/branch-spotbugs-tez-runtime-library.txt	tez-runtime-library in master failed.
-1 ❌	spotbugs	0m 32s	/branch-spotbugs-tez-dag.txt	tez-dag in master failed.
-1 ❌	spotbugs	0m 26s	/branch-spotbugs-tez-tests.txt	tez-tests in master failed.
-1 ❌	spotbugs	0m 22s	/branch-spotbugs-root.txt	root in master failed.
+0 🆗	spotbugs	0m 18s		branch/tez-dist no spotbugs output file (spotbugsXml.xml)
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 11s		Maven dependency ordering for patch
+1 💚	mvninstall	2m 9s		the patch passed
+1 💚	codespell	0m 49s		No new issues.
+1 💚	compile	2m 28s		the patch passed
+1 💚	javac	2m 28s		root generated 0 new + 747 unchanged - 22 fixed = 747 total (was 769)
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	0m 18s		tez-runtime-internals: The patch generated 0 new + 0 unchanged - 2 fixed = 0 total (was 2)
+1 💚	checkstyle	0m 21s		tez-runtime-library: The patch generated 0 new + 41 unchanged - 2 fixed = 41 total (was 43)
+1 💚	checkstyle	0m 22s		The patch passed checkstyle in tez-dag
+1 💚	checkstyle	0m 17s		tez-tests: The patch generated 0 new + 72 unchanged - 2 fixed = 72 total (was 74)
+1 💚	checkstyle	0m 14s		The patch passed checkstyle in tez-dist
+1 💚	checkstyle	0m 35s		root: The patch generated 0 new + 136 unchanged - 6 fixed = 136 total (was 142)
+1 💚	hadolint	0m 1s		No new issues.
+1 💚	markdownlint	0m 1s		No new issues.
+1 💚	shellcheck	0m 0s		No new issues.
+1 💚	javadoc	0m 19s		tez-runtime-internals in the patch passed.
+1 💚	javadoc	0m 23s		tez-runtime-library generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)
+1 💚	javadoc	0m 20s		tez-dag in the patch passed.
+1 💚	javadoc	0m 18s		tez-tests in the patch passed.
+1 💚	javadoc	0m 17s		tez-dist in the patch passed.
+1 💚	javadoc	0m 55s		root generated 0 new + 5 unchanged - 1 fixed = 5 total (was 6)
+0 🆗	spotbugs	0m 20s		tez-dist has no data from spotbugs
			_ Other Tests _
+1 💚	unit	60m 6s		root in the patch passed.
+1 💚	asflicense	2m 6s		The patch does not generate ASF License warnings.
		98m 53s

Subsystem	Report/Notes
Docker	ClientAPI=1.55 ServerAPI=1.55 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-482/8/artifact/out/Dockerfile
Optional Tests	dupname compile unit asflicense codespell detsecrets hadolint shellcheck shelldocs javac javadoc xmllint markdownlint spotbugs checkstyle
uname	Linux e706a9a8f8dd 5.15.0-179-generic #189-Ubuntu SMP Tue May 5 18:20:56 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	tez-personality.sh
git revision	master / `d53e67d`
Default Java	Eclipse Adoptium-25.0.3+9-LTS
Test Results	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-482/8/testReport/
Max. process+thread count	1484 (vs. ulimit of 5500)
modules	C: tez-runtime-internals tez-runtime-library tez-dag tez-tests tez-dist . U: .
Console output	https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-482/8/console
versions	git=2.43.0 maven=3.9.15 hadolint=2.14.0 codespell=2.4.1 markdownlint=0.46.0 shellcheck=0.11.0
Powered by	Apache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

maheshrajus · 2026-07-21T05:21:53Z

@abstractdog @ayushtkn
Could you please review the PR at your convenience?
Thank you !

abstractdog · 2026-07-21T08:43:04Z

is this expected in spotbugs?

[INFO] --- spotbugs:4.9.3.0:spotbugs (default-cli) @ hadoop-shim ---
[INFO] Fork Value is true
     [java] The following errors occurred during analysis:
     [java]   Error scanning java/lang/Object for referenced classes
     [java]     java.lang.IllegalArgumentException: Unsupported class file major version 69

as far as I know, if you change the Dockerfile, it's picked up, so the new spotbugs is supposed to be used

maheshrajus · 2026-07-21T12:52:26Z

@abstractdog Yeah, it should pick SPOTBUGS_VERSION="4.10.2" since I set that same version in the Dockerfile, but it is taking spotbugs:4.9.3.0:spotbugs and running the checks with that instead. We previously faced a similar issue with JDK 17 where Yetus did not respect the updated SpotBugs version. I tested locally with SPOTBUGS_VERSION="4.10.2" and didn't find any issues. We also merged and raised a dummy PR to verify this behavior.

abstractdog · 2026-07-21T13:04:28Z

@abstractdog Yeah, it should pick SPOTBUGS_VERSION="4.10.2" since I set that same version in the Dockerfile, but it is taking spotbugs:4.9.3.0:spotbugs and running the checks with that instead. We previously faced a similar issue with JDK 17 where Yetus did not respect the updated SpotBugs version. I tested locally with SPOTBUGS_VERSION="4.10.2" and didn't find any issues. We also merged and raised a dummy PR to verify this behavior.

thanks @maheshrajus

Error:  Failed to execute goal org.apache.maven.plugins:maven-enforcer-plugin:3.6.2:enforce (enforce-java-version) on project tez: 
Error:  Rule 0: org.apache.maven.enforcer.rules.version.RequireJavaVersion failed with message:
Error:  Detected JDK /opt/hostedtoolcache/Java_Temurin-Hotspot_jdk/21.0.11-10.0.LTS/arm64 is version 21.0.11 which is not in the allowed range [25,).
Error:  -> [Help 1]

I believe the Java 21-related GitHub workflows should be removed once we assume JDK 25 minimum support

This comment was marked as outdated.

Sign in to view

Aggarwal-Raghav reviewed Jun 25, 2026

View reviewed changes

Comment thread tez-plugins/tez-aux-services/pom.xml Outdated

maheshrajus changed the title ~~[WIP] TEZ-4677: JDK25 testing in yetus~~ TEZ-4677: Upgrades Tez to compile and run with JDK 25 Jun 26, 2026

maheshrajus force-pushed the TEZ-4677 branch from 6773889 to dc0143f Compare June 26, 2026 12:21

maheshrajus requested a review from Aggarwal-Raghav June 26, 2026 12:22

maheshrajus force-pushed the TEZ-4677 branch from dc0143f to da09d6f Compare June 26, 2026 16:58

Aggarwal-Raghav reviewed Jun 26, 2026

View reviewed changes

Comment thread pom.xml Outdated

This comment was marked as outdated.

Sign in to view

maheshrajus requested a review from Aggarwal-Raghav June 29, 2026 08:34

This comment was marked as outdated.

Sign in to view

maheshrajus force-pushed the TEZ-4677 branch from c433906 to 2649a3c Compare June 29, 2026 12:01

Aggarwal-Raghav reviewed Jun 29, 2026

View reviewed changes

Comment thread tez-tests/src/test/java/org/apache/tez/test/TestInput.java

maheshrajus added 3 commits July 2, 2026 17:33

TEZ-4677: Upgrades Apache Tez to compile and run with JDK 25

f228c92

Fixed javac issues

6baa761

Review comments Fix:1

7323c70

maheshrajus added 3 commits July 2, 2026 17:47

spotbugs fix

b9d4e9e

Fix checkstyle errors

f712b95

Review comments fix:2

57c0851

maheshrajus force-pushed the TEZ-4677 branch from 2649a3c to 57c0851 Compare July 2, 2026 12:47

Uh oh!

Conversation

maheshrajus commented Apr 15, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

tez-yetus commented Apr 15, 2026

Uh oh!

This comment was marked as outdated.

maheshrajus commented Jun 25, 2026

Uh oh!

Aggarwal-Raghav commented Jun 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

tez-yetus commented Jun 26, 2026

Uh oh!

tez-yetus commented Jun 26, 2026

Uh oh!

Uh oh!

This comment was marked as outdated.

tez-yetus commented Jun 29, 2026

Uh oh!

This comment was marked as outdated.

tez-yetus commented Jun 29, 2026

Uh oh!

Aggarwal-Raghav commented Jun 29, 2026

Uh oh!

Aggarwal-Raghav commented Jun 29, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

This comment was marked as outdated.

tez-yetus commented Jun 29, 2026

Uh oh!

tez-yetus commented Jun 29, 2026

Uh oh!

tez-yetus commented Jun 29, 2026

Uh oh!

Uh oh!

Aggarwal-Raghav commented Jun 29, 2026

Uh oh!

maheshrajus commented Jun 29, 2026

Uh oh!

tez-yetus commented Jul 2, 2026

Uh oh!

maheshrajus commented Jul 2, 2026

Uh oh!

tez-yetus commented Jul 2, 2026

Uh oh!

maheshrajus commented Jul 21, 2026

Uh oh!

abstractdog commented Jul 21, 2026

Uh oh!

maheshrajus commented Jul 21, 2026

Uh oh!

abstractdog commented Jul 21, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

maheshrajus commented Apr 15, 2026 •

edited

Loading

Aggarwal-Raghav commented Jun 25, 2026 •

edited

Loading

Aggarwal-Raghav commented Jun 29, 2026 •

edited

Loading