Skip to content

[CELEBORN-2420] Bump scala version to 2.12.18 - #3799

Closed
yew1eb wants to merge 3 commits into
apache:mainfrom
yew1eb:fix/java8-release-flag
Closed

[CELEBORN-2420] Bump scala version to 2.12.18#3799
yew1eb wants to merge 3 commits into
apache:mainfrom
yew1eb:fix/java8-release-flag

Conversation

@yew1eb

@yew1eb yew1eb commented Aug 11, 2026

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

  1. Unify scala.version to 2.12.18 across all spark-3.x profiles.
  2. Remove maven.plugin.silencer.version override (1.6.0) from spark-3.0 and spark-3.1 profiles, so they use the default 1.7.19 which supports scala 2.12.18.

Why are the changes needed?

scala-maven-plugin 4.9.x auto-generates -release 8 from maven.compiler.target=8 and passes it to scalac. Scala 2.12.10–2.12.17 all have issues with -release on JDK 8:

  • 2.12.15/2.12.17: unconditionally rejects -release on JDK 8
  • 2.12.10: predates the -release option, would fail with "bad option"
image

Scala 2.12.18 allows -release 8 on JDK 8.

Does this PR resolve a correctness bug?

  • Yes

Does this PR introduce any user-facing change?

  • Yes

How was this patch tested?

./build/make-distribution.sh -Pspark-3.0 on JDK 8.
./build/make-distribution.sh -Pspark-3.3 on JDK 8.

image

yew1eb added 3 commits August 11, 2026 18:08
Explicitly set empty maven.compiler.release property to prevent
maven-compiler-plugin 3.12.1 from auto-deriving --release flag,
which is not supported by Java 8's javac.
… error on JDK 8

Bump scala.version from 2.12.15 to 2.12.18 in spark-3.2 and spark-3.3 profiles.
Scala 2.12.15 unconditionally rejects any -release value on JDK 8, but
scala-maven-plugin 4.9.x auto-generates -release 8 from maven.compiler.target=8.
Scala 2.12.18 allows -release 8 on JDK 8.
@yew1eb yew1eb closed this Aug 11, 2026
@yew1eb yew1eb reopened this Aug 11, 2026

@SteNicholas SteNicholas left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks for contribution.

@SteNicholas

Copy link
Copy Markdown
Member

Merged to main(v1.0.0).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants