If somebody wants to extend Spark SQL only it should be possible to use shaded antlr4 classes that Spark will provide.
Thank you, Vlad On Nov 14, 2025, at 1:40 AM, Sem <[email protected]> wrote: Do I understand right, that in that case anyone who wants to extend Spark SQL by adding new keyword won't be able to mark antl4 as "provided"? Best regards, On Thu, 2025-11-13 at 17:44 +0000, Rozov, Vlad wrote: Hi All, I propose to shade antlr4-runtime library. antlr4-runtime library 4.10+ is not semver compatible with 4.9: "Mixing ANTLR 4.9.3 and 4.10 can lead to errors that point to a version mismatch. A very common Java error looks like this: Caused by: java.io.InvalidClassException: org.antlr.v4.runtime.atn.ATN; Could not deserialize ATN with version 3 (expected 4).". As ANTLR 4 is a commonly used library (for example it is used by Hive 3.x and 4.x) and many others 3rd party libraries, shading antlr4-runtime allows to avoid such conflicts. JIRA: https://issues.apache.org/jira/browse/SPARK-53753 Thank you, Vlad
