[
https://issues.apache.org/jira/browse/SPARK-25494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-25494.
-----------------------------
Resolution: Fixed
Assignee: Kris Mok
Fix Version/s: 2.5.0
> Upgrade Spark's use of Janino to 3.0.10
> ---------------------------------------
>
> Key: SPARK-25494
> URL: https://issues.apache.org/jira/browse/SPARK-25494
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.4.0
> Reporter: Kris Mok
> Assignee: Kris Mok
> Priority: Major
> Fix For: 2.5.0
>
>
> This ticket proposes to upgrade Spark's use of Janino from 3.0.9 to 3.0.10.
> Note that 3.0.10 is a out-of-band release specifically for fixing an integer
> overflow issue in Janino's {{ClassFile}} reader. It is otherwise exactly the
> same as 3.0.9, so it's a low risk and compatible upgrade.
> The integer overflow issue affects Spark SQL's codegen stats collection: when
> a generated Class file is huge, especially when the constant pool size is
> above {{Short.MAX_VALUE}}, Janino's {{ClassFile}} reader will throw an
> exception when Spark wants to parse the generated Class file to collect
> stats. So we'll miss the stats of some huge Class files.
> The Janino fix is tracked by this issue:
> https://github.com/janino-compiler/janino/issues/58
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
