[
https://issues.apache.org/jira/browse/SPARK-25494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622852#comment-16622852
]
Apache Spark commented on SPARK-25494:
--------------------------------------
User 'rednaxelafx' has created a pull request for this issue:
https://github.com/apache/spark/pull/22506
> Upgrade Spark's use of Janino to 3.0.10
> ---------------------------------------
>
> Key: SPARK-25494
> URL: https://issues.apache.org/jira/browse/SPARK-25494
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.4.0
> Reporter: Kris Mok
> Priority: Major
>
> This ticket proposes to upgrade Spark's use of Janino from 3.0.9 to 3.0.10.
> Note that 3.0.10 is a out-of-band release specifically for fixing an integer
> overflow issue in Janino's {{ClassFile}} reader. It is otherwise exactly the
> same as 3.0.9, so it's a low risk and compatible upgrade.
> The integer overflow issue affects Spark SQL's codegen stats collection: when
> a generated Class file is huge, especially when the constant pool size is
> above {{Short.MAX_VALUE}}, Janino's {{ClassFile}} reader will throw an
> exception when Spark wants to parse the generated Class file to collect
> stats. So we'll miss the stats of some huge Class files.
> The Janino fix is tracked by this issue:
> https://github.com/janino-compiler/janino/issues/58
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
