[
https://issues.apache.org/jira/browse/SPARK-22692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16278458#comment-16278458
]
Marco Gaido commented on SPARK-22692:
-------------------------------------
I felt this was the best way to go in order to split the discussion on them,
since there are many places and I saw the same approach for the 64KB limit
issue (SPARK-22510).
> Reduce the number of generated mutable states
> ---------------------------------------------
>
> Key: SPARK-22692
> URL: https://issues.apache.org/jira/browse/SPARK-22692
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.3.0
> Reporter: Marco Gaido
>
> A large number of mutable states can cause a error during code generation due
> to reaching the constant pool limit. There is an ongoing effort on
> SPARK-18016 to fix the problem, nonetheless we can also alleviate it avoiding
> to create a global variables when they are not needed.
> Therefore I am creating this umbrella ticket to track the elimination of
> usage of global variables where not needed. This is not a duplicate or an
> alternative to SPARK-18016: this is a complementary effort which can help
> together with it to support wider datasets.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
