Glen Takahashi created SPARK-20871:
--------------------------------------
Summary: Only log Janino code in debug mode
Key: SPARK-20871
URL: https://issues.apache.org/jira/browse/SPARK-20871
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 2.1.1
Reporter: Glen Takahashi
Currently if Janino code compilation fails, it will log the entirety of the
code in the executors. Because the generated code can often be very large, the
logging can cause heap pressure on the driver and cause it to fall over.
I propose removing the "$formatted" from here:
https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala#L964
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
