Nong Li created SPARK-13981:
-------------------------------
Summary: Improve Filter generated code to defer variable
evaluation within operator
Key: SPARK-13981
URL: https://issues.apache.org/jira/browse/SPARK-13981
Project: Spark
Issue Type: Improvement
Reporter: Nong Li
Priority: Minor
We can improve the generated filter code by deferring evaluating variables
until just before they are needed.
For example. x > 1 and y > b
we can do
{code}
x = ...
if (x <= 1) continue
y = ...
{code}
instead of currently where we do
{code}
x = ...
y = ...
if (x <= 1) continue
...
{code}
This is helpful if evaluating y has any cost.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
