Holden Karau created SPARK-55211:
------------------------------------

             Summary: Create an optimizer rule to choose when to use transpiled
                 Key: SPARK-55211
                 URL: https://issues.apache.org/jira/browse/SPARK-55211
             Project: Spark
          Issue Type: Sub-task
          Components: SQL
    Affects Versions: 4.3
            Reporter: Holden Karau


Extend the optimizer so:

It chooses transpiled expressions when they preserve chaining

It avoids transpilation when it would introduce extra serialization or stage 
breaks

It can mix transpiled and native UDFs safely



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to