[ https://issues.apache.org/jira/browse/SPARK-47032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel resolved SPARK-47032. ---------------------------- Resolution: Won't Fix After investigating this, we found that any performance benefits from skipping sending column values from the JVM to the Python worker were obviated by extra manipulation of values on the JVM side to forward them to the output table. As a result, we are closing this. > Create API for 'analyze' method to send input column(s) to output table > unchanged > --------------------------------------------------------------------------------- > > Key: SPARK-47032 > URL: https://issues.apache.org/jira/browse/SPARK-47032 > Project: Spark > Issue Type: Sub-task > Components: PySpark > Affects Versions: 4.0.0 > Reporter: Daniel > Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org