[jira] [Commented] (SPARK-41316) Add @tailrec wherever possible

[ https://issues.apache.org/jira/browse/SPARK-41316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640446#comment-17640446 ] Apache Spark commented on SPARK-41316: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-41316) Add @tailrec wherever possible

[ https://issues.apache.org/jira/browse/SPARK-41316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41316: Assignee: Apache Spark > Add @tailrec wherever possible > --

[jira] [Assigned] (SPARK-41316) Add @tailrec wherever possible

[ https://issues.apache.org/jira/browse/SPARK-41316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41316: Assignee: (was: Apache Spark) > Add @tailrec wherever possible >

[jira] [Commented] (SPARK-41317) PySpark write API for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640443#comment-17640443 ] Apache Spark commented on SPARK-41317: -- User 'grundprinzip' has created a pull request for this

[jira] [Assigned] (SPARK-41317) PySpark write API for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41317: Assignee: (was: Apache Spark) > PySpark write API for Spark Connect >

[jira] [Assigned] (SPARK-41317) PySpark write API for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41317: Assignee: Apache Spark > PySpark write API for Spark Connect >

[jira] [Updated] (SPARK-41317) PySpark write API for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-41317: - Summary: PySpark write API for Spark Connect (was: PySpark read API for Spark Connect) >

[jira] [Updated] (SPARK-40539) PySpark read API parity for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-40539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40539: - Summary: PySpark read API parity for Spark Connect (was: PySpark readwriter API parity for

[jira] (SPARK-40539) PySpark read API parity for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-40539 ] Hyukjin Kwon deleted comment on SPARK-40539: -- was (Author: apachespark): User 'grundprinzip' has created a pull request for this issue: https://github.com/apache/spark/pull/38801 > PySpark

[jira] [Created] (SPARK-41317) PySpark read API for Spark Connect

Hyukjin Kwon created SPARK-41317: Summary: PySpark read API for Spark Connect Key: SPARK-41317 URL: https://issues.apache.org/jira/browse/SPARK-41317 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41315) Implement `DataFrame.replace ` and `DataFrame.na.replace `

Ruifeng Zheng created SPARK-41315: - Summary: Implement `DataFrame.replace ` and `DataFrame.na.replace ` Key: SPARK-41315 URL: https://issues.apache.org/jira/browse/SPARK-41315 Project: Spark

[jira] [Created] (SPARK-41316) Add @tailrec wherever possible

Yang Jie created SPARK-41316: Summary: Add @tailrec wherever possible Key: SPARK-41316 URL: https://issues.apache.org/jira/browse/SPARK-41316 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-41312) Implement DataFrame.withColumnRenamed

[ https://issues.apache.org/jira/browse/SPARK-41312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41312. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38831

[jira] [Resolved] (SPARK-41260) Cast NumPy instances to Python primitive types in GroupState update

[ https://issues.apache.org/jira/browse/SPARK-41260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-41260. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38796

[jira] [Assigned] (SPARK-41260) Cast NumPy instances to Python primitive types in GroupState update

[ https://issues.apache.org/jira/browse/SPARK-41260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-41260: Assignee: Hyukjin Kwon > Cast NumPy instances to Python primitive types in GroupState

[jira] [Resolved] (SPARK-41264) Make Literal support more datatypes

[ https://issues.apache.org/jira/browse/SPARK-41264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41264. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38800

[jira] [Commented] (SPARK-21138) Cannot delete staging dir when the clusters of "spark.yarn.stagingDir" and "spark.hadoop.fs.defaultFS" are different

[ https://issues.apache.org/jira/browse/SPARK-21138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640406#comment-17640406 ] Apache Spark commented on SPARK-21138: -- User 'xinglin' has created a pull request for this issue:

[jira] [Commented] (SPARK-21138) Cannot delete staging dir when the clusters of "spark.yarn.stagingDir" and "spark.hadoop.fs.defaultFS" are different

[ https://issues.apache.org/jira/browse/SPARK-21138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640404#comment-17640404 ] Apache Spark commented on SPARK-21138: -- User 'xinglin' has created a pull request for this issue:

[jira] [Commented] (SPARK-3900) ApplicationMaster's shutdown hook fails and IllegalStateException is thrown.

[ https://issues.apache.org/jira/browse/SPARK-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640402#comment-17640402 ] Apache Spark commented on SPARK-3900: - User 'xinglin' has created a pull request for this issue:

[jira] [Commented] (SPARK-21138) Cannot delete staging dir when the clusters of "spark.yarn.stagingDir" and "spark.hadoop.fs.defaultFS" are different

[ https://issues.apache.org/jira/browse/SPARK-21138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640403#comment-17640403 ] Apache Spark commented on SPARK-21138: -- User 'xinglin' has created a pull request for this issue:

[jira] [Commented] (SPARK-21138) Cannot delete staging dir when the clusters of "spark.yarn.stagingDir" and "spark.hadoop.fs.defaultFS" are different

[ https://issues.apache.org/jira/browse/SPARK-21138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640405#comment-17640405 ] Apache Spark commented on SPARK-21138: -- User 'xinglin' has created a pull request for this issue:

[jira] [Commented] (SPARK-3900) ApplicationMaster's shutdown hook fails and IllegalStateException is thrown.

[ https://issues.apache.org/jira/browse/SPARK-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640400#comment-17640400 ] Apache Spark commented on SPARK-3900: - User 'xinglin' has created a pull request for this issue:

[jira] [Commented] (SPARK-3900) ApplicationMaster's shutdown hook fails and IllegalStateException is thrown.

[ https://issues.apache.org/jira/browse/SPARK-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640401#comment-17640401 ] Apache Spark commented on SPARK-3900: - User 'xinglin' has created a pull request for this issue:

[jira] [Commented] (SPARK-41313) Combine fixes for SPARK-3900 and SPARK-21138

[ https://issues.apache.org/jira/browse/SPARK-41313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640399#comment-17640399 ] Apache Spark commented on SPARK-41313: -- User 'xinglin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41313) Combine fixes for SPARK-3900 and SPARK-21138

[ https://issues.apache.org/jira/browse/SPARK-41313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41313: Assignee: (was: Apache Spark) > Combine fixes for SPARK-3900 and SPARK-21138 >

[jira] [Assigned] (SPARK-41313) Combine fixes for SPARK-3900 and SPARK-21138

[ https://issues.apache.org/jira/browse/SPARK-41313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41313: Assignee: Apache Spark > Combine fixes for SPARK-3900 and SPARK-21138 >

[jira] [Commented] (SPARK-41313) Combine fixes for SPARK-3900 and SPARK-21138

[ https://issues.apache.org/jira/browse/SPARK-41313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640398#comment-17640398 ] Apache Spark commented on SPARK-41313: -- User 'xinglin' has created a pull request for this issue:

[jira] [Updated] (SPARK-41312) Implement DataFrame.withColumnRenamed

[ https://issues.apache.org/jira/browse/SPARK-41312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-41312: - Priority: Critical (was: Major) > Implement DataFrame.withColumnRenamed >

[jira] [Assigned] (SPARK-41312) Implement DataFrame.withColumnRenamed

[ https://issues.apache.org/jira/browse/SPARK-41312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41312: Assignee: Rui Wang (was: Apache Spark) > Implement DataFrame.withColumnRenamed >

[jira] [Assigned] (SPARK-41312) Implement DataFrame.withColumnRenamed

[ https://issues.apache.org/jira/browse/SPARK-41312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41312: Assignee: Apache Spark (was: Rui Wang) > Implement DataFrame.withColumnRenamed >

[jira] [Commented] (SPARK-41312) Implement DataFrame.withColumnRenamed

[ https://issues.apache.org/jira/browse/SPARK-41312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640392#comment-17640392 ] Apache Spark commented on SPARK-41312: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-41312) Implement DataFrame.withColumnRenamed

[ https://issues.apache.org/jira/browse/SPARK-41312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640391#comment-17640391 ] Apache Spark commented on SPARK-41312: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Resolved] (SPARK-41148) Implement `DataFrame.dropna ` and `DataFrame.na.drop `

[ https://issues.apache.org/jira/browse/SPARK-41148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41148. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38819

[jira] [Updated] (SPARK-41313) Combine fixes for SPARK-3900 and SPARK-21138

[ https://issues.apache.org/jira/browse/SPARK-41313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xing Lin updated SPARK-41313: - Description: spark-3900 fixed the illegalStateException in cleanupStagingDir in ApplicationMaster's

[jira] [Updated] (SPARK-41313) Combine fixes for SPARK-3900 and SPARK-21138

[ https://issues.apache.org/jira/browse/SPARK-41313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xing Lin updated SPARK-41313: - Description: spark-3900 fixed the illegalStateException in cleanupStagingDir in ApplicationMaster's

[jira] [Created] (SPARK-41314) Assign a name to the error class _LEGACY_ERROR_TEMP_1094

Yang Jie created SPARK-41314: Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_1094 Key: SPARK-41314 URL: https://issues.apache.org/jira/browse/SPARK-41314 Project: Spark Issue Type:

[jira] [Updated] (SPARK-41313) Combine fixes for SPARK-3900 and SPARK-21138

[ https://issues.apache.org/jira/browse/SPARK-41313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xing Lin updated SPARK-41313: - Summary: Combine fixes for SPARK-3900 and SPARK-21138 (was: Combine fix for SPARK-3900 and

[jira] [Created] (SPARK-41313) Combine fix for SPARK-3900 and SPARK-21138

Xing Lin created SPARK-41313: Summary: Combine fix for SPARK-3900 and SPARK-21138 Key: SPARK-41313 URL: https://issues.apache.org/jira/browse/SPARK-41313 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-41311) Rewrite test RENAME_SRC_PATH_NOT_FOUND to trigger the error from user space

[ https://issues.apache.org/jira/browse/SPARK-41311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Immanuel Buder updated SPARK-41311: --- Description: Rewrite the test for error class *RENAME_SRC_PATH_NOT_FOUND* in

[jira] [Updated] (SPARK-41311) Rewrite test RENAME_SRC_PATH_NOT_FOUND to trigger the error from user space

[ https://issues.apache.org/jira/browse/SPARK-41311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Immanuel Buder updated SPARK-41311: --- Description: Rewrite the test for error class *RENAME_SRC_PATH_NOT_FOUND* in

[jira] [Updated] (SPARK-41311) Rewrite test RENAME_SRC_PATH_NOT_FOUND to trigger the error from user space

[ https://issues.apache.org/jira/browse/SPARK-41311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Immanuel Buder updated SPARK-41311: --- Description: Rewrite the test for error class *RENAME_SRC_PATH_NOT_FOUND* to trigger the

[jira] [Commented] (SPARK-41309) Assign a name to the error class _LEGACY_ERROR_TEMP_1093

[ https://issues.apache.org/jira/browse/SPARK-41309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640384#comment-17640384 ] Apache Spark commented on SPARK-41309: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-41309) Assign a name to the error class _LEGACY_ERROR_TEMP_1093

[ https://issues.apache.org/jira/browse/SPARK-41309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640383#comment-17640383 ] Apache Spark commented on SPARK-41309: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-41309) Assign a name to the error class _LEGACY_ERROR_TEMP_1093

[ https://issues.apache.org/jira/browse/SPARK-41309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41309: Assignee: Apache Spark > Assign a name to the error class _LEGACY_ERROR_TEMP_1093 >

[jira] [Assigned] (SPARK-41309) Assign a name to the error class _LEGACY_ERROR_TEMP_1093

[ https://issues.apache.org/jira/browse/SPARK-41309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41309: Assignee: (was: Apache Spark) > Assign a name to the error class

[jira] [Created] (SPARK-41312) Implement DataFrame.withColumnRenamed

Rui Wang created SPARK-41312: Summary: Implement DataFrame.withColumnRenamed Key: SPARK-41312 URL: https://issues.apache.org/jira/browse/SPARK-41312 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41311) Rewrite test RENAME_SRC_PATH_NOT_FOUND to trigger the error from user space

Immanuel Buder created SPARK-41311: -- Summary: Rewrite test RENAME_SRC_PATH_NOT_FOUND to trigger the error from user space Key: SPARK-41311 URL: https://issues.apache.org/jira/browse/SPARK-41311

[jira] [Commented] (SPARK-41310) Implement DataFrame.toDF

[ https://issues.apache.org/jira/browse/SPARK-41310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640379#comment-17640379 ] Apache Spark commented on SPARK-41310: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41310) Implement DataFrame.toDF

[ https://issues.apache.org/jira/browse/SPARK-41310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41310: Assignee: Apache Spark (was: Rui Wang) > Implement DataFrame.toDF >

[jira] [Assigned] (SPARK-41310) Implement DataFrame.toDF

[ https://issues.apache.org/jira/browse/SPARK-41310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41310: Assignee: Rui Wang (was: Apache Spark) > Implement DataFrame.toDF >

[jira] [Created] (SPARK-41310) Implement DataFrame.toDF

Rui Wang created SPARK-41310: Summary: Implement DataFrame.toDF Key: SPARK-41310 URL: https://issues.apache.org/jira/browse/SPARK-41310 Project: Spark Issue Type: Sub-task Components:

[jira] [Resolved] (SPARK-41308) Improve `DataFrame.count()`

[ https://issues.apache.org/jira/browse/SPARK-41308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41308. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38827

[jira] [Created] (SPARK-41309) Assign a name to the error class _LEGACY_ERROR_TEMP_1093

Yang Jie created SPARK-41309: Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_1093 Key: SPARK-41309 URL: https://issues.apache.org/jira/browse/SPARK-41309 Project: Spark Issue Type:

[jira] [Commented] (SPARK-41299) OOM when filter pushdown `last_day` function

[ https://issues.apache.org/jira/browse/SPARK-41299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640347#comment-17640347 ] Yuming Wang commented on SPARK-41299: - Do you have the query plan? > OOM when filter pushdown

[jira] [Resolved] (SPARK-41304) Add missing docs for DataFrame API

[ https://issues.apache.org/jira/browse/SPARK-41304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41304. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38824

[jira] [Resolved] (SPARK-41306) Improve Connect Expression proto documentation

[ https://issues.apache.org/jira/browse/SPARK-41306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41306. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38825

[jira] [Comment Edited] (SPARK-39674) Initial protobuf definition for Spark Connect API

[ https://issues.apache.org/jira/browse/SPARK-39674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17639798#comment-17639798 ] Hyukjin Kwon edited comment on SPARK-39674 at 11/29/22 12:44 AM: - This

[jira] [Commented] (SPARK-35084) [k8s] On Spark 3, jars listed in spark.jars and spark.jars.packages are not added to sparkContext

[ https://issues.apache.org/jira/browse/SPARK-35084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640310#comment-17640310 ] Apache Spark commented on SPARK-35084: -- User 'ocworld' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41308) Improve `DataFrame.count()`

[ https://issues.apache.org/jira/browse/SPARK-41308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41308: Assignee: Rui Wang (was: Apache Spark) > Improve `DataFrame.count()` >

[jira] [Commented] (SPARK-41308) Improve `DataFrame.count()`

[ https://issues.apache.org/jira/browse/SPARK-41308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640309#comment-17640309 ] Apache Spark commented on SPARK-41308: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41308) Improve `DataFrame.count()`

[ https://issues.apache.org/jira/browse/SPARK-41308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41308: Assignee: Apache Spark (was: Rui Wang) > Improve `DataFrame.count()` >

[jira] [Commented] (SPARK-41241) Use Hive and Spark SQL to modify table field comment, the modified results of Hive cannot be queried using Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-41241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640305#comment-17640305 ] Erik Krogen commented on SPARK-41241: - I think, as a general rule, it's not safe to modify Spark

[jira] [Created] (SPARK-41308) Improve `DataFrame.count()`

Rui Wang created SPARK-41308: Summary: Improve `DataFrame.count()` Key: SPARK-41308 URL: https://issues.apache.org/jira/browse/SPARK-41308 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-41227) Implement DataFrame cross join

[ https://issues.apache.org/jira/browse/SPARK-41227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-41227: - Description: Implement DataFrame cross join for Spark Connect. That consists of -

[jira] [Updated] (SPARK-41227) Implement DataFrame cross join

[ https://issues.apache.org/jira/browse/SPARK-41227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-41227: - Summary: Implement DataFrame cross join (was: Implement `DataFrame.crossJoin`) > Implement

[jira] [Updated] (SPARK-41227) Implement DataFrame cross join

[ https://issues.apache.org/jira/browse/SPARK-41227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-41227: - Description: Implement DataFrame cross join for Spark Connect. That consists of -

[jira] [Commented] (SPARK-41297) Support string sql expressions in DF.where()

[ https://issues.apache.org/jira/browse/SPARK-41297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640282#comment-17640282 ] Apache Spark commented on SPARK-41297: -- User 'grundprinzip' has created a pull request for this

[jira] [Assigned] (SPARK-41297) Support string sql expressions in DF.where()

[ https://issues.apache.org/jira/browse/SPARK-41297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41297: Assignee: Martin Grund (was: Apache Spark) > Support string sql expressions in

[jira] [Assigned] (SPARK-41297) Support string sql expressions in DF.where()

[ https://issues.apache.org/jira/browse/SPARK-41297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41297: Assignee: Apache Spark (was: Martin Grund) > Support string sql expressions in

[jira] [Commented] (SPARK-41297) Support string sql expressions in DF.where()

[ https://issues.apache.org/jira/browse/SPARK-41297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640281#comment-17640281 ] Apache Spark commented on SPARK-41297: -- User 'grundprinzip' has created a pull request for this

[jira] [Assigned] (SPARK-41297) Support string sql expressions in DF.where()

[ https://issues.apache.org/jira/browse/SPARK-41297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Grund reassigned SPARK-41297: Assignee: Martin Grund > Support string sql expressions in DF.where() >

[jira] [Updated] (SPARK-41197) Upgrade Kafka to 3.3.1

[ https://issues.apache.org/jira/browse/SPARK-41197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41197: -- Priority: Major (was: Minor) > Upgrade Kafka to 3.3.1 > -- > >

[jira] [Updated] (SPARK-41197) Upgrade Kafka to 3.3.1

[ https://issues.apache.org/jira/browse/SPARK-41197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41197: -- Affects Version/s: 3.4.0 (was: 3.3.1) > Upgrade Kafka to 3.3.1 >

[jira] [Assigned] (SPARK-41197) Upgrade Kafka version to 3.3 release

[ https://issues.apache.org/jira/browse/SPARK-41197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41197: - Assignee: Ted Yu > Upgrade Kafka version to 3.3 release >

[jira] [Updated] (SPARK-41197) Upgrade Kafka to 3.3.1

[ https://issues.apache.org/jira/browse/SPARK-41197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41197: -- Component/s: Build (was: Java API) > Upgrade Kafka to 3.3.1 >

[jira] [Updated] (SPARK-41197) Upgrade Kafka to 3.3.1

[ https://issues.apache.org/jira/browse/SPARK-41197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41197: -- Summary: Upgrade Kafka to 3.3.1 (was: Upgrade Kafka version to 3.3 release) > Upgrade Kafka

[jira] [Resolved] (SPARK-41197) Upgrade Kafka version to 3.3 release

[ https://issues.apache.org/jira/browse/SPARK-41197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41197. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38715

[jira] [Assigned] (SPARK-41306) Improve Connect Expression proto documentation

[ https://issues.apache.org/jira/browse/SPARK-41306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41306: Assignee: Rui Wang (was: Apache Spark) > Improve Connect Expression proto documentation

[jira] [Commented] (SPARK-41306) Improve Connect Expression proto documentation

[ https://issues.apache.org/jira/browse/SPARK-41306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640254#comment-17640254 ] Apache Spark commented on SPARK-41306: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-41306) Improve Connect Expression proto documentation

[ https://issues.apache.org/jira/browse/SPARK-41306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640253#comment-17640253 ] Apache Spark commented on SPARK-41306: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41306) Improve Connect Expression proto documentation

[ https://issues.apache.org/jira/browse/SPARK-41306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41306: Assignee: Apache Spark (was: Rui Wang) > Improve Connect Expression proto documentation

[jira] [Commented] (SPARK-41185) YuniKorn on ARM incorrectly documented as not supported

[ https://issues.apache.org/jira/browse/SPARK-41185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640252#comment-17640252 ] Dongjoon Hyun commented on SPARK-41185: --- Thank you, [~wilfreds], [~hyukjin.kwon], [~yikunkero] >

[jira] [Updated] (SPARK-41185) Remove ARM limitation for YuniKorn from docs

[ https://issues.apache.org/jira/browse/SPARK-41185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41185: -- Summary: Remove ARM limitation for YuniKorn from docs (was: YuniKorn on ARM incorrectly

[jira] [Updated] (SPARK-41185) YuniKorn on ARM incorrectly documented as not supported

[ https://issues.apache.org/jira/browse/SPARK-41185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41185: -- Priority: Minor (was: Major) > YuniKorn on ARM incorrectly documented as not supported >

[jira] [Created] (SPARK-41307) Improve Connect Expression proto documentation

Rui Wang created SPARK-41307: Summary: Improve Connect Expression proto documentation Key: SPARK-41307 URL: https://issues.apache.org/jira/browse/SPARK-41307 Project: Spark Issue Type: Sub-task

[jira] [Deleted] (SPARK-41307) Improve Connect Expression proto documentation

[ https://issues.apache.org/jira/browse/SPARK-41307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang deleted SPARK-41307: - > Improve Connect Expression proto documentation > -- > >

[jira] [Updated] (SPARK-41185) YuniKorn on ARM incorrectly documented as not supported

[ https://issues.apache.org/jira/browse/SPARK-41185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41185: -- Fix Version/s: (was: 3.4.0) > YuniKorn on ARM incorrectly documented as not supported >

[jira] [Assigned] (SPARK-41185) YuniKorn on ARM incorrectly documented as not supported

[ https://issues.apache.org/jira/browse/SPARK-41185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41185: - Assignee: Wilfred Spiegelenburg > YuniKorn on ARM incorrectly documented as not

[jira] [Resolved] (SPARK-41185) YuniKorn on ARM incorrectly documented as not supported

[ https://issues.apache.org/jira/browse/SPARK-41185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41185. --- Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Issue resolved by

[jira] [Created] (SPARK-41306) Improve Connect Expression proto documentation

Rui Wang created SPARK-41306: Summary: Improve Connect Expression proto documentation Key: SPARK-41306 URL: https://issues.apache.org/jira/browse/SPARK-41306 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41305) Connect Proto Completeness

Rui Wang created SPARK-41305: Summary: Connect Proto Completeness Key: SPARK-41305 URL: https://issues.apache.org/jira/browse/SPARK-41305 Project: Spark Issue Type: Umbrella

[jira] [Assigned] (SPARK-41304) Add missing docs for DataFrame API

[ https://issues.apache.org/jira/browse/SPARK-41304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41304: Assignee: Apache Spark (was: Rui Wang) > Add missing docs for DataFrame API >

[jira] [Assigned] (SPARK-41304) Add missing docs for DataFrame API

[ https://issues.apache.org/jira/browse/SPARK-41304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41304: Assignee: Rui Wang (was: Apache Spark) > Add missing docs for DataFrame API >

[jira] [Commented] (SPARK-41304) Add missing docs for DataFrame API

[ https://issues.apache.org/jira/browse/SPARK-41304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640246#comment-17640246 ] Apache Spark commented on SPARK-41304: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Created] (SPARK-41304) Add missing docs for DataFrame API

Rui Wang created SPARK-41304: Summary: Add missing docs for DataFrame API Key: SPARK-41304 URL: https://issues.apache.org/jira/browse/SPARK-41304 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-27561) Support "lateral column alias references" to allow column aliases to be used within SELECT clauses

[ https://issues.apache.org/jira/browse/SPARK-27561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640214#comment-17640214 ] Apache Spark commented on SPARK-27561: -- User 'anchovYu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-27561) Support "lateral column alias references" to allow column aliases to be used within SELECT clauses

[ https://issues.apache.org/jira/browse/SPARK-27561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27561: Assignee: Apache Spark > Support "lateral column alias references" to allow column

[jira] [Assigned] (SPARK-27561) Support "lateral column alias references" to allow column aliases to be used within SELECT clauses

[ https://issues.apache.org/jira/browse/SPARK-27561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27561: Assignee: (was: Apache Spark) > Support "lateral column alias references" to allow

[jira] [Commented] (SPARK-27561) Support "lateral column alias references" to allow column aliases to be used within SELECT clauses

[ https://issues.apache.org/jira/browse/SPARK-27561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640215#comment-17640215 ] Apache Spark commented on SPARK-27561: -- User 'anchovYu' has created a pull request for this issue:

[jira] [Resolved] (SPARK-41301) SparkSession.range should treat end as optional

[ https://issues.apache.org/jira/browse/SPARK-41301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-41301. --- Fix Version/s: 3.4.0 Assignee: Martin Grund Resolution: Fixed >

  1   2   >