[jira] [Commented] (SPARK-43252) Assign a name to the error class _LEGACY_ERROR_TEMP_2016

[ https://issues.apache.org/jira/browse/SPARK-43252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762572#comment-17762572 ] Deng Ziming commented on SPARK-43252: - https://github.com/apache/spark/pull/42846 > Assign a name

[jira] [Commented] (SPARK-43251) Assign a name to the error class _LEGACY_ERROR_TEMP_2015

[ https://issues.apache.org/jira/browse/SPARK-43251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762571#comment-17762571 ] Deng Ziming commented on SPARK-43251: - https://github.com/apache/spark/pull/42845 > Assign a name

[jira] [Resolved] (SPARK-44845) spark job copies jars repeatedly if fs.defaultFS and application jar are same url

[ https://issues.apache.org/jira/browse/SPARK-44845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-44845. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-44845) spark job copies jars repeatedly if fs.defaultFS and application jar are same url

[ https://issues.apache.org/jira/browse/SPARK-44845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-44845: --- Assignee: zheju_he > spark job copies jars repeatedly if fs.defaultFS and

[jira] [Created] (SPARK-45097) spark delete can use parallel commit?

katty he created SPARK-45097: Summary: spark delete can use parallel commit? Key: SPARK-45097 URL: https://issues.apache.org/jira/browse/SPARK-45097 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-45095) Support spark.master.rest.host

[ https://issues.apache.org/jira/browse/SPARK-45095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45095. --- Resolution: Won't Fix This is closed because we can use `SPARK_MASTER_HOST` in K8s pod

[jira] [Closed] (SPARK-45095) Support spark.master.rest.host

[ https://issues.apache.org/jira/browse/SPARK-45095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-45095. - > Support spark.master.rest.host > -- > > Key:

[jira] [Resolved] (SPARK-45091) Function `floor/round/bround` accept Column type `scale`

[ https://issues.apache.org/jira/browse/SPARK-45091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45091. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42833

[jira] [Assigned] (SPARK-45091) Function `floor/round/bround` accept Column type `scale`

[ https://issues.apache.org/jira/browse/SPARK-45091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45091: - Assignee: Ruifeng Zheng > Function `floor/round/bround` accept Column type `scale` >

[jira] [Resolved] (SPARK-45090) DataFrame.{cube, rollup} support column ordinals

[ https://issues.apache.org/jira/browse/SPARK-45090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45090. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42832

[jira] [Assigned] (SPARK-45090) DataFrame.{cube, rollup} support column ordinals

[ https://issues.apache.org/jira/browse/SPARK-45090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45090: - Assignee: Ruifeng Zheng > DataFrame.{cube, rollup} support column ordinals >

[jira] [Assigned] (SPARK-44835) SparkConnect ReattachExecute could raise before ExecutePlan even attaches.

[ https://issues.apache.org/jira/browse/SPARK-44835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44835: Assignee: Juliusz Sompolski > SparkConnect ReattachExecute could raise before

[jira] [Resolved] (SPARK-44835) SparkConnect ReattachExecute could raise before ExecutePlan even attaches.

[ https://issues.apache.org/jira/browse/SPARK-44835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44835. -- Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-44640) Improve error messages for Python UDTF returning non iterable

[ https://issues.apache.org/jira/browse/SPARK-44640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-44640: - Fix Version/s: 3.5.1 > Improve error messages for Python UDTF returning non iterable >

[jira] [Commented] (SPARK-45096) Optimize apt-get install in Dockerfile

[ https://issues.apache.org/jira/browse/SPARK-45096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762527#comment-17762527 ] ci-cassandra.apache.org commented on SPARK-45096: - User 'zhengruifeng' has created a

[jira] [Created] (SPARK-45096) Optimize apt-get install in Dockerfile

Ruifeng Zheng created SPARK-45096: - Summary: Optimize apt-get install in Dockerfile Key: SPARK-45096 URL: https://issues.apache.org/jira/browse/SPARK-45096 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-45025) Block manager write to memory store iterator should process thread interrupt

[ https://issues.apache.org/jira/browse/SPARK-45025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-45025: Assignee: Anish Shrigondekar > Block manager write to memory store iterator should

[jira] [Resolved] (SPARK-45025) Block manager write to memory store iterator should process thread interrupt

[ https://issues.apache.org/jira/browse/SPARK-45025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-45025. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42742

[jira] [Assigned] (SPARK-45050) Improve error message for UNKNOWN io.grpc.StatusRuntimeException

[ https://issues.apache.org/jira/browse/SPARK-45050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45050: Assignee: Yihong He > Improve error message for UNKNOWN io.grpc.StatusRuntimeException >

[jira] [Resolved] (SPARK-45050) Improve error message for UNKNOWN io.grpc.StatusRuntimeException

[ https://issues.apache.org/jira/browse/SPARK-45050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45050. -- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-45050) Improve error message for UNKNOWN io.grpc.StatusRuntimeException

[ https://issues.apache.org/jira/browse/SPARK-45050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45050: - Fix Version/s: 3.5.1 (was: 3.5.0) > Improve error message for UNKNOWN

[jira] [Created] (SPARK-45095) Support spark.master.rest.host

Dongjoon Hyun created SPARK-45095: - Summary: Support spark.master.rest.host Key: SPARK-45095 URL: https://issues.apache.org/jira/browse/SPARK-45095 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-45094) isEmpty on union of RDDs sharing the same trait crash when the first RDD is empty

[ https://issues.apache.org/jira/browse/SPARK-45094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Francis Roy updated SPARK-45094: - Environment: Tested on Spark 3.2.1 and Spark 3.4.0, using Scala 2.12.17 and OpenJDK

[jira] [Created] (SPARK-45094) isEmpty on union of RDDs sharing the same trait crash when the first RDD is empty

Jean-Francis Roy created SPARK-45094: Summary: isEmpty on union of RDDs sharing the same trait crash when the first RDD is empty Key: SPARK-45094 URL: https://issues.apache.org/jira/browse/SPARK-45094

[jira] [Updated] (SPARK-45079) percentile_approx() fails with an internal error on NULL accuracy

[ https://issues.apache.org/jira/browse/SPARK-45079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-45079: - Fix Version/s: 3.3.4 > percentile_approx() fails with an internal error on NULL accuracy >

[jira] [Updated] (SPARK-45093) AddArtifacts should give proper error messages if it fails

[ https://issues.apache.org/jira/browse/SPARK-45093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alice Sayutina updated SPARK-45093: --- Description: I've been trying to do some testing of udf's using code in other module, so

[jira] [Updated] (SPARK-45093) AddArtifacts should give proper error messages if it fails

[ https://issues.apache.org/jira/browse/SPARK-45093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alice Sayutina updated SPARK-45093: --- Description: I've been trying to do some testing of udf's using code in other module, so

[jira] [Created] (SPARK-45093) AddArtifacts should give proper error messages if it fails

Alice Sayutina created SPARK-45093: -- Summary: AddArtifacts should give proper error messages if it fails Key: SPARK-45093 URL: https://issues.apache.org/jira/browse/SPARK-45093 Project: Spark

[jira] [Commented] (SPARK-43149) When CTAS with USING fails to store metadata in metastore, data gets left around

[ https://issues.apache.org/jira/browse/SPARK-43149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762387#comment-17762387 ] ming95 commented on SPARK-43149: pr:https://github.com/apache/spark/pull/42574 > When CTAS with

[jira] [Commented] (SPARK-44911) create hive table with invalid column should return error class

[ https://issues.apache.org/jira/browse/SPARK-44911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762386#comment-17762386 ] ming95 commented on SPARK-44911: https://github.com/apache/spark/pull/42609 > create hive table

[jira] [Commented] (SPARK-45041) spark using --proxy-user GSS init failed when `hive.metastore.token.signature` not empty

[ https://issues.apache.org/jira/browse/SPARK-45041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762385#comment-17762385 ] ming95 commented on SPARK-45041: https://github.com/apache/spark/pull/42760 > spark using

[jira] [Commented] (SPARK-45077) Upgrade dagre-d3.js from 0.4.3 to 0.6.4

[ https://issues.apache.org/jira/browse/SPARK-45077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762375#comment-17762375 ] Aparna Garg commented on SPARK-45077: - User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-44835) SparkConnect ReattachExecute could raise before ExecutePlan even attaches.

[ https://issues.apache.org/jira/browse/SPARK-44835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762369#comment-17762369 ] Aparna Garg commented on SPARK-44835: - User 'juliuszsompolski' has created a pull request for this

[jira] [Created] (SPARK-45092) Avoid analyze twice for failed queries

Kent Yao created SPARK-45092: Summary: Avoid analyze twice for failed queries Key: SPARK-45092 URL: https://issues.apache.org/jira/browse/SPARK-45092 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-45079) percentile_approx() fails with an internal error on NULL accuracy

[ https://issues.apache.org/jira/browse/SPARK-45079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762340#comment-17762340 ] Aparna Garg commented on SPARK-45079: - User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-45065) Support Pandas 2.1.0

[ https://issues.apache.org/jira/browse/SPARK-45065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762337#comment-17762337 ] Aparna Garg commented on SPARK-45065: - User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-45027) Hide internal functions/variables in `pyspark.sql.functions` from auto-completion

[ https://issues.apache.org/jira/browse/SPARK-45027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762335#comment-17762335 ] Aparna Garg commented on SPARK-45027: - User 'zhengruifeng' has created a pull request for this

[jira] [Updated] (SPARK-40972) OptimizeLocalShuffleReader causing data skew

[ https://issues.apache.org/jira/browse/SPARK-40972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 7mming7 updated SPARK-40972: Description: Because there are many empty files in the table, the partition num of

[jira] [Commented] (SPARK-44514) Optimize join if maximum number of rows on one side is 1

[ https://issues.apache.org/jira/browse/SPARK-44514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762333#comment-17762333 ] 7mming7 commented on SPARK-44514: - When is the plan to be able to merge？ > Optimize join if maximum

[jira] [Commented] (SPARK-45044) Refine docstring of `groupBy/rollup/cube`

[ https://issues.apache.org/jira/browse/SPARK-45044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762332#comment-17762332 ] Aparna Garg commented on SPARK-45044: - User 'panbingkun' has created a pull request for this issue:

[jira] [Commented] (SPARK-45055) Do not transpose windows if they conflict on ORDER BY / PROJECT clauses

[ https://issues.apache.org/jira/browse/SPARK-45055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762330#comment-17762330 ] Aparna Garg commented on SPARK-45055: - User 'agubichev' has created a pull request for this issue:

[jira] [Updated] (SPARK-45044) Refine docstring of `groupBy/rollup/cube`

[ https://issues.apache.org/jira/browse/SPARK-45044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-45044: Summary: Refine docstring of `groupBy/rollup/cube` (was: Refine docstring of `groupBy` `rollup`

[jira] [Updated] (SPARK-45044) Refine docstring of `groupBy` `rollup` `cube`

[ https://issues.apache.org/jira/browse/SPARK-45044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-45044: Summary: Refine docstring of `groupBy` `rollup` `cube` (was: Refine docstring of `groupBy`) >

[jira] [Created] (SPARK-45091) Function `floor/round/bround` accept Column type `scale`

Ruifeng Zheng created SPARK-45091: - Summary: Function `floor/round/bround` accept Column type `scale` Key: SPARK-45091 URL: https://issues.apache.org/jira/browse/SPARK-45091 Project: Spark

[jira] [Created] (SPARK-45090) DataFrame.{cube, rollup} support column ordinals

Ruifeng Zheng created SPARK-45090: - Summary: DataFrame.{cube, rollup} support column ordinals Key: SPARK-45090 URL: https://issues.apache.org/jira/browse/SPARK-45090 Project: Spark Issue

[jira] [Resolved] (SPARK-45079) percentile_approx() fails with an internal error on NULL accuracy

[ https://issues.apache.org/jira/browse/SPARK-45079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-45079. -- Fix Version/s: 3.5.0 4.0.0 3.4.2 Resolution: Fixed Issue

[jira] [Commented] (SPARK-44805) Data lost after union using spark.sql.parquet.enableNestedColumnVectorizedReader=true

[ https://issues.apache.org/jira/browse/SPARK-44805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762295#comment-17762295 ] Jakub Wozniak commented on SPARK-44805: --- Would be great, thanks!  > Data lost after union using