[jira] [Assigned] (SPARK-32236) Local cluster should shutdown gracefully

[ https://issues.apache.org/jira/browse/SPARK-32236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32236: Assignee: Apache Spark (was: Kousuke Saruta) > Local cluster should shutdown gracefully

[jira] [Assigned] (SPARK-32236) Local cluster should shutdown gracefully

[ https://issues.apache.org/jira/browse/SPARK-32236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32236: Assignee: Kousuke Saruta (was: Apache Spark) > Local cluster should shutdown gracefully

[jira] [Commented] (SPARK-32236) Local cluster should shutdown gracefully

[ https://issues.apache.org/jira/browse/SPARK-32236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154148#comment-17154148 ] Apache Spark commented on SPARK-32236: -- User 'sarutak' has created a pull request for this issue:

[jira] [Created] (SPARK-32236) Local cluster should shutdown gracefully

Kousuke Saruta created SPARK-32236: -- Summary: Local cluster should shutdown gracefully Key: SPARK-32236 URL: https://issues.apache.org/jira/browse/SPARK-32236 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-32193) update docs on regexp function

[ https://issues.apache.org/jira/browse/SPARK-32193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] philipse updated SPARK-32193: - Description: Sparksql support the following usage, we may update the docs to let it known to more

[jira] [Updated] (SPARK-32193) update docs on regexp function

[ https://issues.apache.org/jira/browse/SPARK-32193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] philipse updated SPARK-32193: - Summary: update docs on regexp function (was: update migrate guide docs on regexp function) >

[jira] [Assigned] (SPARK-31723) Flaky test: org.apache.spark.deploy.history.HistoryServerSuite

[ https://issues.apache.org/jira/browse/SPARK-31723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31723: - Assignee: Zhongwei Zhu > Flaky test:

[jira] [Resolved] (SPARK-31723) Flaky test: org.apache.spark.deploy.history.HistoryServerSuite

[ https://issues.apache.org/jira/browse/SPARK-31723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31723. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28970

[jira] [Commented] (SPARK-32024) Disk usage tracker went negative in HistoryServerDiskManager

[ https://issues.apache.org/jira/browse/SPARK-32024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154092#comment-17154092 ] Apache Spark commented on SPARK-32024: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-32024) Disk usage tracker went negative in HistoryServerDiskManager

[ https://issues.apache.org/jira/browse/SPARK-32024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154091#comment-17154091 ] Apache Spark commented on SPARK-32024: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-32024) Disk usage tracker went negative in HistoryServerDiskManager

[ https://issues.apache.org/jira/browse/SPARK-32024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154085#comment-17154085 ] Apache Spark commented on SPARK-32024: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-32024) Disk usage tracker went negative in HistoryServerDiskManager

[ https://issues.apache.org/jira/browse/SPARK-32024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154086#comment-17154086 ] Apache Spark commented on SPARK-32024: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Resolved] (SPARK-32168) DSv2 SQL overwrite incorrectly uses static plan with hidden partitions

[ https://issues.apache.org/jira/browse/SPARK-32168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32168. --- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-32168) DSv2 SQL overwrite incorrectly uses static plan with hidden partitions

[ https://issues.apache.org/jira/browse/SPARK-32168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32168: - Assignee: Ryan Blue > DSv2 SQL overwrite incorrectly uses static plan with hidden

[jira] [Commented] (SPARK-32024) Disk usage tracker went negative in HistoryServerDiskManager

[ https://issues.apache.org/jira/browse/SPARK-32024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154051#comment-17154051 ] Apache Spark commented on SPARK-32024: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Updated] (SPARK-32235) Kubernetes Configuration to set Service Account to Executors

[ https://issues.apache.org/jira/browse/SPARK-32235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pedro Rossi updated SPARK-32235: Description: Some cloud providers use Service Accounts to provide resource authorization (one

[jira] [Commented] (SPARK-32024) Disk usage tracker went negative in HistoryServerDiskManager

[ https://issues.apache.org/jira/browse/SPARK-32024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154050#comment-17154050 ] Apache Spark commented on SPARK-32024: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Created] (SPARK-32235) Kubernetes Configuration to set Service Account to Executors

Pedro Rossi created SPARK-32235: --- Summary: Kubernetes Configuration to set Service Account to Executors Key: SPARK-32235 URL: https://issues.apache.org/jira/browse/SPARK-32235 Project: Spark

[jira] [Resolved] (SPARK-32233) Disable SBT unidoc generation testing in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-32233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32233. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29017

[jira] [Assigned] (SPARK-32233) Disable SBT unidoc generation testing in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-32233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32233: - Assignee: Dongjoon Hyun > Disable SBT unidoc generation testing in Jenkins >

[jira] [Commented] (SPARK-32167) nullability of GetArrayStructFields is incorrect

[ https://issues.apache.org/jira/browse/SPARK-32167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153989#comment-17153989 ] Dongjoon Hyun commented on SPARK-32167: --- This lands at branch-2.4 via

[jira] [Updated] (SPARK-32167) nullability of GetArrayStructFields is incorrect

[ https://issues.apache.org/jira/browse/SPARK-32167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32167: -- Fix Version/s: 2.4.7 > nullability of GetArrayStructFields is incorrect >

[jira] [Updated] (SPARK-32234) Spark sql commands are failing on select Queries for the orc tables

[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saurabh Chawla updated SPARK-32234: --- Description: Spark sql commands are failing on select Queries for the orc tables Steps to

[jira] [Updated] (SPARK-32234) Spark sql commands are failing on select Queries for the orc tables

[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saurabh Chawla updated SPARK-32234: --- Summary: Spark sql commands are failing on select Queries for the orc tables (was: Spark

[jira] [Commented] (SPARK-32234) Spark sql commands are failing on selecting the orc tables

[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153958#comment-17153958 ] Apache Spark commented on SPARK-32234: -- User 'SaurabhChawla100' has created a pull request for this

[jira] [Commented] (SPARK-32234) Spark sql commands are failing on selecting the orc tables

[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153953#comment-17153953 ] Saurabh Chawla commented on SPARK-32234: creating the PR for that change 

[jira] [Assigned] (SPARK-32234) Spark sql commands are failing on selecting the orc tables

[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32234: Assignee: (was: Apache Spark) > Spark sql commands are failing on selecting the orc

[jira] [Commented] (SPARK-32234) Spark sql commands are failing on selecting the orc tables

[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153954#comment-17153954 ] Apache Spark commented on SPARK-32234: -- User 'SaurabhChawla100' has created a pull request for this

[jira] [Assigned] (SPARK-32234) Spark sql commands are failing on selecting the orc tables

[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32234: Assignee: Apache Spark > Spark sql commands are failing on selecting the orc tables >

[jira] [Created] (SPARK-32234) Spark sql commands are failing on selecting the orc tables

Saurabh Chawla created SPARK-32234: -- Summary: Spark sql commands are failing on selecting the orc tables Key: SPARK-32234 URL: https://issues.apache.org/jira/browse/SPARK-32234 Project: Spark

[jira] [Resolved] (SPARK-32174) toPandas attempted Arrow optimization but has reached an error and can not continue

[ https://issues.apache.org/jira/browse/SPARK-32174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-32174. -- Resolution: Not A Problem Great, I will mark this as resolved then.  We should add the

[jira] [Commented] (SPARK-32232) IllegalArgumentException: MultilayerPerceptronClassifier_... parameter solver given invalid value auto

[ https://issues.apache.org/jira/browse/SPARK-32232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153769#comment-17153769 ] Sean R. Owen commented on SPARK-32232: -- A few more notes: the equivalent code in Scala works fine,

[jira] [Commented] (SPARK-32174) toPandas attempted Arrow optimization but has reached an error and can not continue

[ https://issues.apache.org/jira/browse/SPARK-32174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153756#comment-17153756 ] Ramin Hazegh commented on SPARK-32174: -- Thanks for the hint. Setting

[jira] [Commented] (SPARK-32227) Bug in load-spark-env.cmd with Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-32227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153734#comment-17153734 ] Apache Spark commented on SPARK-32227: -- User 'warrenzhu25' has created a pull request for this

[jira] [Assigned] (SPARK-32227) Bug in load-spark-env.cmd with Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-32227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32227: Assignee: (was: Apache Spark) > Bug in load-spark-env.cmd with Spark 3.0.0 >

[jira] [Commented] (SPARK-32227) Bug in load-spark-env.cmd with Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-32227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153732#comment-17153732 ] Apache Spark commented on SPARK-32227: -- User 'warrenzhu25' has created a pull request for this

[jira] [Assigned] (SPARK-32227) Bug in load-spark-env.cmd with Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-32227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32227: Assignee: Apache Spark > Bug in load-spark-env.cmd with Spark 3.0.0 >

[jira] [Assigned] (SPARK-32233) Disable SBT unidoc generation testing in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-32233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32233: Assignee: (was: Apache Spark) > Disable SBT unidoc generation testing in Jenkins >

[jira] [Assigned] (SPARK-32233) Disable SBT unidoc generation testing in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-32233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32233: Assignee: Apache Spark > Disable SBT unidoc generation testing in Jenkins >

[jira] [Commented] (SPARK-32233) Disable SBT unidoc generation testing in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-32233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153719#comment-17153719 ] Apache Spark commented on SPARK-32233: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-32233) Disable SBT unidoc generation testing in Jenkins

Dongjoon Hyun created SPARK-32233: - Summary: Disable SBT unidoc generation testing in Jenkins Key: SPARK-32233 URL: https://issues.apache.org/jira/browse/SPARK-32233 Project: Spark Issue

[jira] [Created] (SPARK-32232) IllegalArgumentException: MultilayerPerceptronClassifier_... parameter solver given invalid value auto

steven taylor created SPARK-32232: - Summary: IllegalArgumentException: MultilayerPerceptronClassifier_... parameter solver given invalid value auto Key: SPARK-32232 URL:

[jira] [Assigned] (SPARK-32205) Writing timestamp in mysql gets fails

[ https://issues.apache.org/jira/browse/SPARK-32205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32205: Assignee: (was: Apache Spark) > Writing timestamp in mysql gets fails >

[jira] [Assigned] (SPARK-32205) Writing timestamp in mysql gets fails

[ https://issues.apache.org/jira/browse/SPARK-32205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32205: Assignee: Apache Spark > Writing timestamp in mysql gets fails >

[jira] [Commented] (SPARK-32205) Writing timestamp in mysql gets fails

[ https://issues.apache.org/jira/browse/SPARK-32205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153712#comment-17153712 ] Apache Spark commented on SPARK-32205: -- User 'TJX2014' has created a pull request for this issue:

[jira] [Commented] (SPARK-32231) Use Hadoop 3 profile in AppVeyor SparkR build

[ https://issues.apache.org/jira/browse/SPARK-32231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153668#comment-17153668 ] Apache Spark commented on SPARK-32231: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-32231) Use Hadoop 3 profile in AppVeyor SparkR build

[ https://issues.apache.org/jira/browse/SPARK-32231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32231: Assignee: Apache Spark > Use Hadoop 3 profile in AppVeyor SparkR build >

[jira] [Assigned] (SPARK-32231) Use Hadoop 3 profile in AppVeyor SparkR build

[ https://issues.apache.org/jira/browse/SPARK-32231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32231: Assignee: Apache Spark > Use Hadoop 3 profile in AppVeyor SparkR build >

[jira] [Assigned] (SPARK-32231) Use Hadoop 3 profile in AppVeyor SparkR build

[ https://issues.apache.org/jira/browse/SPARK-32231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32231: Assignee: (was: Apache Spark) > Use Hadoop 3 profile in AppVeyor SparkR build >

[jira] [Commented] (SPARK-32230) Use Hadoop 2.7 profile in AppVeyor SparkR build

[ https://issues.apache.org/jira/browse/SPARK-32230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153637#comment-17153637 ] Apache Spark commented on SPARK-32230: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-32231) Use Hadoop 3 profile in AppVeyor SparkR build

Hyukjin Kwon created SPARK-32231: Summary: Use Hadoop 3 profile in AppVeyor SparkR build Key: SPARK-32231 URL: https://issues.apache.org/jira/browse/SPARK-32231 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-32230) Use Hadoop 2.7 profile in AppVeyor SparkR build

[ https://issues.apache.org/jira/browse/SPARK-32230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32230: Assignee: Apache Spark > Use Hadoop 2.7 profile in AppVeyor SparkR build >

[jira] [Assigned] (SPARK-32230) Use Hadoop 2.7 profile in AppVeyor SparkR build

[ https://issues.apache.org/jira/browse/SPARK-32230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32230: Assignee: (was: Apache Spark) > Use Hadoop 2.7 profile in AppVeyor SparkR build >

[jira] [Commented] (SPARK-32230) Use Hadoop 2.7 profile in AppVeyor SparkR build

[ https://issues.apache.org/jira/browse/SPARK-32230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153636#comment-17153636 ] Apache Spark commented on SPARK-32230: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-22865) Publish Official Apache Spark Docker images

[ https://issues.apache.org/jira/browse/SPARK-22865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153635#comment-17153635 ] Maciej Bryński commented on SPARK-22865: Almost 3 years later there is no official docker image.

[jira] [Created] (SPARK-32230) Use Hadoop 2.7 profile in AppVeyor SparkR build

Hyukjin Kwon created SPARK-32230: Summary: Use Hadoop 2.7 profile in AppVeyor SparkR build Key: SPARK-32230 URL: https://issues.apache.org/jira/browse/SPARK-32230 Project: Spark Issue Type:

[jira] [Commented] (SPARK-20680) Spark-sql do not support for void column datatype of view

[ https://issues.apache.org/jira/browse/SPARK-20680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153623#comment-17153623 ] Apache Spark commented on SPARK-20680: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-32024) Disk usage tracker went negative in HistoryServerDiskManager

[ https://issues.apache.org/jira/browse/SPARK-32024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-32024. -- Fix Version/s: 3.1.0 2.4.7 3.0.1 Resolution:

[jira] [Assigned] (SPARK-32024) Disk usage tracker went negative in HistoryServerDiskManager

[ https://issues.apache.org/jira/browse/SPARK-32024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-32024: Assignee: Zhen Li > Disk usage tracker went negative in HistoryServerDiskManager >

[jira] [Commented] (SPARK-32120) Single GPU is allocated multiple times

[ https://issues.apache.org/jira/browse/SPARK-32120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153579#comment-17153579 ] wuyi commented on SPARK-32120: -- oh yeah, we've documented it. Thanks for reminding. > Single GPU is

[jira] [Created] (SPARK-32229) Application entry parsing fails because DriverWrapper registered instead of the normal driver

Gabor Somogyi created SPARK-32229: - Summary: Application entry parsing fails because DriverWrapper registered instead of the normal driver Key: SPARK-32229 URL: https://issues.apache.org/jira/browse/SPARK-32229

[jira] [Created] (SPARK-32228) Partition column of hive table was capitalized while stored on HDFS

Kernel Force created SPARK-32228: Summary: Partition column of hive table was capitalized while stored on HDFS Key: SPARK-32228 URL: https://issues.apache.org/jira/browse/SPARK-32228 Project: Spark

[jira] [Updated] (SPARK-32227) Bug in load-spark-env.cmd with Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-32227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ihor Bobak updated SPARK-32227: --- Description: spark-env.cmd  which is located in conf  is not loaded by load-spark-env.cmd.   *How

[jira] [Updated] (SPARK-32227) Bug in load-spark-env.cmd with Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-32227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ihor Bobak updated SPARK-32227: --- Attachment: load-spark-env.cmd > Bug in load-spark-env.cmd with Spark 3.0.0 >

[jira] [Updated] (SPARK-32227) Bug in load-spark-env.cmd with Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-32227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ihor Bobak updated SPARK-32227: --- Description: spark-env.cmd  which is located in conf  is not loaded by load-spark-env.cmd.   *How

[jira] [Created] (SPARK-32227) Bug in load-spark-env.cmd with Spark 3.0.0

Ihor Bobak created SPARK-32227: -- Summary: Bug in load-spark-env.cmd with Spark 3.0.0 Key: SPARK-32227 URL: https://issues.apache.org/jira/browse/SPARK-32227 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-32226) JDBC TimeStamp predicates always append `.0`

Mathew Wicks created SPARK-32226: Summary: JDBC TimeStamp predicates always append `.0` Key: SPARK-32226 URL: https://issues.apache.org/jira/browse/SPARK-32226 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-32225) Parquet footer information is read twice

Rajesh Balamohan created SPARK-32225: Summary: Parquet footer information is read twice Key: SPARK-32225 URL: https://issues.apache.org/jira/browse/SPARK-32225 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32225) Parquet footer information is read twice

[ https://issues.apache.org/jira/browse/SPARK-32225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated SPARK-32225: - Attachment: spark_parquet_footer_reads.png > Parquet footer information is read twice >

[jira] [Updated] (SPARK-32225) Parquet footer information is read twice

[ https://issues.apache.org/jira/browse/SPARK-32225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated SPARK-32225: - Description: When running queries, spark reads parquet footer information twice. In

[jira] [Resolved] (SPARK-32214) The type conversion function generated in makeFromJava for "other" type uses a wrong variable.

[ https://issues.apache.org/jira/browse/SPARK-32214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32214. -- Fix Version/s: 3.1.0 3.0.1 2.4.7 Resolution:

[jira] [Commented] (SPARK-32224) Support pass 'spark.yarn.priority' through the SparkSubmit on Yarn modes

[ https://issues.apache.org/jira/browse/SPARK-32224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153357#comment-17153357 ] Apache Spark commented on SPARK-32224: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-32224) Support pass 'spark.yarn.priority' through the SparkSubmit on Yarn modes

[ https://issues.apache.org/jira/browse/SPARK-32224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32224: Assignee: Apache Spark > Support pass 'spark.yarn.priority' through the SparkSubmit on

[jira] [Assigned] (SPARK-32224) Support pass 'spark.yarn.priority' through the SparkSubmit on Yarn modes

[ https://issues.apache.org/jira/browse/SPARK-32224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32224: Assignee: (was: Apache Spark) > Support pass 'spark.yarn.priority' through the

[jira] [Updated] (SPARK-32224) Support pass 'spark.yarn.priority' through the SparkSubmit on Yarn modes

[ https://issues.apache.org/jira/browse/SPARK-32224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-32224: - Description: SPARK-29603 support configure 'spark.yarn.priority' on Yarn deploy modes, and should we

[jira] [Created] (SPARK-32224) Support pass 'spark.yarn.priority' through the SparkSubmit on Yarn modes

Yang Jie created SPARK-32224: Summary: Support pass 'spark.yarn.priority' through the SparkSubmit on Yarn modes Key: SPARK-32224 URL: https://issues.apache.org/jira/browse/SPARK-32224 Project: Spark

[jira] [Commented] (SPARK-31760) Simplification Based on Containment

[ https://issues.apache.org/jira/browse/SPARK-31760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153324#comment-17153324 ] Yuming Wang commented on SPARK-31760: - OK. Thank you [~glashenko]. > Simplification Based on

[jira] [Created] (SPARK-32223) Support adding a user provided config map.

Prashant Sharma created SPARK-32223: --- Summary: Support adding a user provided config map. Key: SPARK-32223 URL: https://issues.apache.org/jira/browse/SPARK-32223 Project: Spark Issue Type:

[jira] [Created] (SPARK-32222) Add integration tests

Prashant Sharma created SPARK-3: --- Summary: Add integration tests Key: SPARK-3 URL: https://issues.apache.org/jira/browse/SPARK-3 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-32213) saveAsTable deletes all files in path

[ https://issues.apache.org/jira/browse/SPARK-32213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153312#comment-17153312 ] angerszhu commented on SPARK-32213: --- [~yuvalr] You can review my pr and give some suggestions.   >

[jira] [Created] (SPARK-32221) Avoid possible errors due to incorrect file size or type supplied in spark conf.

Prashant Sharma created SPARK-32221: --- Summary: Avoid possible errors due to incorrect file size or type supplied in spark conf. Key: SPARK-32221 URL: https://issues.apache.org/jira/browse/SPARK-32221

[jira] [Commented] (SPARK-32213) saveAsTable deletes all files in path

[ https://issues.apache.org/jira/browse/SPARK-32213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153310#comment-17153310 ] Yuval Rochman commented on SPARK-32213: --- Agreed. > saveAsTable deletes all files in path >

[jira] [Assigned] (SPARK-32220) Cartesian Product Hint cause data error

[ https://issues.apache.org/jira/browse/SPARK-32220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32220: Assignee: (was: Apache Spark) > Cartesian Product Hint cause data error >

[jira] [Commented] (SPARK-32220) Cartesian Product Hint cause data error

[ https://issues.apache.org/jira/browse/SPARK-32220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153303#comment-17153303 ] Apache Spark commented on SPARK-32220: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-32220) Cartesian Product Hint cause data error

[ https://issues.apache.org/jira/browse/SPARK-32220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32220: Assignee: Apache Spark > Cartesian Product Hint cause data error >

[jira] [Commented] (SPARK-32219) Add SHOW CACHED TABLES Command

[ https://issues.apache.org/jira/browse/SPARK-32219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153267#comment-17153267 ] Apache Spark commented on SPARK-32219: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-32219) Add SHOW CACHED TABLES Command

[ https://issues.apache.org/jira/browse/SPARK-32219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32219: Assignee: Apache Spark > Add SHOW CACHED TABLES Command > --

[jira] [Commented] (SPARK-32219) Add SHOW CACHED TABLES Command

[ https://issues.apache.org/jira/browse/SPARK-32219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153266#comment-17153266 ] Apache Spark commented on SPARK-32219: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-32219) Add SHOW CACHED TABLES Command

[ https://issues.apache.org/jira/browse/SPARK-32219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32219: Assignee: (was: Apache Spark) > Add SHOW CACHED TABLES Command >

[jira] [Commented] (SPARK-32220) Cartesian Product Hint cause data error

[ https://issues.apache.org/jira/browse/SPARK-32220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153260#comment-17153260 ] angerszhu commented on SPARK-32220: --- raise a pr soon > Cartesian Product Hint cause data error >

[jira] [Updated] (SPARK-32220) Cartesian Product Hint cause data error

[ https://issues.apache.org/jira/browse/SPARK-32220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32220: -- Description: {code:java} spark-sql> select * from test4 order by a asc; 1 2 Time taken: 1.063

[jira] [Updated] (SPARK-32220) Cartesian Product Hint cause data error

[ https://issues.apache.org/jira/browse/SPARK-32220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32220: -- Description: {code:java} spark-sql> select * from test4 order by a asc; 1 2 Time taken: 1.063

[jira] [Updated] (SPARK-32220) Cartesian Product Hint cause data error

[ https://issues.apache.org/jira/browse/SPARK-32220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32220: -- Description: {code:java} spark-sql> select * from test1 order by a asc; 1 2 1 4 2 3 3 4 Time taken:

[jira] [Created] (SPARK-32220) Cartesian Product Hint cause data error

angerszhu created SPARK-32220: - Summary: Cartesian Product Hint cause data error Key: SPARK-32220 URL: https://issues.apache.org/jira/browse/SPARK-32220 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-32200) Redirect to the history page when accessed to /history without appliation id

[ https://issues.apache.org/jira/browse/SPARK-32200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32200: --- Affects Version/s: (was: 3.0.1) 3.0.0 > Redirect to the history

[jira] [Updated] (SPARK-32200) Redirect to the history page when accessed to /history without appliation id

[ https://issues.apache.org/jira/browse/SPARK-32200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32200: --- Affects Version/s: (was: 3.0.0) > Redirect to the history page when accessed to