[jira] [Assigned] (SPARK-32160) Executors should not be able to create SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-32160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32160: Assignee: Takuya Ueshin > Executors should not be able to create SparkContext. >

[jira] [Resolved] (SPARK-32160) Executors should not be able to create SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-32160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32160. -- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-28902) Spark ML Pipeline with nested Pipelines fails to load when saved from Python

[ https://issues.apache.org/jira/browse/SPARK-28902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17154234#comment-17154234 ] Makarov Vasiliy Nicolaevich commented on SPARK-28902: - Also have rep

[jira] [Created] (SPARK-32237) Cannot resolve column when put hint in the views of common table expression

Kernel Force created SPARK-32237: Summary: Cannot resolve column when put hint in the views of common table expression Key: SPARK-32237 URL: https://issues.apache.org/jira/browse/SPARK-32237 Project:

[jira] [Updated] (SPARK-32228) Partition column of hive table was capitalized and stored on HDFS

[ https://issues.apache.org/jira/browse/SPARK-32228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kernel Force updated SPARK-32228: - Summary: Partition column of hive table was capitalized and stored on HDFS (was: Partition colu

[jira] [Assigned] (SPARK-32236) Local cluster should shutdown gracefully

[ https://issues.apache.org/jira/browse/SPARK-32236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32236: Assignee: Apache Spark (was: Kousuke Saruta) > Local cluster should shutdown gracefully

[jira] [Assigned] (SPARK-32236) Local cluster should shutdown gracefully

[ https://issues.apache.org/jira/browse/SPARK-32236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32236: Assignee: Kousuke Saruta (was: Apache Spark) > Local cluster should shutdown gracefully

[jira] [Commented] (SPARK-32236) Local cluster should shutdown gracefully

[ https://issues.apache.org/jira/browse/SPARK-32236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17154148#comment-17154148 ] Apache Spark commented on SPARK-32236: -- User 'sarutak' has created a pull request f

[jira] [Created] (SPARK-32236) Local cluster should shutdown gracefully

Kousuke Saruta created SPARK-32236: -- Summary: Local cluster should shutdown gracefully Key: SPARK-32236 URL: https://issues.apache.org/jira/browse/SPARK-32236 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-32193) update docs on regexp function

[ https://issues.apache.org/jira/browse/SPARK-32193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] philipse updated SPARK-32193: - Description: Sparksql support the following usage, we may update the docs to let it known to more users

[jira] [Updated] (SPARK-32193) update docs on regexp function

[ https://issues.apache.org/jira/browse/SPARK-32193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] philipse updated SPARK-32193: - Summary: update docs on regexp function (was: update migrate guide docs on regexp function) > update

[jira] [Assigned] (SPARK-31723) Flaky test: org.apache.spark.deploy.history.HistoryServerSuite

[ https://issues.apache.org/jira/browse/SPARK-31723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31723: - Assignee: Zhongwei Zhu > Flaky test: org.apache.spark.deploy.history.HistoryServerSuite

[jira] [Resolved] (SPARK-31723) Flaky test: org.apache.spark.deploy.history.HistoryServerSuite

[ https://issues.apache.org/jira/browse/SPARK-31723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31723. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28970 [https://

[jira] [Commented] (SPARK-32024) Disk usage tracker went negative in HistoryServerDiskManager

[ https://issues.apache.org/jira/browse/SPARK-32024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17154092#comment-17154092 ] Apache Spark commented on SPARK-32024: -- User 'HeartSaVioR' has created a pull reque

[jira] [Commented] (SPARK-32024) Disk usage tracker went negative in HistoryServerDiskManager

[ https://issues.apache.org/jira/browse/SPARK-32024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17154091#comment-17154091 ] Apache Spark commented on SPARK-32024: -- User 'HeartSaVioR' has created a pull reque

[jira] [Commented] (SPARK-32024) Disk usage tracker went negative in HistoryServerDiskManager

[ https://issues.apache.org/jira/browse/SPARK-32024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17154085#comment-17154085 ] Apache Spark commented on SPARK-32024: -- User 'HeartSaVioR' has created a pull reque

[jira] [Commented] (SPARK-32024) Disk usage tracker went negative in HistoryServerDiskManager

[ https://issues.apache.org/jira/browse/SPARK-32024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17154086#comment-17154086 ] Apache Spark commented on SPARK-32024: -- User 'HeartSaVioR' has created a pull reque

[jira] [Resolved] (SPARK-32168) DSv2 SQL overwrite incorrectly uses static plan with hidden partitions

[ https://issues.apache.org/jira/browse/SPARK-32168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32168. --- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pul

[jira] [Assigned] (SPARK-32168) DSv2 SQL overwrite incorrectly uses static plan with hidden partitions

[ https://issues.apache.org/jira/browse/SPARK-32168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32168: - Assignee: Ryan Blue > DSv2 SQL overwrite incorrectly uses static plan with hidden parti

[jira] [Commented] (SPARK-32024) Disk usage tracker went negative in HistoryServerDiskManager

[ https://issues.apache.org/jira/browse/SPARK-32024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17154051#comment-17154051 ] Apache Spark commented on SPARK-32024: -- User 'HeartSaVioR' has created a pull reque

[jira] [Updated] (SPARK-32235) Kubernetes Configuration to set Service Account to Executors

[ https://issues.apache.org/jira/browse/SPARK-32235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pedro Rossi updated SPARK-32235: Description: Some cloud providers use Service Accounts to provide resource authorization (one exa

[jira] [Commented] (SPARK-32024) Disk usage tracker went negative in HistoryServerDiskManager

[ https://issues.apache.org/jira/browse/SPARK-32024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17154050#comment-17154050 ] Apache Spark commented on SPARK-32024: -- User 'HeartSaVioR' has created a pull reque

[jira] [Created] (SPARK-32235) Kubernetes Configuration to set Service Account to Executors

Pedro Rossi created SPARK-32235: --- Summary: Kubernetes Configuration to set Service Account to Executors Key: SPARK-32235 URL: https://issues.apache.org/jira/browse/SPARK-32235 Project: Spark I

[jira] [Resolved] (SPARK-32233) Disable SBT unidoc generation testing in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-32233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32233. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29017 [https://

[jira] [Assigned] (SPARK-32233) Disable SBT unidoc generation testing in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-32233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32233: - Assignee: Dongjoon Hyun > Disable SBT unidoc generation testing in Jenkins > --

[jira] [Commented] (SPARK-32167) nullability of GetArrayStructFields is incorrect

[ https://issues.apache.org/jira/browse/SPARK-32167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153989#comment-17153989 ] Dongjoon Hyun commented on SPARK-32167: --- This lands at branch-2.4 via https://gith

[jira] [Updated] (SPARK-32167) nullability of GetArrayStructFields is incorrect

[ https://issues.apache.org/jira/browse/SPARK-32167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32167: -- Fix Version/s: 2.4.7 > nullability of GetArrayStructFields is incorrect >

[jira] [Updated] (SPARK-32234) Spark sql commands are failing on select Queries for the orc tables

[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saurabh Chawla updated SPARK-32234: --- Description: Spark sql commands are failing on select Queries for the orc tables Steps to r

[jira] [Updated] (SPARK-32234) Spark sql commands are failing on select Queries for the orc tables

[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saurabh Chawla updated SPARK-32234: --- Summary: Spark sql commands are failing on select Queries for the orc tables (was: Spark s

[jira] [Commented] (SPARK-32234) Spark sql commands are failing on selecting the orc tables

[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153958#comment-17153958 ] Apache Spark commented on SPARK-32234: -- User 'SaurabhChawla100' has created a pull

[jira] [Commented] (SPARK-32234) Spark sql commands are failing on selecting the orc tables

[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153953#comment-17153953 ] Saurabh Chawla commented on SPARK-32234: creating the PR for that change [https:

[jira] [Assigned] (SPARK-32234) Spark sql commands are failing on selecting the orc tables

[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32234: Assignee: (was: Apache Spark) > Spark sql commands are failing on selecting the orc

[jira] [Commented] (SPARK-32234) Spark sql commands are failing on selecting the orc tables

[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153954#comment-17153954 ] Apache Spark commented on SPARK-32234: -- User 'SaurabhChawla100' has created a pull

[jira] [Assigned] (SPARK-32234) Spark sql commands are failing on selecting the orc tables

[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32234: Assignee: Apache Spark > Spark sql commands are failing on selecting the orc tables > --

[jira] [Created] (SPARK-32234) Spark sql commands are failing on selecting the orc tables

Saurabh Chawla created SPARK-32234: -- Summary: Spark sql commands are failing on selecting the orc tables Key: SPARK-32234 URL: https://issues.apache.org/jira/browse/SPARK-32234 Project: Spark

[jira] [Resolved] (SPARK-32174) toPandas attempted Arrow optimization but has reached an error and can not continue

[ https://issues.apache.org/jira/browse/SPARK-32174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-32174. -- Resolution: Not A Problem Great, I will mark this as resolved then.  We should add the configu

[jira] [Commented] (SPARK-32232) IllegalArgumentException: MultilayerPerceptronClassifier_... parameter solver given invalid value auto

[ https://issues.apache.org/jira/browse/SPARK-32232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153769#comment-17153769 ] Sean R. Owen commented on SPARK-32232: -- A few more notes: the equivalent code in Sc

[jira] [Commented] (SPARK-32174) toPandas attempted Arrow optimization but has reached an error and can not continue

[ https://issues.apache.org/jira/browse/SPARK-32174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153756#comment-17153756 ] Ramin Hazegh commented on SPARK-32174: -- Thanks for the hint. Setting {{io.netty.try

[jira] [Commented] (SPARK-32227) Bug in load-spark-env.cmd with Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-32227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153734#comment-17153734 ] Apache Spark commented on SPARK-32227: -- User 'warrenzhu25' has created a pull reque

[jira] [Assigned] (SPARK-32227) Bug in load-spark-env.cmd with Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-32227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32227: Assignee: (was: Apache Spark) > Bug in load-spark-env.cmd with Spark 3.0.0 > ---

[jira] [Commented] (SPARK-32227) Bug in load-spark-env.cmd with Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-32227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153732#comment-17153732 ] Apache Spark commented on SPARK-32227: -- User 'warrenzhu25' has created a pull reque

[jira] [Assigned] (SPARK-32227) Bug in load-spark-env.cmd with Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-32227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32227: Assignee: Apache Spark > Bug in load-spark-env.cmd with Spark 3.0.0 > --

[jira] [Assigned] (SPARK-32233) Disable SBT unidoc generation testing in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-32233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32233: Assignee: (was: Apache Spark) > Disable SBT unidoc generation testing in Jenkins > --

[jira] [Assigned] (SPARK-32233) Disable SBT unidoc generation testing in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-32233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32233: Assignee: Apache Spark > Disable SBT unidoc generation testing in Jenkins > -

[jira] [Commented] (SPARK-32233) Disable SBT unidoc generation testing in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-32233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153719#comment-17153719 ] Apache Spark commented on SPARK-32233: -- User 'dongjoon-hyun' has created a pull req

[jira] [Created] (SPARK-32233) Disable SBT unidoc generation testing in Jenkins

Dongjoon Hyun created SPARK-32233: - Summary: Disable SBT unidoc generation testing in Jenkins Key: SPARK-32233 URL: https://issues.apache.org/jira/browse/SPARK-32233 Project: Spark Issue Type

[jira] [Created] (SPARK-32232) IllegalArgumentException: MultilayerPerceptronClassifier_... parameter solver given invalid value auto

steven taylor created SPARK-32232: - Summary: IllegalArgumentException: MultilayerPerceptronClassifier_... parameter solver given invalid value auto Key: SPARK-32232 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Assigned] (SPARK-32205) Writing timestamp in mysql gets fails

[ https://issues.apache.org/jira/browse/SPARK-32205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32205: Assignee: (was: Apache Spark) > Writing timestamp in mysql gets fails >

[jira] [Assigned] (SPARK-32205) Writing timestamp in mysql gets fails

[ https://issues.apache.org/jira/browse/SPARK-32205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32205: Assignee: Apache Spark > Writing timestamp in mysql gets fails > ---

[jira] [Commented] (SPARK-32205) Writing timestamp in mysql gets fails

[ https://issues.apache.org/jira/browse/SPARK-32205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153712#comment-17153712 ] Apache Spark commented on SPARK-32205: -- User 'TJX2014' has created a pull request f

[jira] [Commented] (SPARK-32231) Use Hadoop 3 profile in AppVeyor SparkR build

[ https://issues.apache.org/jira/browse/SPARK-32231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153668#comment-17153668 ] Apache Spark commented on SPARK-32231: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-32231) Use Hadoop 3 profile in AppVeyor SparkR build

[ https://issues.apache.org/jira/browse/SPARK-32231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32231: Assignee: Apache Spark > Use Hadoop 3 profile in AppVeyor SparkR build >

[jira] [Assigned] (SPARK-32231) Use Hadoop 3 profile in AppVeyor SparkR build

[ https://issues.apache.org/jira/browse/SPARK-32231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32231: Assignee: Apache Spark > Use Hadoop 3 profile in AppVeyor SparkR build >

[jira] [Assigned] (SPARK-32231) Use Hadoop 3 profile in AppVeyor SparkR build

[ https://issues.apache.org/jira/browse/SPARK-32231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32231: Assignee: (was: Apache Spark) > Use Hadoop 3 profile in AppVeyor SparkR build > -

[jira] [Commented] (SPARK-32230) Use Hadoop 2.7 profile in AppVeyor SparkR build

[ https://issues.apache.org/jira/browse/SPARK-32230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153637#comment-17153637 ] Apache Spark commented on SPARK-32230: -- User 'HyukjinKwon' has created a pull reque

[jira] [Created] (SPARK-32231) Use Hadoop 3 profile in AppVeyor SparkR build

Hyukjin Kwon created SPARK-32231: Summary: Use Hadoop 3 profile in AppVeyor SparkR build Key: SPARK-32231 URL: https://issues.apache.org/jira/browse/SPARK-32231 Project: Spark Issue Type: Tes

[jira] [Assigned] (SPARK-32230) Use Hadoop 2.7 profile in AppVeyor SparkR build

[ https://issues.apache.org/jira/browse/SPARK-32230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32230: Assignee: Apache Spark > Use Hadoop 2.7 profile in AppVeyor SparkR build > -

[jira] [Assigned] (SPARK-32230) Use Hadoop 2.7 profile in AppVeyor SparkR build

[ https://issues.apache.org/jira/browse/SPARK-32230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32230: Assignee: (was: Apache Spark) > Use Hadoop 2.7 profile in AppVeyor SparkR build > --

[jira] [Commented] (SPARK-32230) Use Hadoop 2.7 profile in AppVeyor SparkR build

[ https://issues.apache.org/jira/browse/SPARK-32230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153636#comment-17153636 ] Apache Spark commented on SPARK-32230: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-22865) Publish Official Apache Spark Docker images

[ https://issues.apache.org/jira/browse/SPARK-22865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153635#comment-17153635 ] Maciej Bryński commented on SPARK-22865: Almost 3 years later there is no offici

[jira] [Created] (SPARK-32230) Use Hadoop 2.7 profile in AppVeyor SparkR build

Hyukjin Kwon created SPARK-32230: Summary: Use Hadoop 2.7 profile in AppVeyor SparkR build Key: SPARK-32230 URL: https://issues.apache.org/jira/browse/SPARK-32230 Project: Spark Issue Type:

[jira] [Commented] (SPARK-20680) Spark-sql do not support for void column datatype of view

[ https://issues.apache.org/jira/browse/SPARK-20680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153623#comment-17153623 ] Apache Spark commented on SPARK-20680: -- User 'HyukjinKwon' has created a pull reque

[jira] [Resolved] (SPARK-32024) Disk usage tracker went negative in HistoryServerDiskManager

[ https://issues.apache.org/jira/browse/SPARK-32024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-32024. -- Fix Version/s: 3.1.0 2.4.7 3.0.1 Resolution: Fixed

[jira] [Assigned] (SPARK-32024) Disk usage tracker went negative in HistoryServerDiskManager

[ https://issues.apache.org/jira/browse/SPARK-32024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-32024: Assignee: Zhen Li > Disk usage tracker went negative in HistoryServerDiskManager > --

[jira] [Commented] (SPARK-32120) Single GPU is allocated multiple times

[ https://issues.apache.org/jira/browse/SPARK-32120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153579#comment-17153579 ] wuyi commented on SPARK-32120: -- oh yeah, we've documented it. Thanks for reminding. > Sing

[jira] [Created] (SPARK-32229) Application entry parsing fails because DriverWrapper registered instead of the normal driver

Gabor Somogyi created SPARK-32229: - Summary: Application entry parsing fails because DriverWrapper registered instead of the normal driver Key: SPARK-32229 URL: https://issues.apache.org/jira/browse/SPARK-32229

[jira] [Created] (SPARK-32228) Partition column of hive table was capitalized while stored on HDFS

Kernel Force created SPARK-32228: Summary: Partition column of hive table was capitalized while stored on HDFS Key: SPARK-32228 URL: https://issues.apache.org/jira/browse/SPARK-32228 Project: Spark

[jira] [Updated] (SPARK-32227) Bug in load-spark-env.cmd with Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-32227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ihor Bobak updated SPARK-32227: --- Description: spark-env.cmd  which is located in conf  is not loaded by load-spark-env.cmd.   *How

[jira] [Updated] (SPARK-32227) Bug in load-spark-env.cmd with Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-32227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ihor Bobak updated SPARK-32227: --- Attachment: load-spark-env.cmd > Bug in load-spark-env.cmd with Spark 3.0.0 > -

[jira] [Updated] (SPARK-32227) Bug in load-spark-env.cmd with Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-32227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ihor Bobak updated SPARK-32227: --- Description: spark-env.cmd  which is located in conf  is not loaded by load-spark-env.cmd.   *How

[jira] [Created] (SPARK-32227) Bug in load-spark-env.cmd with Spark 3.0.0

Ihor Bobak created SPARK-32227: -- Summary: Bug in load-spark-env.cmd with Spark 3.0.0 Key: SPARK-32227 URL: https://issues.apache.org/jira/browse/SPARK-32227 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-32226) JDBC TimeStamp predicates always append `.0`

Mathew Wicks created SPARK-32226: Summary: JDBC TimeStamp predicates always append `.0` Key: SPARK-32226 URL: https://issues.apache.org/jira/browse/SPARK-32226 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-32225) Parquet footer information is read twice

Rajesh Balamohan created SPARK-32225: Summary: Parquet footer information is read twice Key: SPARK-32225 URL: https://issues.apache.org/jira/browse/SPARK-32225 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32225) Parquet footer information is read twice

[ https://issues.apache.org/jira/browse/SPARK-32225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated SPARK-32225: - Attachment: spark_parquet_footer_reads.png > Parquet footer information is read twice >

[jira] [Updated] (SPARK-32225) Parquet footer information is read twice

[ https://issues.apache.org/jira/browse/SPARK-32225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated SPARK-32225: - Description: When running queries, spark reads parquet footer information twice. In clou

[jira] [Resolved] (SPARK-32214) The type conversion function generated in makeFromJava for "other" type uses a wrong variable.

[ https://issues.apache.org/jira/browse/SPARK-32214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32214. -- Fix Version/s: 3.1.0 3.0.1 2.4.7 Resolution: Fixed

[jira] [Commented] (SPARK-32224) Support pass 'spark.yarn.priority' through the SparkSubmit on Yarn modes

[ https://issues.apache.org/jira/browse/SPARK-32224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153357#comment-17153357 ] Apache Spark commented on SPARK-32224: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-32224) Support pass 'spark.yarn.priority' through the SparkSubmit on Yarn modes

[ https://issues.apache.org/jira/browse/SPARK-32224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32224: Assignee: Apache Spark > Support pass 'spark.yarn.priority' through the SparkSubmit on Ya

[jira] [Assigned] (SPARK-32224) Support pass 'spark.yarn.priority' through the SparkSubmit on Yarn modes

[ https://issues.apache.org/jira/browse/SPARK-32224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32224: Assignee: (was: Apache Spark) > Support pass 'spark.yarn.priority' through the SparkS

[jira] [Updated] (SPARK-32224) Support pass 'spark.yarn.priority' through the SparkSubmit on Yarn modes

[ https://issues.apache.org/jira/browse/SPARK-32224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-32224: - Description: SPARK-29603 support configure 'spark.yarn.priority' on Yarn deploy modes, and should we sup

[jira] [Created] (SPARK-32224) Support pass 'spark.yarn.priority' through the SparkSubmit on Yarn modes

Yang Jie created SPARK-32224: Summary: Support pass 'spark.yarn.priority' through the SparkSubmit on Yarn modes Key: SPARK-32224 URL: https://issues.apache.org/jira/browse/SPARK-32224 Project: Spark

[jira] [Commented] (SPARK-31760) Simplification Based on Containment

[ https://issues.apache.org/jira/browse/SPARK-31760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153324#comment-17153324 ] Yuming Wang commented on SPARK-31760: - OK. Thank you [~glashenko]. > Simplification

[jira] [Created] (SPARK-32223) Support adding a user provided config map.

Prashant Sharma created SPARK-32223: --- Summary: Support adding a user provided config map. Key: SPARK-32223 URL: https://issues.apache.org/jira/browse/SPARK-32223 Project: Spark Issue Type:

[jira] [Created] (SPARK-32222) Add integration tests

Prashant Sharma created SPARK-3: --- Summary: Add integration tests Key: SPARK-3 URL: https://issues.apache.org/jira/browse/SPARK-3 Project: Spark Issue Type: Sub-task Co

[jira] [Commented] (SPARK-32213) saveAsTable deletes all files in path

[ https://issues.apache.org/jira/browse/SPARK-32213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153312#comment-17153312 ] angerszhu commented on SPARK-32213: --- [~yuvalr] You can review my pr and give some sug

[jira] [Created] (SPARK-32221) Avoid possible errors due to incorrect file size or type supplied in spark conf.

Prashant Sharma created SPARK-32221: --- Summary: Avoid possible errors due to incorrect file size or type supplied in spark conf. Key: SPARK-32221 URL: https://issues.apache.org/jira/browse/SPARK-32221

[jira] [Commented] (SPARK-32213) saveAsTable deletes all files in path

[ https://issues.apache.org/jira/browse/SPARK-32213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153310#comment-17153310 ] Yuval Rochman commented on SPARK-32213: --- Agreed. > saveAsTable deletes all files

[jira] [Assigned] (SPARK-32220) Cartesian Product Hint cause data error

[ https://issues.apache.org/jira/browse/SPARK-32220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32220: Assignee: (was: Apache Spark) > Cartesian Product Hint cause data error > ---

[jira] [Commented] (SPARK-32220) Cartesian Product Hint cause data error

[ https://issues.apache.org/jira/browse/SPARK-32220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153303#comment-17153303 ] Apache Spark commented on SPARK-32220: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-32220) Cartesian Product Hint cause data error

[ https://issues.apache.org/jira/browse/SPARK-32220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32220: Assignee: Apache Spark > Cartesian Product Hint cause data error > --