[jira] [Commented] (SPARK-40737) Add basic support for DataFrameWriter

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618659#comment-17618659 ] Apache Spark commented on SPARK-40737: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-40790) Check error classes in DDL parsing tests

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40790: Assignee: (was: Apache Spark) > Check error classes in DDL parsing tests >

[jira] [Assigned] (SPARK-40790) Check error classes in DDL parsing tests

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40790: Assignee: Apache Spark > Check error classes in DDL parsing tests >

[jira] [Commented] (SPARK-40790) Check error classes in DDL parsing tests

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618657#comment-17618657 ] Apache Spark commented on SPARK-40790: -- User 'panbingkun' has created a pull request for this

[jira] [Updated] (SPARK-40790) Check error classes in DDL parsing tests

2022-10-16 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-40790: Description: Check error classes in DDL command tests by using checkError(). For instance -

[jira] [Assigned] (SPARK-40816) Python: rename LogicalPlan.collect to LogicalPlan.to_proto

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40816: Assignee: Apache Spark > Python: rename LogicalPlan.collect to LogicalPlan.to_proto >

[jira] [Commented] (SPARK-40816) Python: rename LogicalPlan.collect to LogicalPlan.to_proto

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618421#comment-17618421 ] Apache Spark commented on SPARK-40816: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40816) Python: rename LogicalPlan.collect to LogicalPlan.to_proto

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40816: Assignee: (was: Apache Spark) > Python: rename LogicalPlan.collect to

[jira] [Created] (SPARK-40816) Python: rename LogicalPlan.collect to LogicalPlan.to_proto

2022-10-16 Thread Rui Wang (Jira)
Rui Wang created SPARK-40816: Summary: Python: rename LogicalPlan.collect to LogicalPlan.to_proto Key: SPARK-40816 URL: https://issues.apache.org/jira/browse/SPARK-40816 Project: Spark Issue

[jira] [Commented] (SPARK-40780) Add WHERE to Connect proto and DSL

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618410#comment-17618410 ] Apache Spark commented on SPARK-40780: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-40780) Add WHERE to Connect proto and DSL

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618411#comment-17618411 ] Apache Spark commented on SPARK-40780: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-40809) Add as(alias: String) to connect DSL

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618408#comment-17618408 ] Apache Spark commented on SPARK-40809: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-40815) SymlinkTextInputFormat returns incorrect result due to enabled spark.hadoopRDD.ignoreEmptySplits

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618397#comment-17618397 ] Apache Spark commented on SPARK-40815: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40815) SymlinkTextInputFormat returns incorrect result due to enabled spark.hadoopRDD.ignoreEmptySplits

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40815: Assignee: Apache Spark > SymlinkTextInputFormat returns incorrect result due to enabled

[jira] [Commented] (SPARK-40815) SymlinkTextInputFormat returns incorrect result due to enabled spark.hadoopRDD.ignoreEmptySplits

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618398#comment-17618398 ] Apache Spark commented on SPARK-40815: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40815) SymlinkTextInputFormat returns incorrect result due to enabled spark.hadoopRDD.ignoreEmptySplits

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40815: Assignee: (was: Apache Spark) > SymlinkTextInputFormat returns incorrect result due

[jira] [Created] (SPARK-40815) SymlinkTextInputFormat returns incorrect result due to enabled spark.hadoopRDD.ignoreEmptySplits

2022-10-16 Thread Ivan Sadikov (Jira)
Ivan Sadikov created SPARK-40815: Summary: SymlinkTextInputFormat returns incorrect result due to enabled spark.hadoopRDD.ignoreEmptySplits Key: SPARK-40815 URL: https://issues.apache.org/jira/browse/SPARK-40815

[jira] [Commented] (SPARK-40802) Enhance JDBC Connector to use PreparedStatement.getMetaData() to resolve schema instead of PreparedStatement.executeQuery()

2022-10-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618389#comment-17618389 ] Hyukjin Kwon commented on SPARK-40802: -- I guess the problem is that {{getMetaData}} doesn't

[jira] [Updated] (SPARK-40802) Enhance JDBC Connector to use PreparedStatement.getMetaData() to resolve schema instead of PreparedStatement.executeQuery()

2022-10-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40802: - Summary: Enhance JDBC Connector to use PreparedStatement.getMetaData() to resolve schema

[jira] [Updated] (SPARK-40808) Infer schema for CSV files - wrong behavior using header + merge schema

2022-10-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40808: - Component/s: SQL (was: Spark Core) > Infer schema for CSV files - wrong

[jira] [Commented] (SPARK-40808) Infer schema for CSV files - wrong behavior using header + merge schema

2022-10-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618388#comment-17618388 ] Hyukjin Kwon commented on SPARK-40808: -- Yeah reproducer would be helpful to assess this ticket

[jira] [Commented] (SPARK-40814) Exception in thread "main" java.lang.NoClassDefFoundError: io/fabric8/kubernetes/client/KubernetesClient

2022-10-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618386#comment-17618386 ] Hyukjin Kwon commented on SPARK-40814: -- Spark 2.4.x is EOL. Mind trying if the same issue persists

[jira] [Updated] (SPARK-40790) Check error classes in DDL parsing tests

2022-10-16 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-40790: Description: Check error classes in DDL command tests by using checkError(). For instance -

[jira] [Updated] (SPARK-40814) Exception in thread "main" java.lang.NoClassDefFoundError: io/fabric8/kubernetes/client/KubernetesClient

2022-10-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40814: - Priority: Major (was: Blocker) > Exception in thread "main" java.lang.NoClassDefFoundError: >

[jira] [Updated] (SPARK-40814) Exception in thread "main" java.lang.NoClassDefFoundError: io/fabric8/kubernetes/client/KubernetesClient

2022-10-16 Thread jiangjian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangjian updated SPARK-40814: -- Priority: Blocker (was: Major) > Exception in thread "main" java.lang.NoClassDefFoundError: >

[jira] [Updated] (SPARK-40814) Exception in thread "main" java.lang.NoClassDefFoundError: io/fabric8/kubernetes/client/KubernetesClient

2022-10-16 Thread jiangjian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangjian updated SPARK-40814: -- Component/s: Spark Submit > Exception in thread "main" java.lang.NoClassDefFoundError: >

[jira] [Updated] (SPARK-40814) Exception in thread "main" java.lang.NoClassDefFoundError: io/fabric8/kubernetes/client/KubernetesClient

2022-10-16 Thread jiangjian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangjian updated SPARK-40814: -- Attachment: Dockerfile > Exception in thread "main" java.lang.NoClassDefFoundError: >

[jira] [Updated] (SPARK-40814) Exception in thread "main" java.lang.NoClassDefFoundError: io/fabric8/kubernetes/client/KubernetesClient

2022-10-16 Thread jiangjian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangjian updated SPARK-40814: -- Environment: k8s version: v1.18.9 spark version: v2.4.0 kubernetes-client:v6.1.1 was: k8s

[jira] [Updated] (SPARK-40814) Exception in thread "main" java.lang.NoClassDefFoundError: io/fabric8/kubernetes/client/KubernetesClient

2022-10-16 Thread jiangjian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangjian updated SPARK-40814: -- Attachment: spark-error.log > Exception in thread "main" java.lang.NoClassDefFoundError: >

[jira] [Created] (SPARK-40814) Exception in thread "main" java.lang.NoClassDefFoundError: io/fabric8/kubernetes/client/KubernetesClient

2022-10-16 Thread jiangjian (Jira)
jiangjian created SPARK-40814: - Summary: Exception in thread "main" java.lang.NoClassDefFoundError: io/fabric8/kubernetes/client/KubernetesClient Key: SPARK-40814 URL:

[jira] [Commented] (SPARK-40812) Add Deduplicate to Connect proto

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618344#comment-17618344 ] Apache Spark commented on SPARK-40812: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40812) Add Deduplicate to Connect proto

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40812: Assignee: Apache Spark > Add Deduplicate to Connect proto >

[jira] [Commented] (SPARK-40812) Add Deduplicate to Connect proto

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618343#comment-17618343 ] Apache Spark commented on SPARK-40812: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40812) Add Deduplicate to Connect proto

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40812: Assignee: (was: Apache Spark) > Add Deduplicate to Connect proto >

[jira] [Assigned] (SPARK-40813) Add limit and offset to Connect DSL

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40813: Assignee: (was: Apache Spark) > Add limit and offset to Connect DSL >

[jira] [Commented] (SPARK-40813) Add limit and offset to Connect DSL

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618342#comment-17618342 ] Apache Spark commented on SPARK-40813: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40813) Add limit and offset to Connect DSL

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40813: Assignee: Apache Spark > Add limit and offset to Connect DSL >

[jira] [Created] (SPARK-40813) Add limit and offset to Connect DSL

2022-10-16 Thread Rui Wang (Jira)
Rui Wang created SPARK-40813: Summary: Add limit and offset to Connect DSL Key: SPARK-40813 URL: https://issues.apache.org/jira/browse/SPARK-40813 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40812) Add Deduplicate to Connect proto

2022-10-16 Thread Rui Wang (Jira)
Rui Wang created SPARK-40812: Summary: Add Deduplicate to Connect proto Key: SPARK-40812 URL: https://issues.apache.org/jira/browse/SPARK-40812 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-40811) Use checkError() to intercept ParseException

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40811: Assignee: (was: Apache Spark) > Use checkError() to intercept ParseException >

[jira] [Commented] (SPARK-40811) Use checkError() to intercept ParseException

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618300#comment-17618300 ] Apache Spark commented on SPARK-40811: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40811) Use checkError() to intercept ParseException

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40811: Assignee: Apache Spark > Use checkError() to intercept ParseException >

[jira] [Commented] (SPARK-40811) Use checkError() to intercept ParseException

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618299#comment-17618299 ] Apache Spark commented on SPARK-40811: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-40811) Use checkError() to intercept ParseException

2022-10-16 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40811: - Description: Port the following test suites onto checkError(): - SQLViewSuite - JDBCTableCatalogSuite

[jira] [Created] (SPARK-40811) Use checkError() to intercept ParseException

2022-10-16 Thread Max Gekk (Jira)
Max Gekk created SPARK-40811: Summary: Use checkError() to intercept ParseException Key: SPARK-40811 URL: https://issues.apache.org/jira/browse/SPARK-40811 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-40786) Check error classes in PlanParserSuite

2022-10-16 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40786. -- Resolution: Fixed Issue resolved by pull request 38271 [https://github.com/apache/spark/pull/38271]

[jira] [Assigned] (SPARK-40786) Check error classes in PlanParserSuite

2022-10-16 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40786: Assignee: BingKun Pan > Check error classes in PlanParserSuite >

[jira] [Updated] (SPARK-40728) Upgrade ASM to 9.4

2022-10-16 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40728: - Priority: Minor (was: Major) > Upgrade ASM to 9.4 > -- > >

[jira] [Resolved] (SPARK-40728) Upgrade ASM to 9.4

2022-10-16 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40728. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38189

[jira] [Assigned] (SPARK-40728) Upgrade ASM to 9.4

2022-10-16 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40728: Assignee: Yang Jie > Upgrade ASM to 9.4 > -- > > Key:

[jira] [Commented] (SPARK-40808) Infer schema for CSV files - wrong behavior using header + merge schema

2022-10-16 Thread zzzzming95 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618277#comment-17618277 ] ming95 commented on SPARK-40808: [~ohadm]  Can you provide code to reproduce this issue. >

[jira] [Resolved] (SPARK-40809) Add as(alias: String) to connect DSL

2022-10-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40809. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38272

[jira] [Assigned] (SPARK-40809) Add as(alias: String) to connect DSL

2022-10-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40809: Assignee: Rui Wang > Add as(alias: String) to connect DSL >

[jira] [Commented] (SPARK-40588) Sorting issue with AQE turned on

2022-10-16 Thread zzzzming95 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618265#comment-17618265 ] ming95 commented on SPARK-40588: After my test, I think this is not a problem of AQE, because

[jira] [Updated] (SPARK-40588) Sorting issue with AQE turned on

2022-10-16 Thread zzzzming95 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ming95 updated SPARK-40588: --- Attachment: image-2022-10-16-22-05-47-159.png > Sorting issue with AQE turned on >

[jira] [Commented] (SPARK-40810) Use SparkIllegalArgumentException instead of IllegalArgumentException in CreateDatabaseCommand & AlterDatabaseSetLocationCommand

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618263#comment-17618263 ] Apache Spark commented on SPARK-40810: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-40810) Use SparkIllegalArgumentException instead of IllegalArgumentException in CreateDatabaseCommand & AlterDatabaseSetLocationCommand

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40810: Assignee: Apache Spark > Use SparkIllegalArgumentException instead of

[jira] [Commented] (SPARK-40810) Use SparkIllegalArgumentException instead of IllegalArgumentException in CreateDatabaseCommand & AlterDatabaseSetLocationCommand

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618262#comment-17618262 ] Apache Spark commented on SPARK-40810: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-40810) Use SparkIllegalArgumentException instead of IllegalArgumentException in CreateDatabaseCommand & AlterDatabaseSetLocationCommand

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40810: Assignee: (was: Apache Spark) > Use SparkIllegalArgumentException instead of

[jira] [Created] (SPARK-40810) Use SparkIllegalArgumentException instead of IllegalArgumentException in CreateDatabaseCommand & AlterDatabaseSetLocationCommand

2022-10-16 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-40810: --- Summary: Use SparkIllegalArgumentException instead of IllegalArgumentException in CreateDatabaseCommand & AlterDatabaseSetLocationCommand Key: SPARK-40810 URL:

[jira] [Assigned] (SPARK-37945) Use error classes in the execution errors of arithmetic ops

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37945: Assignee: Apache Spark > Use error classes in the execution errors of arithmetic ops >

[jira] [Commented] (SPARK-37945) Use error classes in the execution errors of arithmetic ops

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618253#comment-17618253 ] Apache Spark commented on SPARK-37945: -- User 'khalidmammadov' has created a pull request for this

[jira] [Assigned] (SPARK-37945) Use error classes in the execution errors of arithmetic ops

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37945: Assignee: (was: Apache Spark) > Use error classes in the execution errors of

[jira] [Commented] (SPARK-40809) Add as(alias: String) to connect DSL

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618239#comment-17618239 ] Apache Spark commented on SPARK-40809: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-40809) Add as(alias: String) to connect DSL

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618238#comment-17618238 ] Apache Spark commented on SPARK-40809: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40809) Add as(alias: String) to connect DSL

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40809: Assignee: Apache Spark > Add as(alias: String) to connect DSL >

[jira] [Assigned] (SPARK-40809) Add as(alias: String) to connect DSL

2022-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40809: Assignee: (was: Apache Spark) > Add as(alias: String) to connect DSL >

[jira] [Updated] (SPARK-40809) Add as(alias: String) to connect DSL

2022-10-16 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-40809: - Summary: Add as(alias: String) to connect DSL (was: Add as(alias) to connect DSL) > Add as(alias:

[jira] [Created] (SPARK-40809) Add as(alias) to connect DSL

2022-10-16 Thread Rui Wang (Jira)
Rui Wang created SPARK-40809: Summary: Add as(alias) to connect DSL Key: SPARK-40809 URL: https://issues.apache.org/jira/browse/SPARK-40809 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-39951) Support columnar batches with nested fields in Parquet V2

2022-10-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-39951: --- Assignee: Adam Binford (was: Apache Spark) > Support columnar batches with nested fields

[jira] [Commented] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-10-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618234#comment-17618234 ] Yuming Wang commented on SPARK-40563: - [~Zing] Does branch-3.3 also fixed this issue? > Error at

[jira] [Updated] (SPARK-39200) Stream is corrupted Exception while fetching the blocks from fallback storage system

2022-10-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-39200: Fix Version/s: 3.3.1 (was: 3.3.2) > Stream is corrupted Exception while

[jira] [Updated] (SPARK-40535) NPE from observe of collect_list

2022-10-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40535: Fix Version/s: 3.3.1 (was: 3.3.2) > NPE from observe of collect_list >

[jira] [Updated] (SPARK-40547) Fix dead links in sparkr-vignettes.Rmd

2022-10-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40547: Fix Version/s: 3.3.1 (was: 3.3.2) > Fix dead links in sparkr-vignettes.Rmd

[jira] [Updated] (SPARK-40322) Fix all dead links

2022-10-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40322: Fix Version/s: 3.4.0 3.3.1 (was: 3.3.2) > Fix all dead

[jira] [Updated] (SPARK-40562) Add spark.sql.legacy.groupingIdWithAppendedUserGroupBy

2022-10-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40562: Fix Version/s: 3.3.1 (was: 3.3.2) > Add

[jira] [Updated] (SPARK-38717) Handle Hive's bucket spec case preserving behaviour

2022-10-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-38717: Fix Version/s: 3.3.1 (was: 3.3.2) > Handle Hive's bucket spec case

[jira] [Updated] (SPARK-40583) Documentation error in "Integration with Cloud Infrastructures"

2022-10-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40583: Fix Version/s: 3.3.1 (was: 3.3.2) > Documentation error in "Integration

[jira] [Updated] (SPARK-40636) Fix wrong remained shuffles log in BlockManagerDecommissioner

2022-10-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40636: Fix Version/s: 3.3.1 (was: 3.3.2) > Fix wrong remained shuffles log in

[jira] [Updated] (SPARK-40648) Add `@ExtendedLevelDBTest` to the leveldb relevant tests in the yarn module

2022-10-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40648: Fix Version/s: 3.3.1 (was: 3.3.2) > Add `@ExtendedLevelDBTest` to the

[jira] [Updated] (SPARK-40574) Add PURGE to DROP TABLE doc

2022-10-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40574: Fix Version/s: 3.3.1 (was: 3.3.2) > Add PURGE to DROP TABLE doc >

[jira] [Updated] (SPARK-40612) On Kubernetes for long running app Spark using an invalid principal to renew the delegation token

2022-10-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40612: Fix Version/s: 3.3.1 (was: 3.3.2) > On Kubernetes for long running app

[jira] [Updated] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-10-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-39725: Fix Version/s: 3.3.1 (was: 3.3.2) > Upgrade jetty-http from

[jira] [Updated] (SPARK-40682) Set spark.driver.maxResultSize to 3g in SqlBasedBenchmark

2022-10-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40682: Fix Version/s: 3.3.1 (was: 3.3.2) > Set spark.driver.maxResultSize to 3g

[jira] [Updated] (SPARK-40808) Infer schema for CSV files - wrong behavior using header + merge schema

2022-10-16 Thread ohad (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ohad updated SPARK-40808: - Description: Hello.  I am writing unit-tests to some functionality in my application that reading data from

[jira] [Updated] (SPARK-40808) Infer schema for CSV files - wrong behavior using header + merge schema

2022-10-16 Thread ohad (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ohad updated SPARK-40808: - Description: Hello.  I am writing unit-tests to some functionality in my application that reading data from

[jira] [Created] (SPARK-40808) Infer schema for CSV files - wrong behavior using header + merge schema

2022-10-16 Thread ohad (Jira)
ohad created SPARK-40808: Summary: Infer schema for CSV files - wrong behavior using header + merge schema Key: SPARK-40808 URL: https://issues.apache.org/jira/browse/SPARK-40808 Project: Spark

[jira] [Assigned] (SPARK-40784) Check error classes in DDLParserSuite

2022-10-16 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40784: Assignee: BingKun Pan > Check error classes in DDLParserSuite >

[jira] [Resolved] (SPARK-40784) Check error classes in DDLParserSuite

2022-10-16 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40784. -- Resolution: Fixed Issue resolved by pull request 38259 [https://github.com/apache/spark/pull/38259]