[jira] [Commented] (SPARK-36876) Support Dynamic Partition pruning for HiveTableScanExec

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443246#comment-17443246 ] Apache Spark commented on SPARK-36876: -- User 'whcdjj' has created a pull request for this issue:

[jira] [Commented] (SPARK-36876) Support Dynamic Partition pruning for HiveTableScanExec

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443245#comment-17443245 ] Apache Spark commented on SPARK-36876: -- User 'whcdjj' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37319) Support K8s image building with Java 17

2021-11-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37319: - Assignee: Dongjoon Hyun > Support K8s image building with Java 17 >

[jira] [Assigned] (SPARK-37319) Support K8s image building with Java 17

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37319: Assignee: (was: Apache Spark) > Support K8s image building with Java 17 >

[jira] [Commented] (SPARK-37319) Support K8s image building with Java 17

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443242#comment-17443242 ] Apache Spark commented on SPARK-37319: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37319) Support K8s image building with Java 17

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37319: Assignee: Apache Spark > Support K8s image building with Java 17 >

[jira] [Commented] (SPARK-37319) Support K8s image building with Java 17

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443241#comment-17443241 ] Apache Spark commented on SPARK-37319: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-37319) Support K8s image building with Java 17

2021-11-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-37319: - Summary: Support K8s image building with Java 17 Key: SPARK-37319 URL: https://issues.apache.org/jira/browse/SPARK-37319 Project: Spark Issue Type:

[jira] [Updated] (SPARK-35781) Support Spark on Apple Silicon on macOS natively

2021-11-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35781: -- Affects Version/s: 3.3.0 (was: 3.2.0) > Support Spark on Apple

[jira] [Assigned] (SPARK-37317) Reduce weights in GaussianMixtureSuite

2021-11-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37317: - Assignee: Dongjoon Hyun > Reduce weights in GaussianMixtureSuite >

[jira] [Commented] (SPARK-37318) Make FallbackStorageSuite robust in terms of DNS

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443233#comment-17443233 ] Apache Spark commented on SPARK-37318: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-37318) Make FallbackStorageSuite robust in terms of DNS

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443232#comment-17443232 ] Apache Spark commented on SPARK-37318: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37318) Make FallbackStorageSuite robust in terms of DNS

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37318: Assignee: Apache Spark > Make FallbackStorageSuite robust in terms of DNS >

[jira] [Assigned] (SPARK-37318) Make FallbackStorageSuite robust in terms of DNS

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37318: Assignee: (was: Apache Spark) > Make FallbackStorageSuite robust in terms of DNS >

[jira] [Created] (SPARK-37318) Make FallbackStorageSuite robust in terms of DNS

2021-11-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-37318: - Summary: Make FallbackStorageSuite robust in terms of DNS Key: SPARK-37318 URL: https://issues.apache.org/jira/browse/SPARK-37318 Project: Spark Issue

[jira] [Assigned] (SPARK-37317) Reduce weights in GaussianMixtureSuite

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37317: Assignee: (was: Apache Spark) > Reduce weights in GaussianMixtureSuite >

[jira] [Assigned] (SPARK-37317) Reduce weights in GaussianMixtureSuite

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37317: Assignee: Apache Spark > Reduce weights in GaussianMixtureSuite >

[jira] [Commented] (SPARK-37317) Reduce weights in GaussianMixtureSuite

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443229#comment-17443229 ] Apache Spark commented on SPARK-37317: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-37317) Reduce weights in GaussianMixtureSuite

2021-11-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-37317: - Summary: Reduce weights in GaussianMixtureSuite Key: SPARK-37317 URL: https://issues.apache.org/jira/browse/SPARK-37317 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37316) Add code-gen for existence sort merge join

2021-11-13 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443227#comment-17443227 ] Cheng Su commented on SPARK-37316: -- Will raise a PR soon after

[jira] [Created] (SPARK-37316) Add code-gen for existence sort merge join

2021-11-13 Thread Cheng Su (Jira)
Cheng Su created SPARK-37316: Summary: Add code-gen for existence sort merge join Key: SPARK-37316 URL: https://issues.apache.org/jira/browse/SPARK-37316 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-37291) PySpark init SparkSession should copy conf to sharedState

2021-11-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37291: -- Summary: PySpark init SparkSession should copy conf to sharedState (was: PySpark

[jira] [Resolved] (SPARK-37291) PySpark SparkSession.config should respect enableHiveSupport

2021-11-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37291. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34559

[jira] [Assigned] (SPARK-37291) PySpark SparkSession.config should respect enableHiveSupport

2021-11-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37291: - Assignee: angerszhu > PySpark SparkSession.config should respect enableHiveSupport >

[jira] [Resolved] (SPARK-37315) Mitigate ConcurrentModificationException thrown from a test in MLEventSuite

2021-11-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37315. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34583

[jira] [Updated] (SPARK-37315) Mitigate ConcurrentModificationException thrown from a test in MLEventSuite

2021-11-13 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37315: --- Summary: Mitigate ConcurrentModificationException thrown from a test in MLEventSuite (was:

[jira] [Resolved] (SPARK-37307) Don't obtain JDBC connection for empty partition

2021-11-13 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-37307. Fix Version/s: 3.2.1 3.3.0 Assignee: Sean R. Owen Resolution:

[jira] [Commented] (SPARK-37315) Mitigate a ConcurrentModificationException thrown from a test in MLEventSuite

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443127#comment-17443127 ] Apache Spark commented on SPARK-37315: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37315) Mitigate a ConcurrentModificationException thrown from a test in MLEventSuite

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37315: Assignee: Apache Spark (was: Kousuke Saruta) > Mitigate a

[jira] [Assigned] (SPARK-37315) Mitigate a ConcurrentModificationException thrown from a test in MLEventSuite

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37315: Assignee: Kousuke Saruta (was: Apache Spark) > Mitigate a

[jira] [Updated] (SPARK-37315) Mitigate a ConcurrentModificationException thrown from a test in MLEventSuite

2021-11-13 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37315: --- Description: Recently, I notice ConcurrentModificationException is sometimes thrown from

[jira] [Created] (SPARK-37315) Mitigate a ConcurrentModificationException thrown from a test in MLEventSuite

2021-11-13 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-37315: -- Summary: Mitigate a ConcurrentModificationException thrown from a test in MLEventSuite Key: SPARK-37315 URL: https://issues.apache.org/jira/browse/SPARK-37315

[jira] [Updated] (SPARK-37288) Backport update pyspark.since annotation to 3.1 and 3.2

2021-11-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37288: - Fix Version/s: 3.1.3 3.2.1 > Backport update pyspark.since annotation to 3.1

[jira] [Commented] (SPARK-37289) Refactoring:remove the unnecessary function with partitionSchemaOption

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443102#comment-17443102 ] Apache Spark commented on SPARK-37289: -- User 'tenglei' has created a pull request for this issue:

[jira] [Commented] (SPARK-35352) Add code-gen for full outer sort merge join

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443051#comment-17443051 ] Apache Spark commented on SPARK-35352: -- User 'c21' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35352) Add code-gen for full outer sort merge join

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35352: Assignee: Apache Spark > Add code-gen for full outer sort merge join >

[jira] [Assigned] (SPARK-35352) Add code-gen for full outer sort merge join

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35352: Assignee: (was: Apache Spark) > Add code-gen for full outer sort merge join >

[jira] [Updated] (SPARK-35352) Add code-gen for full outer sort merge join

2021-11-13 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-35352: - Affects Version/s: 3.3.0 > Add code-gen for full outer sort merge join >

[jira] [Updated] (SPARK-37308) Flaky Test: DDLParserSuite.create view -- basic

2021-11-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37308: -- Description: - https://github.com/apache/spark/runs/4188475706 -

[jira] [Resolved] (SPARK-37314) Upgrade kubernetes-client to 5.10.1

2021-11-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37314. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34579

[jira] [Assigned] (SPARK-37270) Incorect result of filter using isNull condition

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37270: Assignee: Apache Spark > Incorect result of filter using isNull condition >

[jira] [Assigned] (SPARK-37270) Incorect result of filter using isNull condition

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37270: Assignee: (was: Apache Spark) > Incorect result of filter using isNull condition >

[jira] [Commented] (SPARK-37270) Incorect result of filter using isNull condition

2021-11-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443035#comment-17443035 ] Apache Spark commented on SPARK-37270: -- User 'wangyum' has created a pull request for this issue: