[jira] [Commented] (SPARK-32330) Preserve shuffled hash join build side partitioning

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158906#comment-17158906 ] Apache Spark commented on SPARK-32330: -- User 'c21' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32330) Preserve shuffled hash join build side partitioning

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32330: Assignee: Apache Spark > Preserve shuffled hash join build side partitioning >

[jira] [Assigned] (SPARK-32330) Preserve shuffled hash join build side partitioning

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32330: Assignee: (was: Apache Spark) > Preserve shuffled hash join build side partitioning

[jira] [Commented] (SPARK-32330) Preserve shuffled hash join build side partitioning

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158905#comment-17158905 ] Apache Spark commented on SPARK-32330: -- User 'c21' has created a pull request for this issue:

[jira] [Commented] (SPARK-32325) JSON predicate pushdown for nested fields

2020-07-15 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158902#comment-17158902 ] Maxim Gekk commented on SPARK-32325: The JIRA ticket was opened while addressing [~dongjoon]

[jira] [Updated] (SPARK-32330) Preserve shuffled hash join build side partitioning

2020-07-15 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-32330: - Description: Currently `ShuffledHashJoin.outputPartitioning` inherits from

[jira] [Created] (SPARK-32330) Preserve shuffled hash join build side partitioning

2020-07-15 Thread Cheng Su (Jira)
Cheng Su created SPARK-32330: Summary: Preserve shuffled hash join build side partitioning Key: SPARK-32330 URL: https://issues.apache.org/jira/browse/SPARK-32330 Project: Spark Issue Type:

[jira] [Commented] (SPARK-31831) Flaky test: org.apache.spark.sql.hive.thriftserver.HiveSessionImplSuite.(It is not a test it is a sbt.testing.SuiteSelector)

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158886#comment-17158886 ] Apache Spark commented on SPARK-31831: -- User 'frankyin-factual' has created a pull request for this

[jira] [Commented] (SPARK-31831) Flaky test: org.apache.spark.sql.hive.thriftserver.HiveSessionImplSuite.(It is not a test it is a sbt.testing.SuiteSelector)

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158885#comment-17158885 ] Apache Spark commented on SPARK-31831: -- User 'frankyin-factual' has created a pull request for this

[jira] [Assigned] (SPARK-32329) Rename HADOOP2_MODULE_PROFILES to HADOOP_MODULE_PROFILES

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32329: Assignee: (was: Apache Spark) > Rename HADOOP2_MODULE_PROFILES to

[jira] [Commented] (SPARK-32329) Rename HADOOP2_MODULE_PROFILES to HADOOP_MODULE_PROFILES

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158881#comment-17158881 ] Apache Spark commented on SPARK-32329: -- User 'williamhyun' has created a pull request for this

[jira] [Assigned] (SPARK-32329) Rename HADOOP2_MODULE_PROFILES to HADOOP_MODULE_PROFILES

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32329: Assignee: Apache Spark > Rename HADOOP2_MODULE_PROFILES to HADOOP_MODULE_PROFILES >

[jira] [Created] (SPARK-32329) Rename HADOOP2_MODULE_PROFILES to HADOOP_MODULE_PROFILES

2020-07-15 Thread William Hyun (Jira)
William Hyun created SPARK-32329: Summary: Rename HADOOP2_MODULE_PROFILES to HADOOP_MODULE_PROFILES Key: SPARK-32329 URL: https://issues.apache.org/jira/browse/SPARK-32329 Project: Spark

[jira] [Commented] (SPARK-32325) JSON predicate pushdown for nested fields

2020-07-15 Thread pavithra ramachandran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158878#comment-17158878 ] pavithra ramachandran commented on SPARK-32325: --- i would like to work on this > JSON

[jira] [Commented] (SPARK-32328) Avro predicate pushdown for nested fields

2020-07-15 Thread pavithra ramachandran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158877#comment-17158877 ] pavithra ramachandran commented on SPARK-32328: --- i would like to work on this > Avro

[jira] [Assigned] (SPARK-32125) [UI] Support get taskList by status in Web UI and SHS Rest API

2020-07-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-32125: -- Assignee: Zhongwei Zhu > [UI] Support get taskList by status in Web UI and SHS Rest

[jira] [Resolved] (SPARK-32125) [UI] Support get taskList by status in Web UI and SHS Rest API

2020-07-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-32125. Resolution: Fixed This issue is resolved in https://github.com/apache/spark/pull/28942 >

[jira] [Commented] (SPARK-32306) `approx_percentile` in Spark SQL gives incorrect results

2020-07-15 Thread Ankit Raj Boudh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158863#comment-17158863 ] Ankit Raj Boudh commented on SPARK-32306: - [~seanmalory], i will raise the pr for this soon >

[jira] [Updated] (SPARK-32324) Fix error messages during using PIVOT and lateral view

2020-07-15 Thread philipse (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] philipse updated SPARK-32324: - Description: Currently when we use `lateral view` and `pivot` together in from clause, if  `lateral

[jira] [Created] (SPARK-32328) Avro predicate pushdown for nested fields

2020-07-15 Thread jobit mathew (Jira)
jobit mathew created SPARK-32328: Summary: Avro predicate pushdown for nested fields Key: SPARK-32328 URL: https://issues.apache.org/jira/browse/SPARK-32328 Project: Spark Issue Type:

[jira] [Commented] (SPARK-32307) Aggression that use map type input UDF as group expression can fail

2020-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158814#comment-17158814 ] Dongjoon Hyun commented on SPARK-32307: --- Hi, [~Ngone51]. It seems that we need to pass a full

[jira] [Updated] (SPARK-32307) Aggression that use map type input UDF as group expression can fail

2020-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32307: -- Fix Version/s: (was: 3.0.1) > Aggression that use map type input UDF as group expression

[jira] [Commented] (SPARK-32307) Aggression that use map type input UDF as group expression can fail

2020-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158813#comment-17158813 ] Dongjoon Hyun commented on SPARK-32307: --- This is reverted from `branch-3.0` due to the UT failure.

[jira] [Assigned] (SPARK-32327) Introduce UnresolvedTableOrPermanentView for commands that support a table/view but not a temporary view

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32327: Assignee: Apache Spark > Introduce UnresolvedTableOrPermanentView for commands that

[jira] [Commented] (SPARK-32327) Introduce UnresolvedTableOrPermanentView for commands that support a table/view but not a temporary view

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158745#comment-17158745 ] Apache Spark commented on SPARK-32327: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32327) Introduce UnresolvedTableOrPermanentView for commands that support a table/view but not a temporary view

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32327: Assignee: (was: Apache Spark) > Introduce UnresolvedTableOrPermanentView for

[jira] [Commented] (SPARK-32327) Introduce UnresolvedTableOrPermanentView for commands that support a table/view but not a temporary view

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158744#comment-17158744 ] Apache Spark commented on SPARK-32327: -- User 'imback82' has created a pull request for this issue:

[jira] [Commented] (SPARK-32037) Rename blacklisting feature to avoid language with racist connotation

2020-07-15 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158739#comment-17158739 ] Thomas Graves commented on SPARK-32037: --- Any other opinions on what we should go with here? >

[jira] [Created] (SPARK-32327) Introduce UnresolvedTableOrPermanentView for commands that support a table/view but not a temporary view

2020-07-15 Thread Terry Kim (Jira)
Terry Kim created SPARK-32327: - Summary: Introduce UnresolvedTableOrPermanentView for commands that support a table/view but not a temporary view Key: SPARK-32327 URL:

[jira] [Created] (SPARK-32326) R version is too old on Jenkins k8s PRB

2020-07-15 Thread Holden Karau (Jira)
Holden Karau created SPARK-32326: Summary: R version is too old on Jenkins k8s PRB Key: SPARK-32326 URL: https://issues.apache.org/jira/browse/SPARK-32326 Project: Spark Issue Type:

[jira] [Commented] (SPARK-32324) Fix error messages during using PIVOT and lateral view

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158584#comment-17158584 ] Apache Spark commented on SPARK-32324: -- User 'GuoPhilipse' has created a pull request for this

[jira] [Assigned] (SPARK-32324) Fix error messages during using PIVOT and lateral view

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32324: Assignee: (was: Apache Spark) > Fix error messages during using PIVOT and lateral

[jira] [Commented] (SPARK-32324) Fix error messages during using PIVOT and lateral view

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158582#comment-17158582 ] Apache Spark commented on SPARK-32324: -- User 'GuoPhilipse' has created a pull request for this

[jira] [Assigned] (SPARK-32324) Fix error messages during using PIVOT and lateral view

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32324: Assignee: Apache Spark > Fix error messages during using PIVOT and lateral view >

[jira] [Created] (SPARK-32325) JSON predicate pushdown for nested fields

2020-07-15 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32325: -- Summary: JSON predicate pushdown for nested fields Key: SPARK-32325 URL: https://issues.apache.org/jira/browse/SPARK-32325 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-32324) Fix error messages during using PIVOT and lateral view

2020-07-15 Thread philipse (Jira)
philipse created SPARK-32324: Summary: Fix error messages during using PIVOT and lateral view Key: SPARK-32324 URL: https://issues.apache.org/jira/browse/SPARK-32324 Project: Spark Issue Type:

[jira] [Commented] (SPARK-32018) Fix UnsafeRow set overflowed decimal

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158553#comment-17158553 ] Apache Spark commented on SPARK-32018: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-32018) Fix UnsafeRow set overflowed decimal

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158548#comment-17158548 ] Apache Spark commented on SPARK-32018: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Resolved] (SPARK-32140) Add summary to FMClassificationModel

2020-07-15 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-32140. Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28960

[jira] [Assigned] (SPARK-32140) Add summary to FMClassificationModel

2020-07-15 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao reassigned SPARK-32140: -- Assignee: Huaxin Gao > Add summary to FMClassificationModel >

[jira] [Commented] (SPARK-32287) Flaky Test: ExecutorAllocationManagerSuite.add executors default profile

2020-07-15 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158521#comment-17158521 ] Thomas Graves commented on SPARK-32287: --- I'll try to reproduce and investigate locally > Flaky

[jira] [Assigned] (SPARK-32036) Remove references to "blacklist"/"whitelist" language (outside of blacklisting feature)

2020-07-15 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-32036: - Assignee: Erik Krogen > Remove references to "blacklist"/"whitelist" language (outside

[jira] [Resolved] (SPARK-32036) Remove references to "blacklist"/"whitelist" language (outside of blacklisting feature)

2020-07-15 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-32036. --- Fix Version/s: 3.1.0 Resolution: Fixed > Remove references to

[jira] [Commented] (SPARK-32321) Rollback SPARK-26267 workaround since KAFKA-7703 resolved

2020-07-15 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158484#comment-17158484 ] Gabor Somogyi commented on SPARK-32321: --- [~zsxwing] since you're the author and written the

[jira] [Commented] (SPARK-32321) Rollback SPARK-26267 workaround since KAFKA-7703 resolved

2020-07-15 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158475#comment-17158475 ] Gabor Somogyi commented on SPARK-32321: --- Hope it will make KafkaOffsetReader area more clear

[jira] [Resolved] (SPARK-32318) Add a test case to EliminateSortsSuite for protecting ORDER BY in DISTRIBUTE BY

2020-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32318. --- Fix Version/s: 3.1.0 2.4.7 3.0.1 Resolution:

[jira] [Assigned] (SPARK-32318) Add a test case to EliminateSortsSuite for protecting ORDER BY in DISTRIBUTE BY

2020-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32318: - Assignee: Dongjoon Hyun > Add a test case to EliminateSortsSuite for protecting ORDER

[jira] [Updated] (SPARK-32323) Javascript/HTML bug in spark application UI

2020-07-15 Thread Ihor Bobak (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ihor Bobak updated SPARK-32323: --- Description: I attached screeenshot - everything is written on it. This appeared in Spark 3.0.0 in

[jira] [Updated] (SPARK-32323) Javascript/HTML bug in spark application UI

2020-07-15 Thread Ihor Bobak (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ihor Bobak updated SPARK-32323: --- Attachment: 2020-07-15 16_36_31-pyspark-shell - Spark Jobs.png > Javascript/HTML bug in spark

[jira] [Updated] (SPARK-32323) Javascript/HTML bug in spark application UI

2020-07-15 Thread Ihor Bobak (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ihor Bobak updated SPARK-32323: --- Description: I attached screeenshot - everything is written on it. This appeared in Spark 3.0.0  

[jira] [Created] (SPARK-32323) Javascript/HTML bug in spark application UI

2020-07-15 Thread Ihor Bobak (Jira)
Ihor Bobak created SPARK-32323: -- Summary: Javascript/HTML bug in spark application UI Key: SPARK-32323 URL: https://issues.apache.org/jira/browse/SPARK-32323 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-32322) Pyspark not launching in Spark IPV6 environment

2020-07-15 Thread pavithra ramachandran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158165#comment-17158165 ] pavithra ramachandran commented on SPARK-32322: --- i would like to check this > Pyspark not

[jira] [Created] (SPARK-32322) Pyspark not launching in Spark IPV6 environment

2020-07-15 Thread jobit mathew (Jira)
jobit mathew created SPARK-32322: Summary: Pyspark not launching in Spark IPV6 environment Key: SPARK-32322 URL: https://issues.apache.org/jira/browse/SPARK-32322 Project: Spark Issue Type:

[jira] [Commented] (SPARK-32321) Rollback SPARK-26267 workaround since KAFKA-7703 resolved

2020-07-15 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158161#comment-17158161 ] Gabor Somogyi commented on SPARK-32321: --- I've started to work on this > Rollback SPARK-26267

[jira] [Commented] (SPARK-32321) Rollback SPARK-26267 workaround since KAFKA-7703 resolved

2020-07-15 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158160#comment-17158160 ] Gabor Somogyi commented on SPARK-32321: --- FYI [~zsxwing] > Rollback SPARK-26267 workaround since

[jira] [Created] (SPARK-32321) Rollback SPARK-26267 workaround since KAFKA-7703 resolved

2020-07-15 Thread Gabor Somogyi (Jira)
Gabor Somogyi created SPARK-32321: - Summary: Rollback SPARK-26267 workaround since KAFKA-7703 resolved Key: SPARK-32321 URL: https://issues.apache.org/jira/browse/SPARK-32321 Project: Spark

[jira] [Commented] (SPARK-32281) Spark wipes out SORTED spec in metastore when DESC is used

2020-07-15 Thread Ankit Raj Boudh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158125#comment-17158125 ] Ankit Raj Boudh commented on SPARK-32281: - [~bersprockets], I will raise PR for this soon. >

[jira] [Assigned] (SPARK-31168) Upgrade Scala to 2.12.12

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31168: Assignee: Apache Spark > Upgrade Scala to 2.12.12 > > >

[jira] [Assigned] (SPARK-31168) Upgrade Scala to 2.12.12

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31168: Assignee: (was: Apache Spark) > Upgrade Scala to 2.12.12 >

[jira] [Commented] (SPARK-31168) Upgrade Scala to 2.12.12

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158056#comment-17158056 ] Apache Spark commented on SPARK-31168: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31480) Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-15 Thread Dilip Biswal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dilip Biswal reassigned SPARK-31480: Assignee: Dilip Biswal > Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node >

[jira] [Resolved] (SPARK-31480) Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-15 Thread Dilip Biswal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dilip Biswal resolved SPARK-31480. -- Resolution: Fixed > Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node >

[jira] [Assigned] (SPARK-32283) Multiple Kryo registrators can't be used anymore

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32283: Assignee: (was: Apache Spark) > Multiple Kryo registrators can't be used anymore >

[jira] [Assigned] (SPARK-32283) Multiple Kryo registrators can't be used anymore

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32283: Assignee: Apache Spark > Multiple Kryo registrators can't be used anymore >

[jira] [Commented] (SPARK-32283) Multiple Kryo registrators can't be used anymore

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158034#comment-17158034 ] Apache Spark commented on SPARK-32283: -- User 'LantaoJin' has created a pull request for this issue:

[jira] [Commented] (SPARK-32283) Multiple Kryo registrators can't be used anymore

2020-07-15 Thread Lantao Jin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158018#comment-17158018 ] Lantao Jin commented on SPARK-32283: Thanks for reporting this. Will file a patch. > Multiple Kryo

[jira] [Updated] (SPARK-28367) Kafka connector infinite wait because metadata never updated

2020-07-15 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-28367: -- Affects Version/s: 3.1.0 > Kafka connector infinite wait because metadata never updated >

[jira] [Commented] (SPARK-32320) Remove mutable default arguments

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157996#comment-17157996 ] Apache Spark commented on SPARK-32320: -- User 'Fokko' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32320) Remove mutable default arguments

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32320: Assignee: (was: Apache Spark) > Remove mutable default arguments >

[jira] [Commented] (SPARK-32320) Remove mutable default arguments

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157995#comment-17157995 ] Apache Spark commented on SPARK-32320: -- User 'Fokko' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32320) Remove mutable default arguments

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32320: Assignee: Apache Spark > Remove mutable default arguments >

[jira] [Created] (SPARK-32320) Remove mutable default arguments

2020-07-15 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-32320: Summary: Remove mutable default arguments Key: SPARK-32320 URL: https://issues.apache.org/jira/browse/SPARK-32320 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32271) Add option for k-fold cross-validation to CrossValidator

2020-07-15 Thread Austin Jordan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Austin Jordan updated SPARK-32271: -- Summary: Add option for k-fold cross-validation to CrossValidator (was: Update

[jira] [Updated] (SPARK-32271) Update CrossValidator to parallelize fit method across folds

2020-07-15 Thread Austin Jordan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Austin Jordan updated SPARK-32271: -- Description: *What changes were proposed in this pull request?* I have added a `method`

[jira] [Updated] (SPARK-32271) Update CrossValidator to parallelize fit method across folds

2020-07-15 Thread Austin Jordan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Austin Jordan updated SPARK-32271: -- Description: ### What changes were proposed in this pull request? I have added a `method`

[jira] [Commented] (SPARK-32319) Remove unused imports

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157983#comment-17157983 ] Apache Spark commented on SPARK-32319: -- User 'Fokko' has created a pull request for this issue:

[jira] [Commented] (SPARK-32319) Remove unused imports

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157980#comment-17157980 ] Apache Spark commented on SPARK-32319: -- User 'Fokko' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32319) Remove unused imports

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32319: Assignee: (was: Apache Spark) > Remove unused imports > - > >

[jira] [Assigned] (SPARK-32319) Remove unused imports

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32319: Assignee: Apache Spark > Remove unused imports > - > >

[jira] [Created] (SPARK-32319) Remove unused imports

2020-07-15 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-32319: Summary: Remove unused imports Key: SPARK-32319 URL: https://issues.apache.org/jira/browse/SPARK-32319 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-32291) COALESCE should not reduce the child parallelism if it is Join

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32291: Assignee: Apache Spark > COALESCE should not reduce the child parallelism if it is Join

[jira] [Assigned] (SPARK-32291) COALESCE should not reduce the child parallelism if it is Join

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32291: Assignee: (was: Apache Spark) > COALESCE should not reduce the child parallelism if

[jira] [Commented] (SPARK-32291) COALESCE should not reduce the child parallelism if it is Join

2020-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157969#comment-17157969 ] Apache Spark commented on SPARK-32291: -- User 'LantaoJin' has created a pull request for this issue:

[jira] [Commented] (SPARK-29965) Race in executor shutdown handling can lead to executor never fully unregistering

2020-07-15 Thread Jeroen Dries (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157936#comment-17157936 ] Jeroen Dries commented on SPARK-29965: -- We seem to see the same (or similar?) issue on Spark 2.4.4.