[jira] [Resolved] (SPARK-30699) GMM blockify input vectors

2020-05-11 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-30699. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27473

[jira] [Commented] (SPARK-31683) Make Prometheus output consistent with DropWizard 4.1 result

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105058#comment-17105058 ] Apache Spark commented on SPARK-31683: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-31683) Make Prometheus output consistent with DropWizard 4.1 result

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105056#comment-17105056 ] Apache Spark commented on SPARK-31683: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-31683) Make Prometheus output consistent with DropWizard 4.1 result

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31683: Assignee: Apache Spark > Make Prometheus output consistent with DropWizard 4.1 result >

[jira] [Assigned] (SPARK-31683) Make Prometheus output consistent with DropWizard 4.1 result

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31683: Assignee: (was: Apache Spark) > Make Prometheus output consistent with DropWizard

[jira] [Created] (SPARK-31683) Make Prometheus output consistent with DropWizard 4.1 result

2020-05-11 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-31683: - Summary: Make Prometheus output consistent with DropWizard 4.1 result Key: SPARK-31683 URL: https://issues.apache.org/jira/browse/SPARK-31683 Project: Spark

[jira] [Commented] (SPARK-31655) Upgrade snappy to version 1.1.7.5

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105052#comment-17105052 ] Apache Spark commented on SPARK-31655: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-31655) Upgrade snappy to version 1.1.7.5

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105049#comment-17105049 ] Apache Spark commented on SPARK-31655: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-31655) Upgrade snappy to version 1.1.7.5

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105043#comment-17105043 ] Apache Spark commented on SPARK-31655: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-31655) Upgrade snappy to version 1.1.7.5

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105042#comment-17105042 ] Apache Spark commented on SPARK-31655: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-31655) Upgrade snappy to version 1.1.7.5

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105026#comment-17105026 ] Apache Spark commented on SPARK-31655: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-31655) Upgrade snappy to version 1.1.7.5

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105025#comment-17105025 ] Apache Spark commented on SPARK-31655: -- User 'AngersZh' has created a pull request for this

[jira] [Updated] (SPARK-31682) Turn on spark.sql.legacy.createHiveTableByDefault.enabled by default

2020-05-11 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31682: - Parent: (was: SPARK-30098) Issue Type: Improvement (was: Sub-task) > Turn on

[jira] [Updated] (SPARK-31682) Turn on spark.sql.legacy.createHiveTableByDefault.enabled by default

2020-05-11 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31682: - Parent: SPARK-31085 Issue Type: Sub-task (was: Improvement) > Turn on

[jira] [Assigned] (SPARK-31682) Turn on spark.sql.legacy.createHiveTableByDefault.enabled by default

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31682: Assignee: (was: Apache Spark) > Turn on

[jira] [Assigned] (SPARK-31682) Turn on spark.sql.legacy.createHiveTableByDefault.enabled by default

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31682: Assignee: Apache Spark > Turn on spark.sql.legacy.createHiveTableByDefault.enabled by

[jira] [Commented] (SPARK-31682) Turn on spark.sql.legacy.createHiveTableByDefault.enabled by default

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105016#comment-17105016 ] Apache Spark commented on SPARK-31682: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Created] (SPARK-31682) Turn on spark.sql.legacy.createHiveTableByDefault.enabled by default

2020-05-11 Thread wuyi (Jira)
wuyi created SPARK-31682: Summary: Turn on spark.sql.legacy.createHiveTableByDefault.enabled by default Key: SPARK-31682 URL: https://issues.apache.org/jira/browse/SPARK-31682 Project: Spark Issue

[jira] [Resolved] (SPARK-31393) Show the correct alias in schema for expression

2020-05-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31393. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28164

[jira] [Assigned] (SPARK-31393) Show the correct alias in schema for expression

2020-05-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31393: Assignee: jiaan.geng > Show the correct alias in schema for expression >

[jira] [Resolved] (SPARK-31559) AM starts with initial fetched tokens in any attempt

2020-05-11 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-31559. Fix Version/s: 3.0.0 Assignee: Jungtaek Lim Resolution:

[jira] [Resolved] (SPARK-31671) Wrong error message in VectorAssembler when column lengths can not be inferred

2020-05-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31671. -- Fix Version/s: 2.4.7 3.0.0 Assignee: YijieFan Resolution:

[jira] [Commented] (SPARK-20007) Make SparkR apply() functions robust to workers that return empty data.frame

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104969#comment-17104969 ] Apache Spark commented on SPARK-20007: -- User 'liangz1' has created a pull request for this issue:

[jira] [Updated] (SPARK-31671) Wrong error message in VectorAssembler when column lengths can not be inferred

2020-05-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-31671: - Affects Version/s: (was: 3.0.1) Labels: (was: pull-request-available) >

[jira] [Commented] (SPARK-20007) Make SparkR apply() functions robust to workers that return empty data.frame

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104967#comment-17104967 ] Apache Spark commented on SPARK-20007: -- User 'liangz1' has created a pull request for this issue:

[jira] [Commented] (SPARK-31666) Cannot map hostPath volumes to container

2020-05-11 Thread Stephen Hopper (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104947#comment-17104947 ] Stephen Hopper commented on SPARK-31666: I was able to fix the issue by patching Spark. As noted

[jira] [Commented] (SPARK-31681) Python multiclass logistic regression evaluate should return LogisticRegressionSummary

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104936#comment-17104936 ] Apache Spark commented on SPARK-31681: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31681) Python multiclass logistic regression evaluate should return LogisticRegressionSummary

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31681: Assignee: Apache Spark > Python multiclass logistic regression evaluate should return >

[jira] [Assigned] (SPARK-31681) Python multiclass logistic regression evaluate should return LogisticRegressionSummary

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31681: Assignee: (was: Apache Spark) > Python multiclass logistic regression evaluate

[jira] [Commented] (SPARK-31681) Python multiclass logistic regression evaluate should return LogisticRegressionSummary

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104935#comment-17104935 ] Apache Spark commented on SPARK-31681: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Created] (SPARK-31681) Python multiclass logistic regression evaluate should return LogisticRegressionSummary

2020-05-11 Thread Huaxin Gao (Jira)
Huaxin Gao created SPARK-31681: -- Summary: Python multiclass logistic regression evaluate should return LogisticRegressionSummary Key: SPARK-31681 URL: https://issues.apache.org/jira/browse/SPARK-31681

[jira] [Assigned] (SPARK-31680) Support Java 8 datetime types by Random data generator

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31680: Assignee: Apache Spark > Support Java 8 datetime types by Random data generator >

[jira] [Commented] (SPARK-31680) Support Java 8 datetime types by Random data generator

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104884#comment-17104884 ] Apache Spark commented on SPARK-31680: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31680) Support Java 8 datetime types by Random data generator

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31680: Assignee: (was: Apache Spark) > Support Java 8 datetime types by Random data

[jira] [Created] (SPARK-31680) Support Java 8 datetime types by Random data generator

2020-05-11 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31680: -- Summary: Support Java 8 datetime types by Random data generator Key: SPARK-31680 URL: https://issues.apache.org/jira/browse/SPARK-31680 Project: Spark Issue

[jira] [Resolved] (SPARK-31456) If shutdownhook is added with priority Integer.MIN_VALUE, it's supposed to be called the last, but it gets called before other positive priority shutdownhook

2020-05-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31456. --- Fix Version/s: 3.0.0 2.4.6 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-31456) If shutdownhook is added with priority Integer.MIN_VALUE, it's supposed to be called the last, but it gets called before other positive priority shutdownhook

2020-05-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31456: -- Fix Version/s: (was: 2.4.6) 2.4.7 > If shutdownhook is added with

[jira] [Assigned] (SPARK-31456) If shutdownhook is added with priority Integer.MIN_VALUE, it's supposed to be called the last, but it gets called before other positive priority shutdownhook

2020-05-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31456: - Assignee: Oleg Kuznetsov > If shutdownhook is added with priority Integer.MIN_VALUE,

[jira] [Updated] (SPARK-31456) If shutdownhook is added with priority Integer.MIN_VALUE, it's supposed to be called the last, but it gets called before other positive priority shutdownhook

2020-05-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31456: -- Affects Version/s: 1.6.3 2.0.2 2.1.3

[jira] [Commented] (SPARK-27249) Developers API for Transformers beyond UnaryTransformer

2020-05-11 Thread Nick Afshartous (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104661#comment-17104661 ] Nick Afshartous commented on SPARK-27249: - [~enrush] Hi Everett, can you please chime in on the

[jira] [Assigned] (SPARK-31663) Grouping sets with having clause returns the wrong result

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31663: Assignee: (was: Apache Spark) > Grouping sets with having clause returns the wrong

[jira] [Assigned] (SPARK-31663) Grouping sets with having clause returns the wrong result

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31663: Assignee: Apache Spark > Grouping sets with having clause returns the wrong result >

[jira] [Commented] (SPARK-31663) Grouping sets with having clause returns the wrong result

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104528#comment-17104528 ] Apache Spark commented on SPARK-31663: -- User 'xuanyuanking' has created a pull request for this

[jira] [Updated] (SPARK-31575) Synchronise global JVM security configuration modification

2020-05-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-31575: - Priority: Minor (was: Major) > Synchronise global JVM security configuration modification >

[jira] [Resolved] (SPARK-31575) Synchronise global JVM security configuration modification

2020-05-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31575. -- Fix Version/s: 3.1.0 Assignee: Gabor Somogyi Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-31667) Python side flatten the result dataframe of ANOVATest/ChisqTest/FValueTest

2020-05-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31667. -- Fix Version/s: 3.1.0 Assignee: Huaxin Gao Resolution: Fixed Resolved by

[jira] [Commented] (SPARK-30098) Use default datasource as provider for CREATE TABLE syntax

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104479#comment-17104479 ] Apache Spark commented on SPARK-30098: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Commented] (SPARK-30098) Use default datasource as provider for CREATE TABLE syntax

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104478#comment-17104478 ] Apache Spark commented on SPARK-30098: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31665) Test parquet dictionary encoding of random dates/timestamps

2020-05-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31665: --- Assignee: Maxim Gekk > Test parquet dictionary encoding of random dates/timestamps >

[jira] [Resolved] (SPARK-31665) Test parquet dictionary encoding of random dates/timestamps

2020-05-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31665. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28481

[jira] [Commented] (SPARK-31666) Cannot map hostPath volumes to container

2020-05-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104391#comment-17104391 ] Hyukjin Kwon commented on SPARK-31666: -- No idea. Something must have been wrong. > Cannot map

[jira] [Reopened] (SPARK-31666) Cannot map hostPath volumes to container

2020-05-11 Thread Stephen Hopper (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Hopper reopened SPARK-31666: [~hyukjin.kwon] why was this closed and marked as invalid? > Cannot map hostPath volumes to

[jira] [Commented] (SPARK-31678) PrintStackTrace for Spark SQL CLI when error occurs

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104352#comment-17104352 ] Apache Spark commented on SPARK-31678: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31678) PrintStackTrace for Spark SQL CLI when error occurs

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31678: Assignee: Apache Spark > PrintStackTrace for Spark SQL CLI when error occurs >

[jira] [Assigned] (SPARK-31678) PrintStackTrace for Spark SQL CLI when error occurs

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31678: Assignee: (was: Apache Spark) > PrintStackTrace for Spark SQL CLI when error occurs

[jira] [Commented] (SPARK-31679) Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite: Failed to create new KafkaAdminClient

2020-05-11 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104322#comment-17104322 ] Gabor Somogyi commented on SPARK-31679: --- Started to work on this. > Flaky test:

[jira] [Created] (SPARK-31679) Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite: Failed to create new KafkaAdminClient

2020-05-11 Thread Gabor Somogyi (Jira)
Gabor Somogyi created SPARK-31679: - Summary: Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite: Failed to create new KafkaAdminClient Key: SPARK-31679 URL:

[jira] [Created] (SPARK-31678) PrintStackTrace for Spark SQL CLI when error occurs

2020-05-11 Thread Kent Yao (Jira)
Kent Yao created SPARK-31678: Summary: PrintStackTrace for Spark SQL CLI when error occurs Key: SPARK-31678 URL: https://issues.apache.org/jira/browse/SPARK-31678 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-31676) QuantileDiscretizer raise error parameter splits given invalid value (splits array includes -0.0 and 0.0)

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31676: Assignee: Apache Spark > QuantileDiscretizer raise error parameter splits given invalid

[jira] [Commented] (SPARK-31676) QuantileDiscretizer raise error parameter splits given invalid value (splits array includes -0.0 and 0.0)

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104269#comment-17104269 ] Apache Spark commented on SPARK-31676: -- User 'WeichenXu123' has created a pull request for this

[jira] [Assigned] (SPARK-31676) QuantileDiscretizer raise error parameter splits given invalid value (splits array includes -0.0 and 0.0)

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31676: Assignee: (was: Apache Spark) > QuantileDiscretizer raise error parameter splits

[jira] [Updated] (SPARK-31676) QuantileDiscretizer raise error parameter splits given invalid value (splits array includes -0.0 and 0.0)

2020-05-11 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-31676: --- Description: Reproduce code {code: scala} import scala.util.Random val rng = new Random(3) val

[jira] [Updated] (SPARK-31676) QuantileDiscretizer raise error parameter splits given invalid value (splits array includes -0.0 and 0.0)

2020-05-11 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-31676: --- Description: Reproduce code {code} import scala.util.Random val rng = new Random(3) val a1 =

[jira] [Commented] (SPARK-31677) Use KVStore to cache stream query progress

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104265#comment-17104265 ] Apache Spark commented on SPARK-31677: -- User 'uncleGen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31677) Use KVStore to cache stream query progress

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31677: Assignee: Apache Spark > Use KVStore to cache stream query progress >

[jira] [Assigned] (SPARK-31677) Use KVStore to cache stream query progress

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31677: Assignee: (was: Apache Spark) > Use KVStore to cache stream query progress >

[jira] [Commented] (SPARK-31677) Use KVStore to cache stream query progress

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104264#comment-17104264 ] Apache Spark commented on SPARK-31677: -- User 'uncleGen' has created a pull request for this issue:

[jira] [Updated] (SPARK-31677) Use KVStore to cache stream query progress

2020-05-11 Thread Genmao Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated SPARK-31677: -- Description: 1. Streaming query progress information are cached twice in *StreamExecution* and

[jira] [Updated] (SPARK-31677) Use KVStore to cache stream query progress

2020-05-11 Thread Genmao Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated SPARK-31677: -- Environment: (was: 1. Streaming query progress information are cached twice in *StreamExecution*

[jira] [Created] (SPARK-31677) Use KVStore to cache stream query progress

2020-05-11 Thread Genmao Yu (Jira)
Genmao Yu created SPARK-31677: - Summary: Use KVStore to cache stream query progress Key: SPARK-31677 URL: https://issues.apache.org/jira/browse/SPARK-31677 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-31676) QuantileDiscretizer raise error parameter splits given invalid value (splits array includes -0.0 and 0.0)

2020-05-11 Thread Weichen Xu (Jira)
Weichen Xu created SPARK-31676: -- Summary: QuantileDiscretizer raise error parameter splits given invalid value (splits array includes -0.0 and 0.0) Key: SPARK-31676 URL:

[jira] [Updated] (SPARK-31675) Fail to insert data to a table with remote location which causes by hive encryption check

2020-05-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-31675: - Description: Before this fix https://issues.apache.org/jira/browse/HIVE-14380 in Hive 2.2.0, when

[jira] [Created] (SPARK-31675) Fail to insert data to a table with remote location which causes by hive encryption check

2020-05-11 Thread Kent Yao (Jira)
Kent Yao created SPARK-31675: Summary: Fail to insert data to a table with remote location which causes by hive encryption check Key: SPARK-31675 URL: https://issues.apache.org/jira/browse/SPARK-31675

[jira] [Commented] (SPARK-31634) "show tables like" support for SQL wildcard characters (% and _)

2020-05-11 Thread pavithra ramachandran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104223#comment-17104223 ] pavithra ramachandran commented on SPARK-31634: --- [~yumwang] i see that show tables uses

[jira] [Updated] (SPARK-30331) The final AdaptiveSparkPlan event is not marked with `isFinalPlan=true`

2020-05-11 Thread Manu Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manu Zhang updated SPARK-30331: --- Parent: SPARK-31412 Issue Type: Sub-task (was: Bug) > The final AdaptiveSparkPlan event is

[jira] [Updated] (SPARK-31658) SQL UI doesn't show write commands of AQE plan

2020-05-11 Thread Manu Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manu Zhang updated SPARK-31658: --- Parent: SPARK-31412 Issue Type: Sub-task (was: Improvement) > SQL UI doesn't show write

[jira] [Commented] (SPARK-31620) TreeNodeException: Binding attribute, tree: sum#19L

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104151#comment-17104151 ] Apache Spark commented on SPARK-31620: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31620) TreeNodeException: Binding attribute, tree: sum#19L

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31620: Assignee: Apache Spark > TreeNodeException: Binding attribute, tree: sum#19L >

[jira] [Commented] (SPARK-31620) TreeNodeException: Binding attribute, tree: sum#19L

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104148#comment-17104148 ] Apache Spark commented on SPARK-31620: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31620) TreeNodeException: Binding attribute, tree: sum#19L

2020-05-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31620: Assignee: (was: Apache Spark) > TreeNodeException: Binding attribute, tree: sum#19L