[jira] [Updated] (SPARK-23788) Race condition in StreamingQuerySuite

2018-03-24 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-23788: - Fix Version/s: 2.2.2 > Race condition in StreamingQuerySuite >

[jira] [Resolved] (SPARK-23788) Race condition in StreamingQuerySuite

2018-03-24 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-23788. -- Resolution: Fixed Assignee: Jose Torres Fix Version/s: 2.4.0

[jira] [Updated] (SPARK-23727) Support DATE predict push down in parquet

2018-03-24 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23727: -- Issue Type: Improvement (was: Bug) > Support DATE predict push down in parquet >

[jira] [Commented] (SPARK-23598) WholeStageCodegen can lead to IllegalAccessError calling append for HashAggregateExec

2018-03-24 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412835#comment-16412835 ] Dongjoon Hyun commented on SPARK-23598: --- Hi, [~hvanhovell] and [~kiszk]. Although this test case is

[jira] [Updated] (SPARK-23598) WholeStageCodegen can lead to IllegalAccessError calling append for HashAggregateExec

2018-03-24 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23598: -- Fix Version/s: 2.3.1 > WholeStageCodegen can lead to IllegalAccessError calling append for >

[jira] [Commented] (SPARK-23782) SHS should not show applications to user without read permission

2018-03-24 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412820#comment-16412820 ] Marcelo Vanzin commented on SPARK-23782: bq. The users can see which applications have been run

[jira] [Commented] (SPARK-23791) Sub-optimal generated code for sum aggregating

2018-03-24 Thread Valentin Nikotin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412799#comment-16412799 ] Valentin Nikotin commented on SPARK-23791: -- When testing aggregation with different number of

[jira] [Updated] (SPARK-23791) Sub-optimal generated code for sum aggregating

2018-03-24 Thread Valentin Nikotin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentin Nikotin updated SPARK-23791: - Description: It appears to be that with wholeStage codegen enabled simple spark job

[jira] [Updated] (SPARK-23791) Sub-optimal generated code for sum aggregating

2018-03-24 Thread Valentin Nikotin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentin Nikotin updated SPARK-23791: - Summary: Sub-optimal generated code for sum aggregating (was: Sub-optimal generated

[jira] [Updated] (SPARK-23791) Sub-optimal generated code when aggregating nullable columns

2018-03-24 Thread Valentin Nikotin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentin Nikotin updated SPARK-23791: - Environment: (was: {code:java} import org.apache.spark.sql.functions._ import

[jira] [Updated] (SPARK-23791) Sub-optimal generated code when aggregating nullable columns

2018-03-24 Thread Valentin Nikotin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentin Nikotin updated SPARK-23791: - Description: It appears to be that with wholeStage codegen enabled simple spark job

[jira] [Updated] (SPARK-23791) Sub-optimal generated code when aggregating nullable columns

2018-03-24 Thread Valentin Nikotin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentin Nikotin updated SPARK-23791: - Description: It appears to be that with wholeStage codegen enabled simple spark job

[jira] [Updated] (SPARK-23791) Sub-optimal generated code when aggregating nullable columns

2018-03-24 Thread Valentin Nikotin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentin Nikotin updated SPARK-23791: - Description: It appears to be that with wholeStage codegen enabled simple spark job

[jira] [Created] (SPARK-23791) Sub-optimal generated code when aggregating nullable columns

2018-03-24 Thread Valentin Nikotin (JIRA)
Valentin Nikotin created SPARK-23791: Summary: Sub-optimal generated code when aggregating nullable columns Key: SPARK-23791 URL: https://issues.apache.org/jira/browse/SPARK-23791 Project: Spark

[jira] [Commented] (SPARK-23645) pandas_udf can not be called with keyword arguments

2018-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412711#comment-16412711 ] Apache Spark commented on SPARK-23645: -- User 'mstewart141' has created a pull request for this

[jira] [Updated] (SPARK-23790) proxy-user failed connecting to a kerberos configured metastore

2018-03-24 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-23790: Description: This appeared at a customer trying to integrate with a kerberized

[jira] [Commented] (SPARK-23790) proxy-user failed connecting to a kerberos configured metastore

2018-03-24 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412644#comment-16412644 ] Stavros Kontopoulos commented on SPARK-23790: - [~susanxhuynh] fyi. [~vanzin], [~jerryshao] do

[jira] [Updated] (SPARK-23790) proxy-user failed connecting to a kerberos configured metastore

2018-03-24 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-23790: Description: This appeared at a customer trying to integrate with a kerberized

[jira] [Updated] (SPARK-23790) proxy-user failed connecting to a kerberos configured metastore

2018-03-24 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-23790: Description: This appeared at a customer trying to integrate with a kerberized

[jira] [Updated] (SPARK-23790) proxy-user failed connecting to a kerberos configured metastore

2018-03-24 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-23790: Description: This appeared at a customer trying to integrate with a kerberized

[jira] [Updated] (SPARK-23790) proxy-user failed connecting to a kerberos configured metastore

2018-03-24 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-23790: Description: This appeared at a customer trying to integrate with a kerberized

[jira] [Updated] (SPARK-23790) proxy-user failed connecting to a kerberos configured metastore

2018-03-24 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-23790: Description: This appeared at a customer trying to integrate with a kerberized

[jira] [Updated] (SPARK-23790) proxy-user failed connecting to a kerberos configured metastore

2018-03-24 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-23790: Description: This appeared at a customer trying to integrate with a kerberized

[jira] [Updated] (SPARK-23790) proxy-user failed connecting to a kerberos configured metastore

2018-03-24 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-23790: Description: This appeared at a customer trying to integrate with a kerberized

[jira] [Updated] (SPARK-23790) proxy-user failed connecting to a kerberos configured metastore

2018-03-24 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-23790: Description: This appeared at a customer trying to integrate with a kerberized

[jira] [Updated] (SPARK-23790) proxy-user failed connecting to a kerberos configured metastore

2018-03-24 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-23790: Description: This appeared at a customer trying to integrate with a kerberized

[jira] [Updated] (SPARK-23790) proxy-user failed connecting to a kerberos configured metastore

2018-03-24 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-23790: Description: This appeared at a customer trying to integrate with a kerberized

[jira] [Created] (SPARK-23790) proxy-user failed connecting to a kerberos configured metastore

2018-03-24 Thread Stavros Kontopoulos (JIRA)
Stavros Kontopoulos created SPARK-23790: --- Summary: proxy-user failed connecting to a kerberos configured metastore Key: SPARK-23790 URL: https://issues.apache.org/jira/browse/SPARK-23790

[jira] [Commented] (SPARK-23782) SHS should not show applications to user without read permission

2018-03-24 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412510#comment-16412510 ] Marco Gaido commented on SPARK-23782: - [~vanzin] thanks for the link. I see that in the discussion

[jira] [Assigned] (SPARK-23789) Shouldn't set hive.metastore.uris before invoking HiveDelegationTokenProvider

2018-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23789: Assignee: Apache Spark > Shouldn't set hive.metastore.uris before invoking

[jira] [Commented] (SPARK-23789) Shouldn't set hive.metastore.uris before invoking HiveDelegationTokenProvider

2018-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412470#comment-16412470 ] Apache Spark commented on SPARK-23789: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23789) Shouldn't set hive.metastore.uris before invoking HiveDelegationTokenProvider

2018-03-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23789: Assignee: (was: Apache Spark) > Shouldn't set hive.metastore.uris before invoking

[jira] [Created] (SPARK-23789) Shouldn't set hive.metastore.uris before invoking HiveDelegationTokenProvider

2018-03-24 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-23789: --- Summary: Shouldn't set hive.metastore.uris before invoking HiveDelegationTokenProvider Key: SPARK-23789 URL: https://issues.apache.org/jira/browse/SPARK-23789 Project:

[jira] [Comment Edited] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-03-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412458#comment-16412458 ] Felix Cheung edited comment on SPARK-23780 at 3/24/18 6:53 AM: --- here

[jira] [Commented] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-03-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412458#comment-16412458 ] Felix Cheung commented on SPARK-23780: -- here

[jira] [Commented] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-03-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412457#comment-16412457 ] Felix Cheung commented on SPARK-23780: -- hmm, I think the cause of this is the incompatibility of the