[jira] [Created] (SPARK-29018) Spark ThriftServer change to it's own API

2019-09-08 Thread angerszhu (Jira)
angerszhu created SPARK-29018: - Summary: Spark ThriftServer change to it's own API Key: SPARK-29018 URL: https://issues.apache.org/jira/browse/SPARK-29018 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-29018) Spark ThriftServer change to it's own API

2019-09-08 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29018: -- Description: Current SparkThriftServer rely on HiveServer2 too much, when Hive version changed, we sh

[jira] [Created] (SPARK-29019) Improve tooltip information in JDBC/ODBC Server tab

2019-09-08 Thread Pablo Langa Blanco (Jira)
Pablo Langa Blanco created SPARK-29019: -- Summary: Improve tooltip information in JDBC/ODBC Server tab Key: SPARK-29019 URL: https://issues.apache.org/jira/browse/SPARK-29019 Project: Spark

[jira] [Reopened] (SPARK-20765) Cannot load persisted PySpark ML Pipeline that includes 3rd party stage (Transformer or Estimator) if the package name of stage is not "org.apache.spark" and "pyspark"

2019-09-08 Thread Ilya Matiach (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilya Matiach reopened SPARK-20765: -- I'm still seeing this issue, please see this thread: [https://github.com/Azure/mmlspark/issues/61

[jira] [Commented] (SPARK-28042) Support mapping spark.local.dir to hostPath volume

2019-09-08 Thread Jiaxin Shan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925265#comment-16925265 ] Jiaxin Shan commented on SPARK-28042: - [~vanzin] Do we usually backport these improv

[jira] [Commented] (SPARK-28042) Support mapping spark.local.dir to hostPath volume

2019-09-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925274#comment-16925274 ] Dongjoon Hyun commented on SPARK-28042: --- No, we usually backport bug fixes only.

[jira] [Updated] (SPARK-28942) [Spark][WEB UI]Spark in local mode hostname display localhost in the Host Column of Task Summary Page

2019-09-08 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28942: -- Issue Type: Improvement (was: Bug) > [Spark][WEB UI]Spark in local mode hostname display localhost in

[jira] [Resolved] (SPARK-28942) [Spark][WEB UI]Spark in local mode hostname display localhost in the Host Column of Task Summary Page

2019-09-08 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28942. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25645 [https://github.c

[jira] [Assigned] (SPARK-28942) [Spark][WEB UI]Spark in local mode hostname display localhost in the Host Column of Task Summary Page

2019-09-08 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28942: - Assignee: Shivu Sondur > [Spark][WEB UI]Spark in local mode hostname display localhost in the H

[jira] [Resolved] (SPARK-27420) KinesisInputDStream should expose a way to configure CloudWatch metrics

2019-09-08 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27420. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 24651 [https://github.c

[jira] [Assigned] (SPARK-27420) KinesisInputDStream should expose a way to configure CloudWatch metrics

2019-09-08 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27420: - Assignee: Kengo Seki > KinesisInputDStream should expose a way to configure CloudWatch metrics

[jira] [Resolved] (SPARK-28953) Integration tests fail due to malformed URL

2019-09-08 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28953. --- Resolution: Duplicate > Integration tests fail due to malformed URL > --

[jira] [Resolved] (SPARK-28886) Kubernetes DepsTestsSuite fails on OSX with minikube 1.3.1 due to formatting

2019-09-08 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28886. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25599 [https://github.c

[jira] [Assigned] (SPARK-28542) Document Stages page

2019-09-08 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28542: --- Assignee: Pablo Langa Blanco > Document Stages page > > > Key:

[jira] [Commented] (SPARK-24285) Flaky test: ContinuousSuite.query without test harness

2019-09-08 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925303#comment-16925303 ] Jungtaek Lim commented on SPARK-24285: -- Somehow I found I filed duplicated issue SP

[jira] [Resolved] (SPARK-24285) Flaky test: ContinuousSuite.query without test harness

2019-09-08 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-24285. -- Fix Version/s: 2.4.4 3.0.0 Resolution: Duplicate I've just marked it

[jira] [Commented] (SPARK-28984) csv files should support multi-character separators

2019-09-08 Thread cheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925316#comment-16925316 ] cheng commented on SPARK-28984: --- My current alternative will cause the csv file to be read

[jira] [Commented] (SPARK-28970) implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925327#comment-16925327 ] Wenchen Fan commented on SPARK-28970: - {{USE foo.bar}} can be ambiguous, but I think

[jira] [Commented] (SPARK-29015) Can not support "add jar" on JDK 11

2019-09-08 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925348#comment-16925348 ] angerszhu commented on SPARK-29015: --- I have tried in Java8, the same error, maybe not

[jira] [Commented] (SPARK-28042) Support mapping spark.local.dir to hostPath volume

2019-09-08 Thread Jiaxin Shan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925349#comment-16925349 ] Jiaxin Shan commented on SPARK-28042: - [~dongjoon] Thanks! I will try to cherry-pick

[jira] [Commented] (SPARK-26205) Optimize InSet expression for bytes, shorts, ints, dates

2019-09-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925361#comment-16925361 ] Wenchen Fan commented on SPARK-26205: - I just noticed that the new codegen of `InSet

[jira] [Assigned] (SPARK-28916) Generated SpecificSafeProjection.apply method grows beyond 64 KB when use SparkSQL

2019-09-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28916: --- Assignee: Marco Gaido > Generated SpecificSafeProjection.apply method grows beyond 64 KB wh

[jira] [Resolved] (SPARK-28916) Generated SpecificSafeProjection.apply method grows beyond 64 KB when use SparkSQL

2019-09-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28916. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25642 [https://gith

[jira] [Resolved] (SPARK-29000) [SQL] Decimal precision overflow when don't allow precision loss

2019-09-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29000. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25701 [https://gith

[jira] [Assigned] (SPARK-29000) [SQL] Decimal precision overflow when don't allow precision loss

2019-09-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29000: --- Assignee: feiwang > [SQL] Decimal precision overflow when don't allow precision loss >

[jira] [Resolved] (SPARK-28637) Thriftserver can not support interval type

2019-09-08 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28637. - Fix Version/s: 3.0.0 Assignee: Yuming Wang Resolution: Fixed > Thriftserver can not supp