[jira] [Commented] (LIVY-616) Livy Server discovery

2019-08-05 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900602#comment-16900602 ] Saisai Shao commented on LIVY-616: -- [~oshevchenko] you can either push an empty commit or reopen the PR to

[jira] [Assigned] (SPARK-28475) Add regex MetricFilter to GraphiteSink

2019-08-02 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-28475: --- Assignee: Nick Karpov > Add regex MetricFilter to GraphiteSink >

[jira] [Updated] (SPARK-28475) Add regex MetricFilter to GraphiteSink

2019-08-02 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-28475: Priority: Minor (was: Major) > Add regex MetricFilter to GraphiteSink >

[jira] [Resolved] (SPARK-28475) Add regex MetricFilter to GraphiteSink

2019-08-02 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-28475. - Resolution: Resolved Fix Version/s: 3.0.0 > Add regex MetricFilter to GraphiteSink >

[jira] [Commented] (SPARK-28475) Add regex MetricFilter to GraphiteSink

2019-08-02 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16898749#comment-16898749 ] Saisai Shao commented on SPARK-28475: - This is resolved via

[jira] [Closed] (LIVY-597) Upgrade Livy guava dependency

2019-07-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao closed LIVY-597. Resolution: Duplicate > Upgrade Livy guava dependency > - > >

[jira] [Assigned] (LIVY-587) Remove Guava dependency

2019-07-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned LIVY-587: Assignee: Saisai Shao (was: jiewang) > Remove Guava dependency > --- > >

[jira] [Assigned] (LIVY-587) Remove Guava dependency

2019-07-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned LIVY-587: Assignee: jiewang (was: Saisai Shao) > Remove Guava dependency > --- > >

[jira] [Assigned] (LIVY-587) Remove Guava dependency

2019-07-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned LIVY-587: Assignee: jiewang > Remove Guava dependency > --- > > Key:

[jira] [Resolved] (LIVY-587) Remove Guava dependency

2019-07-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved LIVY-587. -- Resolution: Fixed Fix Version/s: 0.7.0 Issue resolved by pull request 181

[jira] [Assigned] (LIVY-613) Livy can't handle the java.sql.Date type correctly

2019-07-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned LIVY-613: Assignee: wyp > Livy can't handle the java.sql.Date type correctly >

[jira] [Resolved] (LIVY-613) Livy can't handle the java.sql.Date type correctly

2019-07-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved LIVY-613. -- Resolution: Fixed Fix Version/s: 0.7.0 Issue resolved by pull request 186

[jira] [Reopened] (LIVY-575) Implement missing metadata operations

2019-07-22 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reopened LIVY-575: -- > Implement missing metadata operations > - > > Key:

[jira] [Updated] (LIVY-609) LDAP auth for Livy thriftserver

2019-07-22 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated LIVY-609: - Priority: Major (was: Minor) > LDAP auth for Livy thriftserver > --- > >

[jira] [Updated] (LIVY-609) LDAP auth for Livy thriftserver

2019-07-22 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated LIVY-609: - Fix Version/s: (was: 0.7.0) > LDAP auth for Livy thriftserver > --- > >

[jira] [Resolved] (LIVY-610) optimization for windows environment build.

2019-07-22 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved LIVY-610. -- Resolution: Fixed Issue resolved by pull request 184 [https://github.com/apache/incubator-livy/pull/184]

[jira] [Commented] (LIVY-575) Implement missing metadata operations

2019-07-18 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887773#comment-16887773 ] Saisai Shao commented on LIVY-575: -- Hi [~mgaido], we have 3 colleagues planning to work on Livy project,

[jira] [Assigned] (SPARK-28106) Spark SQL add jar with wrong hdfs path, SparkContext still add it to jar path ,and cause Task Failed

2019-07-16 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-28106: --- Assignee: angerszhu > Spark SQL add jar with wrong hdfs path, SparkContext still add it to

[jira] [Resolved] (SPARK-28106) Spark SQL add jar with wrong hdfs path, SparkContext still add it to jar path ,and cause Task Failed

2019-07-16 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-28106. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24909

[jira] [Updated] (SPARK-28106) Spark SQL add jar with wrong hdfs path, SparkContext still add it to jar path ,and cause Task Failed

2019-07-16 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-28106: Component/s: Spark Core > Spark SQL add jar with wrong hdfs path, SparkContext still add it to

[jira] [Resolved] (LIVY-582) python test_create_new_session_without_default_config test fails consistently

2019-07-15 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved LIVY-582. -- Resolution: Fixed Fix Version/s: 0.7.0 Issue resolved by pull request 180

[jira] [Assigned] (LIVY-582) python test_create_new_session_without_default_config test fails consistently

2019-07-15 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned LIVY-582: Assignee: Yiheng Wang > python test_create_new_session_without_default_config test fails

[jira] [Assigned] (LIVY-603) upgrade build spark version to 2.4.3

2019-07-11 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned LIVY-603: Assignee: Yiheng Wang > upgrade build spark version to 2.4.3 >

[jira] [Resolved] (LIVY-603) upgrade build spark version to 2.4.3

2019-07-11 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved LIVY-603. -- Resolution: Fixed Issue resolved by pull request 179 [https://github.com/apache/incubator-livy/pull/179]

[jira] [Commented] (LIVY-587) Remove Guava dependency

2019-07-10 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882007#comment-16882007 ] Saisai Shao commented on LIVY-587: -- I would suggest to remove guava rather than upgrade guava version.

[jira] [Comment Edited] (LIVY-587) Remove Guava dependency

2019-07-10 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882007#comment-16882007 ] Saisai Shao edited comment on LIVY-587 at 7/10/19 12:40 PM: I would suggest to

[jira] [Assigned] (SPARK-28202) [Core] [Test] Avoid noises of system props in SparkConfSuite

2019-07-01 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-28202: --- Assignee: ShuMing Li > [Core] [Test] Avoid noises of system props in SparkConfSuite >

[jira] [Resolved] (SPARK-28202) [Core] [Test] Avoid noises of system props in SparkConfSuite

2019-07-01 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-28202. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24998

[jira] [Commented] (SPARK-25299) Use remote storage for persisting shuffle data

2019-07-01 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876070#comment-16876070 ] Saisai Shao commented on SPARK-25299: - Better to post a pdf version [~mcheah] :). > Use remote

[jira] [Commented] (SPARK-25299) Use remote storage for persisting shuffle data

2019-06-28 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874703#comment-16874703 ] Saisai Shao commented on SPARK-25299: - Votes were passed, so what is our plan for code submission?

[jira] [Updated] (SPARK-25299) Use remote storage for persisting shuffle data

2019-06-13 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-25299: Labels: SPIP (was: ) > Use remote storage for persisting shuffle data >

[jira] [Created] (SPARK-27996) Spark UI redirect will be failed behind the https reverse proxy

2019-06-10 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-27996: --- Summary: Spark UI redirect will be failed behind the https reverse proxy Key: SPARK-27996 URL: https://issues.apache.org/jira/browse/SPARK-27996 Project: Spark

[jira] [Commented] (SPARK-15348) Hive ACID

2019-05-21 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844750#comment-16844750 ] Saisai Shao commented on SPARK-15348: - No, it doesn't support hive ACID, it has its own mechanism to

[jira] [Commented] (SPARK-15348) Hive ACID

2019-05-21 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844597#comment-16844597 ] Saisai Shao commented on SPARK-15348: - I think delta lake project is exactly what you want. > Hive

[jira] [Comment Edited] (SPARK-15348) Hive ACID

2019-05-21 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844597#comment-16844597 ] Saisai Shao edited comment on SPARK-15348 at 5/21/19 7:38 AM: -- I think

[jira] [Commented] (SPARK-24615) Accelerator-aware task scheduling for Spark

2019-01-24 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750872#comment-16750872 ] Saisai Shao commented on SPARK-24615: - I'm really sorry about the delay. Due to some changes on my

[jira] [Commented] (SPARK-26512) Spark 2.4.0 is not working with Hadoop 2.8.3 in windows 10

2019-01-04 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734072#comment-16734072 ] Saisai Shao commented on SPARK-26512: - This seems like a Netty version problem,

[jira] [Commented] (SPARK-26512) Spark 2.4.0 is not working with Hadoop 2.8.3 in windows 10?

2019-01-03 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16733740#comment-16733740 ] Saisai Shao commented on SPARK-26512: - Please list the problems you saw, any log or exception. We

[jira] [Updated] (SPARK-26457) Show hadoop configurations in HistoryServer environment tab

2019-01-02 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-26457: Priority: Minor (was: Major) > Show hadoop configurations in HistoryServer environment tab >

[jira] [Resolved] (SPARK-26516) zeppelin with spark on mesos: environment variable setting

2019-01-02 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-26516. - Resolution: Invalid > zeppelin with spark on mesos: environment variable setting >

[jira] [Updated] (SPARK-26513) Trigger GC on executor node idle

2019-01-02 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-26513: Fix Version/s: (was: 3.0.0) > Trigger GC on executor node idle >

[jira] [Commented] (SPARK-26516) zeppelin with spark on mesos: environment variable setting

2019-01-02 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732587#comment-16732587 ] Saisai Shao commented on SPARK-26516: - Questions should go to user@spark mail list. Also if this is

[jira] [Commented] (SPARK-20415) SPARK job hangs while writing DataFrame to HDFS

2018-12-27 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730084#comment-16730084 ] Saisai Shao commented on SPARK-20415: - Have you tried latest version of Spark, does this problem

[jira] [Commented] (SPARK-25299) Use remote storage for persisting shuffle data

2018-12-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16729357#comment-16729357 ] Saisai Shao commented on SPARK-25299: - [~jealous] Can we have a doc about this proposed solution for

[jira] [Assigned] (LIVY-526) Upgrade jetty version

2018-10-13 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned LIVY-526: Assignee: Arun Mahadevan > Upgrade jetty version > - > > Key:

[jira] [Resolved] (LIVY-526) Upgrade jetty version

2018-10-13 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved LIVY-526. -- Resolution: Fixed Fix Version/s: 0.6.0 Issue resolved by pull request 120

[jira] [Updated] (SPARK-25501) Kafka delegation token support

2018-09-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-25501: Labels: SPIP (was: ) > Kafka delegation token support > -- > >

[jira] [Updated] (SPARK-25206) wrong records are returned when Hive metastore schema and parquet schema are in different letter cases

2018-09-25 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-25206: Labels: Parquet correctness known_issue (was: Parquet correctness) > wrong records are returned

[jira] [Assigned] (LIVY-510) Remove support for jdk7

2018-09-19 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned LIVY-510: Assignee: Marcelo Vanzin > Remove support for jdk7 > --- > >

[jira] [Resolved] (LIVY-510) Remove support for jdk7

2018-09-19 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved LIVY-510. -- Resolution: Fixed Fix Version/s: 0.6.0 Issue resolved by pull request 111

[jira] [Commented] (LIVY-507) Livy 0.5 incubating. Dumps output of command run in the browser.

2018-09-11 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16611602#comment-16611602 ] Saisai Shao commented on LIVY-507: -- Frankly saying, some users they just want the opposite, so it is hard

[jira] [Updated] (LIVY-507) Livy 0.5 incubating. Dumps output of command run in the browser.

2018-09-11 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated LIVY-507: - Fix Version/s: (was: 0.5.0) > Livy 0.5 incubating. Dumps output of command run in the browser. >

[jira] [Created] (LIVY-508) Support custom auth filter for LivyServer

2018-09-11 Thread Saisai Shao (JIRA)
Saisai Shao created LIVY-508: Summary: Support custom auth filter for LivyServer Key: LIVY-508 URL: https://issues.apache.org/jira/browse/LIVY-508 Project: Livy Issue Type: Improvement

[jira] [Updated] (LIVY-508) Support custom auth filter for LivyServer

2018-09-11 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated LIVY-508: - Description: Current Livy only supports Spnego auth support, we may have different requirements for auth

[jira] [Assigned] (LIVY-493) Add UTs to the thriftserver module

2018-09-09 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned LIVY-493: Assignee: Marco Gaido > Add UTs to the thriftserver module > -- > >

[jira] [Assigned] (LIVY-491) Add thriftserver module

2018-09-09 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned LIVY-491: Assignee: Marco Gaido > Add thriftserver module > --- > > Key:

[jira] [Resolved] (LIVY-493) Add UTs to the thriftserver module

2018-09-09 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved LIVY-493. -- Resolution: Fixed Fix Version/s: 0.6.0 Issue resolved by pull request 104

[jira] [Resolved] (LIVY-492) Base implementation Livy thriftserver

2018-09-09 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved LIVY-492. -- Resolution: Fixed Fix Version/s: 0.6.0 Issue resolved by pull request 104

[jira] [Resolved] (LIVY-491) Add thriftserver module

2018-09-09 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved LIVY-491. -- Resolution: Fixed Fix Version/s: 0.6.0 Issue resolved by pull request 104

[jira] [Assigned] (SPARK-24615) Accelerator-aware task scheduling for Spark

2018-09-01 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-24615: --- Assignee: (was: Saisai Shao) > Accelerator-aware task scheduling for Spark >

[jira] [Assigned] (SPARK-25183) Spark HiveServer2 registers shutdown hook with JVM, not ShutdownHookManager; race conditions can arise

2018-08-31 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-25183: --- Assignee: Steve Loughran > Spark HiveServer2 registers shutdown hook with JVM, not

[jira] [Resolved] (SPARK-25183) Spark HiveServer2 registers shutdown hook with JVM, not ShutdownHookManager; race conditions can arise

2018-08-31 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-25183. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22186

[jira] [Commented] (SPARK-25206) wrong records are returned when Hive metastore schema and parquet schema are in different letter cases

2018-08-30 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598115#comment-16598115 ] Saisai Shao commented on SPARK-25206: - I see, if it is not going to be merged, let's close this JIRA

[jira] [Commented] (SPARK-25135) insert datasource table may all null when select from view on parquet

2018-08-30 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598111#comment-16598111 ] Saisai Shao commented on SPARK-25135: - What's the ETA of this issue [~yumwang]? > insert datasource

[jira] [Commented] (SPARK-25206) wrong records are returned when Hive metastore schema and parquet schema are in different letter cases

2018-08-30 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598110#comment-16598110 ] Saisai Shao commented on SPARK-25206: - What is the status of this JIRA, are we going to backport, or

[jira] [Updated] (SPARK-24785) Making sure REPL prints Spark UI info and then Welcome message

2018-08-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-24785: Fix Version/s: 2.4.0 > Making sure REPL prints Spark UI info and then Welcome message >

[jira] [Commented] (LIVY-501) Support Spark 2.3 SparkR backend

2018-08-27 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594384#comment-16594384 ] Saisai Shao commented on LIVY-501: -- BTW, branch-0.5 doesn't claim to support Spark 2.3+. > Support Spark

[jira] [Commented] (LIVY-501) Support Spark 2.3 SparkR backend

2018-08-27 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594382#comment-16594382 ] Saisai Shao commented on LIVY-501: -- Yes, I've fixed this issue in master branch

[jira] [Updated] (SPARK-25221) [DEPLOY] Consistent trailing whitespace treatment of conf values

2018-08-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-25221: Target Version/s: (was: 2.3.2, 2.4.0) > [DEPLOY] Consistent trailing whitespace treatment of

[jira] [Commented] (SPARK-25221) [DEPLOY] Consistent trailing whitespace treatment of conf values

2018-08-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593124#comment-16593124 ] Saisai Shao commented on SPARK-25221: - I'm going to remove the target version, I don't think it is a

[jira] [Commented] (SPARK-25131) Event logs missing applicationAttemptId for SparkListenerApplicationStart

2018-08-21 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16587062#comment-16587062 ] Saisai Shao commented on SPARK-25131: - This is by design, not a bug. > Event logs missing

[jira] [Updated] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected

2018-08-20 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-25144: Target Version/s: 2.2.3, 2.3.2 > distinct on Dataset leads to exception due to Managed memory

[jira] [Commented] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected

2018-08-20 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16585482#comment-16585482 ] Saisai Shao commented on SPARK-25144: - Does this exist in master branch? > distinct on Dataset

[jira] [Commented] (SPARK-23679) uiWebUrl show inproper URL when running on YARN

2018-08-20 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16585473#comment-16585473 ] Saisai Shao commented on SPARK-23679: - Let me fix this issue. This is mainly a RM HA introduced

[jira] [Updated] (SPARK-23679) uiWebUrl show inproper URL when running on YARN

2018-08-20 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-23679: Component/s: YARN > uiWebUrl show inproper URL when running on YARN >

[jira] [Commented] (SPARK-25114) RecordBinaryComparator may return wrong result when subtraction between two words is divisible by Integer.MAX_VALUE

2018-08-19 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16585321#comment-16585321 ] Saisai Shao commented on SPARK-25114: - What's the ETA of this issue [~jiangxb1987]? >

[jira] [Commented] (LIVY-489) Expose a JDBC endpoint for Livy

2018-08-15 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16581056#comment-16581056 ] Saisai Shao commented on LIVY-489: -- Hi [~mgaido], let's combine task 2, 3, 4 together, and 5, 6

[jira] [Commented] (LIVY-489) Expose a JDBC endpoint for Livy

2018-08-13 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578207#comment-16578207 ] Saisai Shao commented on LIVY-489: -- BTW, [~mgaido] do you have a branch or a diff so that I can take a

[jira] [Commented] (LIVY-489) Expose a JDBC endpoint for Livy

2018-08-13 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578133#comment-16578133 ] Saisai Shao commented on LIVY-489: -- I see. But it is hard to review for such a big thing, it would be

[jira] [Commented] (SPARK-25020) Unable to Perform Graceful Shutdown in Spark Streaming with Hadoop 2.8

2018-08-12 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577846#comment-16577846 ] Saisai Shao commented on SPARK-25020: - Yes, we also met the same issue. This is more like a Hadoop

[jira] [Commented] (LIVY-489) Expose a JDBC endpoint for Livy

2018-08-12 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1650#comment-1650 ] Saisai Shao commented on LIVY-489: -- Hi [~mgaido] can you please also list out the tasks you're planning to

[jira] [Commented] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

2018-08-09 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575778#comment-16575778 ] Saisai Shao commented on SPARK-25084: - I see. Unfortunately I've cut the RC4, if it worth to include

[jira] [Commented] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

2018-08-09 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575774#comment-16575774 ] Saisai Shao commented on SPARK-25084: - Is this a regression or just a bug existed in old version? >

[jira] [Commented] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

2018-08-09 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575772#comment-16575772 ] Saisai Shao commented on SPARK-25084: - I'm already preparing new RC4. If this is not a severe issue,

[jira] [Updated] (SPARK-24948) SHS filters wrongly some applications due to permission check

2018-08-07 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-24948: Fix Version/s: 2.2.3 > SHS filters wrongly some applications due to permission check >

[jira] [Assigned] (SPARK-24948) SHS filters wrongly some applications due to permission check

2018-08-07 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-24948: --- Assignee: Marco Gaido > SHS filters wrongly some applications due to permission check >

[jira] [Updated] (SPARK-24948) SHS filters wrongly some applications due to permission check

2018-08-07 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-24948: Fix Version/s: 2.3.2 > SHS filters wrongly some applications due to permission check >

[jira] [Commented] (SPARK-22634) Update Bouncy castle dependency

2018-08-07 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572542#comment-16572542 ] Saisai Shao commented on SPARK-22634: - [~srowen] I'm wondering if it is possible to upgrade to

[jira] [Commented] (SPARK-25030) SparkSubmit.doSubmit will not return result if the mainClass submitted creates a Timer()

2018-08-06 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16570995#comment-16570995 ] Saisai Shao commented on SPARK-25030: - I would like to see more about this issue. >

[jira] [Updated] (SPARK-24948) SHS filters wrongly some applications due to permission check

2018-08-02 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-24948: Priority: Blocker (was: Major) > SHS filters wrongly some applications due to permission check >

[jira] [Updated] (SPARK-24948) SHS filters wrongly some applications due to permission check

2018-08-02 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-24948: Target Version/s: 2.2.3, 2.3.2, 2.4.0 > SHS filters wrongly some applications due to permission

[jira] [Commented] (SPARK-24615) Accelerator-aware task scheduling for Spark

2018-07-31 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16564562#comment-16564562 ] Saisai Shao commented on SPARK-24615: - Leveraging dynamic allocation to tear down and bring up

[jira] [Comment Edited] (SPARK-24615) Accelerator-aware task scheduling for Spark

2018-07-31 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16564562#comment-16564562 ] Saisai Shao edited comment on SPARK-24615 at 8/1/18 12:35 AM: -- Leveraging

[jira] [Comment Edited] (SPARK-24615) Accelerator-aware task scheduling for Spark

2018-07-31 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16563730#comment-16563730 ] Saisai Shao edited comment on SPARK-24615 at 7/31/18 2:16 PM: -- Hi

[jira] [Commented] (SPARK-24615) Accelerator-aware task scheduling for Spark

2018-07-31 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16563730#comment-16563730 ] Saisai Shao commented on SPARK-24615: - Hi [~tgraves], I think eval() might unnecessarily break the

[jira] [Resolved] (SPARK-24975) Spark history server REST API /api/v1/version returns error 404

2018-07-31 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-24975. - Resolution: Duplicate > Spark history server REST API /api/v1/version returns error 404 >

[jira] [Updated] (SPARK-24957) Decimal arithmetic can lead to wrong values using codegen

2018-07-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-24957: Target Version/s: 2.4.0 > Decimal arithmetic can lead to wrong values using codegen >

[jira] [Commented] (SPARK-24957) Decimal arithmetic can lead to wrong values using codegen

2018-07-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561334#comment-16561334 ] Saisai Shao commented on SPARK-24957: - Not necessary to mark as blocker, we still have plenty of

[jira] [Updated] (SPARK-24932) Allow update mode for streaming queries with join

2018-07-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-24932: Target Version/s: (was: 2.3.2) > Allow update mode for streaming queries with join >

[jira] [Commented] (SPARK-24932) Allow update mode for streaming queries with join

2018-07-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561331#comment-16561331 ] Saisai Shao commented on SPARK-24932: - I'm going to remove the target version for this JIRA.

<    1   2   3   4   5   6   7   8   9   10   >