[jira] [Updated] (SPARK-17022) Potential deadlock in driver handling message

2017-02-07 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-17022: - Well, `YarnSchedulerEndpoint` is a **ThreadSafeRpcEndpoint**, which can only handle one message at a

[jira] [Created] (SPARK-18920) Update outdated date formatting

2016-12-18 Thread Tao Wang (JIRA)
Tao Wang created SPARK-18920: Summary: Update outdated date formatting Key: SPARK-18920 URL: https://issues.apache.org/jira/browse/SPARK-18920 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-18606) [HISTORYSERVER]It will check html elems while searching HistoryServer

2016-11-28 Thread Tao Wang (JIRA)
Tao Wang created SPARK-18606: Summary: [HISTORYSERVER]It will check html elems while searching HistoryServer Key: SPARK-18606 URL: https://issues.apache.org/jira/browse/SPARK-18606 Project: Spark

[jira] [Created] (SPARK-18396) "Duration" column makes search result confused, maybe we should make it unsearchable

2016-11-10 Thread Tao Wang (JIRA)
Tao Wang created SPARK-18396: Summary: "Duration" column makes search result confused, maybe we should make it unsearchable Key: SPARK-18396 URL: https://issues.apache.org/jira/browse/SPARK-18396

[jira] [Commented] (SPARK-18298) HistoryServer use GMT time all time

2016-11-07 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646270#comment-15646270 ] Tao Wang commented on SPARK-18298: -- [~ajbozarth] Thanks for your attention. I think it's the issue 1,

[jira] [Commented] (SPARK-18298) HistoryServer use GMT time all time

2016-11-07 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646269#comment-15646269 ] Tao Wang commented on SPARK-18298: -- [~ajbozarth] Thanks for your attention. I think it's the issue 1,

[jira] [Updated] (SPARK-18298) HistoryServer use GMT time all time

2016-11-07 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-18298: - Description: When I started HistoryServer for reading event logs, the timestamp readed will be parsed

[jira] [Updated] (SPARK-18298) HistoryServer use GMT time all time

2016-11-07 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-18298: - Description: When I started HistoryServer for reading event logs, the timestamp readed will be parsed

[jira] [Created] (SPARK-18298) HistoryServer use GMT time all time

2016-11-06 Thread Tao Wang (JIRA)
Tao Wang created SPARK-18298: Summary: HistoryServer use GMT time all time Key: SPARK-18298 URL: https://issues.apache.org/jira/browse/SPARK-18298 Project: Spark Issue Type: Bug

[jira] [Closed] (SPARK-17610) The failed stage caused by FetchFailed may never be resubmitted

2016-09-21 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang closed SPARK-17610. Resolution: Not A Problem > The failed stage caused by FetchFailed may never be resubmitted >

[jira] [Commented] (SPARK-17610) The failed stage caused by FetchFailed may never be resubmitted

2016-09-21 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15509712#comment-15509712 ] Tao Wang commented on SPARK-17610: -- As reason mentioned in https://github.com/apache/spark/pull/15176,

[jira] [Updated] (SPARK-17610) The failed stage caused by FetchFailed may never be resubmitted

2016-09-21 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-17610: - Description: We have a problem in our environment, in which the failed stage has not been resubmitted

[jira] [Commented] (SPARK-17610) The failed stage caused by FetchFailed may never be resubmitted

2016-09-20 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508362#comment-15508362 ] Tao Wang commented on SPARK-17610: -- cc [~rxin] [~andrewor14] > The failed stage caused by FetchFailed

[jira] [Updated] (SPARK-17610) The failed stage caused by FetchFailed may never be resubmitted

2016-09-20 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-17610: - Summary: The failed stage caused by FetchFailed may never be resubmitted (was: The failed stage caused

[jira] [Created] (SPARK-17610) The failed stage caused FetchFailed may never be resubmitted

2016-09-20 Thread Tao Wang (JIRA)
Tao Wang created SPARK-17610: Summary: The failed stage caused FetchFailed may never be resubmitted Key: SPARK-17610 URL: https://issues.apache.org/jira/browse/SPARK-17610 Project: Spark Issue

[jira] [Commented] (SPARK-17022) Potential deadlock in driver handling message

2016-08-12 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15418488#comment-15418488 ] Tao Wang commented on SPARK-17022: -- looks like they are related, especially with SPARK-16702. >

[jira] [Created] (SPARK-17022) Potential deadlock in driver handling message

2016-08-11 Thread Tao Wang (JIRA)
Tao Wang created SPARK-17022: Summary: Potential deadlock in driver handling message Key: SPARK-17022 URL: https://issues.apache.org/jira/browse/SPARK-17022 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-17010) [MINOR]Wrong description in memory management document

2016-08-10 Thread Tao Wang (JIRA)
Tao Wang created SPARK-17010: Summary: [MINOR]Wrong description in memory management document Key: SPARK-17010 URL: https://issues.apache.org/jira/browse/SPARK-17010 Project: Spark Issue Type:

[jira] [Commented] (SPARK-14559) Netty RPC didn't check channel is active before sending message

2016-08-01 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15403247#comment-15403247 ] Tao Wang commented on SPARK-14559: -- Hi [~zsxwing], Sadly the application is ended now so i can't get the

[jira] [Commented] (SPARK-14559) Netty RPC didn't check channel is active before sending message

2016-07-31 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15401456#comment-15401456 ] Tao Wang commented on SPARK-14559: -- Hi, we have same issues, along with another error sending message:

[jira] [Created] (SPARK-15667) Throw exception if columns number of outputs mismatch the inputs

2016-05-31 Thread Tao Wang (JIRA)
Tao Wang created SPARK-15667: Summary: Throw exception if columns number of outputs mismatch the inputs Key: SPARK-15667 URL: https://issues.apache.org/jira/browse/SPARK-15667 Project: Spark

[jira] [Commented] (SPARK-15015) Log statements lack file name/number

2016-05-19 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291027#comment-15291027 ] Tao Wang commented on SPARK-15015: -- I think it's a nice improvement for us to locate the code line more

[jira] [Created] (SPARK-14258) change scope of some functions in KafkaCluster

2016-03-29 Thread Tao Wang (JIRA)
Tao Wang created SPARK-14258: Summary: change scope of some functions in KafkaCluster Key: SPARK-14258 URL: https://issues.apache.org/jira/browse/SPARK-14258 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-13935) Other clients' connection hang up when someone do huge load

2016-03-20 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197491#comment-15197491 ] Tao Wang edited comment on SPARK-13935 at 3/16/16 3:20 PM: --- after checking the

[jira] [Comment Edited] (SPARK-13935) Other clients' connection hang up when someone do huge load

2016-03-19 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197554#comment-15197554 ] Tao Wang edited comment on SPARK-13935 at 3/16/16 3:51 PM: --- [~marmbrus]

[jira] [Updated] (SPARK-13935) Other clients' connection hang up when someone do huge load

2016-03-19 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-13935: - Description: We run a sql like "insert overwrite table store_returns partition (sr_returned_date)

[jira] [Created] (SPARK-13935) Other clients' connection hang up when someone do huge load

2016-03-19 Thread Tao Wang (JIRA)
Tao Wang created SPARK-13935: Summary: Other clients' connection hang up when someone do huge load Key: SPARK-13935 URL: https://issues.apache.org/jira/browse/SPARK-13935 Project: Spark Issue

[jira] [Updated] (SPARK-13935) Other clients' connection hang up when someone do huge load

2016-03-19 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-13935: - Affects Version/s: 1.6.0 1.6.1 > Other clients' connection hang up when someone

[jira] [Commented] (SPARK-13935) Other clients' connection hang up when someone do huge load

2016-03-19 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197491#comment-15197491 ] Tao Wang commented on SPARK-13935: -- after checking the latest codes on github, i believe same problem

[jira] [Commented] (SPARK-13935) Other clients' connection hang up when someone do huge load

2016-03-18 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197554#comment-15197554 ] Tao Wang commented on SPARK-13935: -- [~marmbrus][~liancheng][~chenghao] > Other clients' connection

[jira] [Commented] (SPARK-13852) handle the InterruptedException caused by YARN HA switch

2016-03-14 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192853#comment-15192853 ] Tao Wang commented on SPARK-13852: -- will push the codes later :) > handle the InterruptedException

[jira] [Created] (SPARK-13852) handle the InterruptedException caused by YARN HA switch

2016-03-14 Thread Tao Wang (JIRA)
Tao Wang created SPARK-13852: Summary: handle the InterruptedException caused by YARN HA switch Key: SPARK-13852 URL: https://issues.apache.org/jira/browse/SPARK-13852 Project: Spark Issue

[jira] [Updated] (SPARK-12752) Can Thrift Server connect to Hive Metastore?

2016-01-11 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-12752: - Description: Before we use Thrift Server directly connecting to database such as mysql to store its

[jira] [Updated] (SPARK-12752) Can Thrift Server connect to Hive Metastore?

2016-01-11 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-12752: - Description: Before we use Thrift Server directly connecting to database such as mysql to store its

[jira] [Created] (SPARK-12752) Can Thrift Server connect to Hive Metastore?

2016-01-11 Thread Tao Wang (JIRA)
Tao Wang created SPARK-12752: Summary: Can Thrift Server connect to Hive Metastore? Key: SPARK-12752 URL: https://issues.apache.org/jira/browse/SPARK-12752 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-12752) Can Thrift Server connect to Hive Metastore?

2016-01-11 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-12752: - Attachment: JDBCServer.log > Can Thrift Server connect to Hive Metastore? >

[jira] [Created] (SPARK-10416) Thrift Server cannot do isolation for different users

2015-09-02 Thread Tao Wang (JIRA)
Tao Wang created SPARK-10416: Summary: Thrift Server cannot do isolation for different users Key: SPARK-10416 URL: https://issues.apache.org/jira/browse/SPARK-10416 Project: Spark Issue Type:

[jira] [Commented] (SPARK-10416) Thrift Server cannot do isolation for different users

2015-09-02 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14727036#comment-14727036 ] Tao Wang commented on SPARK-10416: -- BTW the build command is "mvn -Pbigtop-dist -Phive-thriftserver

[jira] [Created] (SPARK-9596) We better not load Hadoop classes again

2015-08-04 Thread Tao Wang (JIRA)
Tao Wang created SPARK-9596: --- Summary: We better not load Hadoop classes again Key: SPARK-9596 URL: https://issues.apache.org/jira/browse/SPARK-9596 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-9496) Do not print password in Hive Config

2015-07-30 Thread Tao Wang (JIRA)
Tao Wang created SPARK-9496: --- Summary: Do not print password in Hive Config Key: SPARK-9496 URL: https://issues.apache.org/jira/browse/SPARK-9496 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-5210) Support log rolling in EventLogger

2015-07-20 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14633548#comment-14633548 ] Tao Wang commented on SPARK-5210: - Except the OOM caused by replaying the entire log, do

[jira] [Commented] (SPARK-5210) Support log rolling in EventLogger

2015-07-14 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626325#comment-14626325 ] Tao Wang commented on SPARK-5210: - Hi [~joshrosen], we found same problem in streaming /

[jira] [Comment Edited] (SPARK-5210) Support log rolling in EventLogger

2015-07-14 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626325#comment-14626325 ] Tao Wang edited comment on SPARK-5210 at 7/14/15 1:21 PM: -- Hi

[jira] [Updated] (SPARK-8676) After TGT expires, Thrift Server get No valid credentials provided exception

2015-06-28 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-8676: Summary: After TGT expires, Thrift Server get No valid credentials provided exception (was: After TGT

[jira] [Created] (SPARK-8676) After TGT expires, Thrift Server get No invalid credentials exception

2015-06-26 Thread Tao Wang (JIRA)
Tao Wang created SPARK-8676: --- Summary: After TGT expires, Thrift Server get No invalid credentials exception Key: SPARK-8676 URL: https://issues.apache.org/jira/browse/SPARK-8676 Project: Spark

[jira] [Commented] (SPARK-6882) Spark ThriftServer2 Kerberos failed encountering java.lang.IllegalArgumentException: Unknown auth type: null Allowed values are: [auth-int, auth-conf, auth]

2015-06-17 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589398#comment-14589398 ] Tao Wang commented on SPARK-6882: - Did you try to set hive.server2.thrift.sasl.qop to

[jira] [Created] (SPARK-8290) spark class command builder need read SPARK_JAVA_OPTS

2015-06-10 Thread Tao Wang (JIRA)
Tao Wang created SPARK-8290: --- Summary: spark class command builder need read SPARK_JAVA_OPTS Key: SPARK-8290 URL: https://issues.apache.org/jira/browse/SPARK-8290 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-8290) spark class command builder need read SPARK_JAVA_OPTS and SPARK_DRIVER_MEMORY properly

2015-06-10 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-8290: Description: SPARK_JAVA_OPTS was missed in reconstructing the launcher part, we should add it back so

[jira] [Updated] (SPARK-8290) spark class command builder need read SPARK_JAVA_OPTS and SPARK_DRIVER_MEMORY properly

2015-06-10 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-8290: Summary: spark class command builder need read SPARK_JAVA_OPTS and SPARK_DRIVER_MEMORY properly (was:

[jira] [Updated] (SPARK-8290) spark class command builder need read SPARK_JAVA_OPTS and SPARK_DRIVER_MEMORY properly

2015-06-10 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-8290: Description: SPARK_JAVA_OPTS was missed in reconstructing the launcher part, we should add it back so

[jira] [Created] (SPARK-8273) Driver hangs up when yarn shutdown in client mode

2015-06-09 Thread Tao Wang (JIRA)
Tao Wang created SPARK-8273: --- Summary: Driver hangs up when yarn shutdown in client mode Key: SPARK-8273 URL: https://issues.apache.org/jira/browse/SPARK-8273 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-7945) Do trim to values of properties

2015-05-29 Thread Tao Wang (JIRA)
Tao Wang created SPARK-7945: --- Summary: Do trim to values of properties Key: SPARK-7945 URL: https://issues.apache.org/jira/browse/SPARK-7945 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-7524) add configs for keytab and principal, move originals to internal

2015-05-24 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-7524: Description: As spark now supports long running service by updating tokens for namenode, but only accept

[jira] [Created] (SPARK-7846) Use different way to pass spark.yarn.keytab and spark.yarn.principal in different modes

2015-05-24 Thread Tao Wang (JIRA)
Tao Wang created SPARK-7846: --- Summary: Use different way to pass spark.yarn.keytab and spark.yarn.principal in different modes Key: SPARK-7846 URL: https://issues.apache.org/jira/browse/SPARK-7846 Project:

[jira] [Created] (SPARK-7759) Failed to start thrift server when metastore is postgre sql

2015-05-20 Thread Tao Wang (JIRA)
Tao Wang created SPARK-7759: --- Summary: Failed to start thrift server when metastore is postgre sql Key: SPARK-7759 URL: https://issues.apache.org/jira/browse/SPARK-7759 Project: Spark Issue Type:

[jira] [Created] (SPARK-7758) Failed to start thrift server when metastore is postgre sql

2015-05-20 Thread Tao Wang (JIRA)
Tao Wang created SPARK-7758: --- Summary: Failed to start thrift server when metastore is postgre sql Key: SPARK-7758 URL: https://issues.apache.org/jira/browse/SPARK-7758 Project: Spark Issue Type:

[jira] [Closed] (SPARK-7759) Failed to start thrift server when metastore is postgre sql

2015-05-20 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang closed SPARK-7759. --- Resolution: Duplicate Post twice as network issue. Close this. Failed to start thrift server when metastore

[jira] [Updated] (SPARK-7758) Failed to start thrift server when metastore is postgre sql

2015-05-20 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-7758: Attachment: hive-site.xml Failed to start thrift server when metastore is postgre sql

[jira] [Updated] (SPARK-7758) Failed to start thrift server when metastore is postgre sql

2015-05-20 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-7758: Attachment: with no error.log with error.log Failed to start thrift server when metastore

[jira] [Updated] (SPARK-7758) Failed to start thrift server when metastore is postgre sql

2015-05-20 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-7758: Priority: Critical (was: Major) Failed to start thrift server when metastore is postgre sql

[jira] [Closed] (SPARK-4669) Allow users to set arbitrary akka configurations via property file

2015-05-14 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang closed SPARK-4669. --- Resolution: Won't Fix Per Prashant's comments in https://github.com/apache/spark/pull/3551, I closed this.

[jira] [Created] (SPARK-7524) add configs for keytab and principal, move originals to internal

2015-05-11 Thread Tao Wang (JIRA)
Tao Wang created SPARK-7524: --- Summary: add configs for keytab and principal, move originals to internal Key: SPARK-7524 URL: https://issues.apache.org/jira/browse/SPARK-7524 Project: Spark Issue

[jira] [Closed] (SPARK-7086) Do not retry when public service start on port

2015-04-26 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang closed SPARK-7086. --- Resolution: Later See comments under https://github.com/apache/spark/pull/5657, we will use another policy

[jira] [Reopened] (SPARK-7086) Do not retry when public service start on port

2015-04-26 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang reopened SPARK-7086: - Just change the solution state. Do not retry when public service start on port

[jira] [Closed] (SPARK-7086) Do not retry when public service start on port

2015-04-26 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang closed SPARK-7086. --- Resolution: Fixed See comments under https://github.com/apache/spark/pull/5657, we will use another policy

[jira] [Updated] (SPARK-2750) Add Https support for Web UI

2015-04-25 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-2750: Attachment: exception on yarn when https enabled.txt Add Https support for Web UI

[jira] [Created] (SPARK-7086) Do not retry when public service start on port

2015-04-23 Thread Tao Wang (JIRA)
Tao Wang created SPARK-7086: --- Summary: Do not retry when public service start on port Key: SPARK-7086 URL: https://issues.apache.org/jira/browse/SPARK-7086 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-7031) let thrift server take SPARK_DAEMON_MEMORY and SPARK_DAEMON_JAVA_OPTS

2015-04-21 Thread Tao Wang (JIRA)
Tao Wang created SPARK-7031: --- Summary: let thrift server take SPARK_DAEMON_MEMORY and SPARK_DAEMON_JAVA_OPTS Key: SPARK-7031 URL: https://issues.apache.org/jira/browse/SPARK-7031 Project: Spark

[jira] [Closed] (SPARK-6933) Thrift Server couldn't strip .inprogress suffix after being stopped

2015-04-16 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang closed SPARK-6933. --- Resolution: Duplicate Thrift Server couldn't strip .inprogress suffix after being stopped

[jira] [Updated] (SPARK-6933) Thrift Server couldn't strip .inprogress suffix after being stopped

2015-04-15 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-6933: Affects Version/s: 1.3.0 Thrift Server couldn't strip .inprogress suffix after being stopped

[jira] [Commented] (SPARK-6933) Thrift Server couldn't strip .inprogress suffix after being stopped

2015-04-15 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496200#comment-14496200 ] Tao Wang commented on SPARK-6933: - BTW the event log file on hdfs is still with

[jira] [Created] (SPARK-6933) Thrift Server couldn't strip .inprogress suffix after being stopped

2015-04-15 Thread Tao Wang (JIRA)
Tao Wang created SPARK-6933: --- Summary: Thrift Server couldn't strip .inprogress suffix after being stopped Key: SPARK-6933 URL: https://issues.apache.org/jira/browse/SPARK-6933 Project: Spark

[jira] [Commented] (SPARK-6933) Thrift Server couldn't strip .inprogress suffix after being stopped

2015-04-15 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496437#comment-14496437 ] Tao Wang commented on SPARK-6933: - P.P.S: Tested with SparkPi, it worked fine. Now this

[jira] [Created] (SPARK-6894) typo spark.executor.extraLibraryOptions = spark.executor.extraLibraryPath

2015-04-14 Thread Tao Wang (JIRA)
Tao Wang created SPARK-6894: --- Summary: typo spark.executor.extraLibraryOptions = spark.executor.extraLibraryPath Key: SPARK-6894 URL: https://issues.apache.org/jira/browse/SPARK-6894 Project: Spark

[jira] [Created] (SPARK-6879) Check if the app is completed before clean it up

2015-04-13 Thread Tao Wang (JIRA)
Tao Wang created SPARK-6879: --- Summary: Check if the app is completed before clean it up Key: SPARK-6879 URL: https://issues.apache.org/jira/browse/SPARK-6879 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-6758) Block jetty's log as we have already shaded it

2015-04-07 Thread Tao Wang (JIRA)
Tao Wang created SPARK-6758: --- Summary: Block jetty's log as we have already shaded it Key: SPARK-6758 URL: https://issues.apache.org/jira/browse/SPARK-6758 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-6639) Create a new script to start multiple masters

2015-04-02 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392374#comment-14392374 ] Tao Wang commented on SPARK-6639: - I'd say this is a useful feature for Standalone

[jira] [Created] (SPARK-6639) Create a new script to start multiple masters

2015-03-31 Thread Tao Wang (JIRA)
Tao Wang created SPARK-6639: --- Summary: Create a new script to start multiple masters Key: SPARK-6639 URL: https://issues.apache.org/jira/browse/SPARK-6639 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-6443) Could not submit app in standalone cluster mode when HA is enabled

2015-03-27 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-6443: Priority: Critical (was: Major) Could not submit app in standalone cluster mode when HA is enabled

[jira] [Created] (SPARK-6552) expose start-slave.sh to user and update outdated doc

2015-03-26 Thread Tao Wang (JIRA)
Tao Wang created SPARK-6552: --- Summary: expose start-slave.sh to user and update outdated doc Key: SPARK-6552 URL: https://issues.apache.org/jira/browse/SPARK-6552 Project: Spark Issue Type:

[jira] [Updated] (SPARK-6552) expose start-slave.sh to user and update outdated doc

2015-03-26 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-6552: Component/s: Documentation expose start-slave.sh to user and update outdated doc

[jira] [Created] (SPARK-6559) specify port of python gateway server and let it retry if failed

2015-03-26 Thread Tao Wang (JIRA)
Tao Wang created SPARK-6559: --- Summary: specify port of python gateway server and let it retry if failed Key: SPARK-6559 URL: https://issues.apache.org/jira/browse/SPARK-6559 Project: Spark Issue

[jira] [Updated] (SPARK-6443) Could not submit app in standalone cluster mode when HA is enabled

2015-03-23 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-6443: Description: After digging some codes, I found user could not submit app in standalone cluster mode when

[jira] [Updated] (SPARK-6443) Could not submit app in standalone cluster mode when HA is enabled

2015-03-23 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-6443: Description: After digging some codes, I found user could not submit app in standalone cluster mode when

[jira] [Created] (SPARK-6426) User could also point the yarn cluster config directory via YARN_CONF_DIR

2015-03-20 Thread Tao Wang (JIRA)
Tao Wang created SPARK-6426: --- Summary: User could also point the yarn cluster config directory via YARN_CONF_DIR Key: SPARK-6426 URL: https://issues.apache.org/jira/browse/SPARK-6426 Project: Spark

[jira] [Updated] (SPARK-6443) Could not submit app in standalone cluster mode when HA is enabled

2015-03-20 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-6443: Description: After digging some codes, I found user could not submit app in standalone cluster mode when

[jira] [Created] (SPARK-6443) Could not submit app in standalone cluster mode when HA is enabled

2015-03-20 Thread Tao Wang (JIRA)
Tao Wang created SPARK-6443: --- Summary: Could not submit app in standalone cluster mode when HA is enabled Key: SPARK-6443 URL: https://issues.apache.org/jira/browse/SPARK-6443 Project: Spark

[jira] [Commented] (SPARK-3438) Support for accessing secured HDFS in Standalone Mode

2015-03-10 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356114#comment-14356114 ] Tao Wang commented on SPARK-3438: - Looks like this issue is same with that in SPARK-5158.

[jira] [Comment Edited] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

2015-02-11 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315951#comment-14315951 ] Tao Wang edited comment on SPARK-5159 at 2/12/15 4:15 AM: -- I have

[jira] [Commented] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

2015-02-11 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315951#comment-14315951 ] Tao Wang commented on SPARK-5159: - I have tested this on branch 1.2, below are results:

[jira] [Commented] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

2015-02-11 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315955#comment-14315955 ] Tao Wang commented on SPARK-5159: - You said that *hive.server2.enable.doAs* is not

[jira] [Comment Edited] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

2015-02-11 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315951#comment-14315951 ] Tao Wang edited comment on SPARK-5159 at 2/11/15 10:18 AM: --- I

[jira] [Updated] (SPARK-5719) allow daemons to bind to specified host

2015-02-10 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-5719: Description: Now web ui binds to 0.0.0.0. When multiple network plane is enabled, we may try to bind ui

[jira] [Created] (SPARK-5719) allow UIs to bind to specified host

2015-02-10 Thread Tao Wang (JIRA)
Tao Wang created SPARK-5719: --- Summary: allow UIs to bind to specified host Key: SPARK-5719 URL: https://issues.apache.org/jira/browse/SPARK-5719 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-5719) allow daemons to bind to specified host

2015-02-10 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-5719: Summary: allow daemons to bind to specified host (was: allow UIs to bind to specified host) allow

[jira] [Updated] (SPARK-5719) allow daemons to bind to specified host

2015-02-10 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-5719: Description: Now web ui binds to 0.0.0.0. When multiple network plane is enabled, we may try to bind ui