[GitHub] spark issue #15628: [SPARK-17471][ML] Add compressed method to ML matrices

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15628 **[Test build #75083 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75083/testReport)** for PR 15628 at commit

[GitHub] spark issue #17394: [SPARK-20067] [SQL] Use treeString to print out the tabl...

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17394 **[Test build #75082 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75082/testReport)** for PR 17394 at commit

[GitHub] spark pull request #17394: [SPARK-20067] [SQL] Use treeString to print out t...

2017-03-22 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/17394 [SPARK-20067] [SQL] Use treeString to print out the table schema for CatalogTable ### What changes were proposed in this pull request? Follow what we did in Dataset API `printSchema`, we

[GitHub] spark issue #17335: [SPARK-19995][Hive][Yarn] Using real user to initialize ...

2017-03-22 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/17335 Broaden this issue a bit. Currently in driver side (client mode), issued delegation tokens are not added into current ugi, this makes follow-up hdfs/metastore/hbase communication still use tgt

[GitHub] spark issue #17355: [SPARK-19955][WIP][PySpark] Jenkins Python Conda based t...

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17355 **[Test build #75081 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75081/testReport)** for PR 17355 at commit

[GitHub] spark issue #17219: [SPARK-19876][SS][WIP] OneTime Trigger Executor

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17219 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75080/ Test FAILed. ---

[GitHub] spark issue #17219: [SPARK-19876][SS][WIP] OneTime Trigger Executor

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17219 **[Test build #75080 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75080/testReport)** for PR 17219 at commit

[GitHub] spark issue #17219: [SPARK-19876][SS][WIP] OneTime Trigger Executor

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17219 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17219: [SPARK-19876][SS][WIP] OneTime Trigger Executor

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17219 **[Test build #75080 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75080/testReport)** for PR 17219 at commit

[GitHub] spark issue #17389: [MINOR][BUILD] Fix javadoc8 break

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17389 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75076/ Test PASSed. ---

[GitHub] spark issue #17389: [MINOR][BUILD] Fix javadoc8 break

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17389 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17389: [MINOR][BUILD] Fix javadoc8 break

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17389 **[Test build #75076 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75076/testReport)** for PR 17389 at commit

[GitHub] spark pull request #17342: [SPARK-12868][SQL] Allow adding jars from hdfs

2017-03-22 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/17342#discussion_r107583524 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -2767,3 +2767,24 @@ private[spark] class CircularBuffer(sizeInBytes: Int = 10240)

[GitHub] spark issue #17393: [SPARK-20066] [CORE] Add explicit SecurityManager(SparkC...

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17393 **[Test build #75079 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75079/testReport)** for PR 17393 at commit

[GitHub] spark pull request #17393: [SPARK-20066] [CORE] Add explicit SecurityManager...

2017-03-22 Thread markgrover
GitHub user markgrover opened a pull request: https://github.com/apache/spark/pull/17393 [SPARK-20066] [CORE] Add explicit SecurityManager(SparkConf) constructor for backwards compatibility with Java. ## What changes were proposed in this pull request? This adds an

[GitHub] spark issue #17388: [SPARK-20059][YARN] Use the correct classloader for HBas...

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17388 **[Test build #75078 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75078/testReport)** for PR 17388 at commit

[GitHub] spark pull request #17268: [SPARK-19932][SS] Disallow a case that might caus...

2017-03-22 Thread lw-lin
Github user lw-lin closed the pull request at: https://github.com/apache/spark/pull/17268 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17268: [SPARK-19932][SS] Disallow a case that might cause OOM f...

2017-03-22 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/17268 Thanks for the comments! Closing this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16905 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75072/ Test PASSed. ---

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16905 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16905 **[Test build #75072 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75072/testReport)** for PR 16905 at commit

[GitHub] spark issue #17355: [SPARK-19955][WIP][PySpark] Jenkins Python Conda based t...

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17355 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17355: [SPARK-19955][WIP][PySpark] Jenkins Python Conda based t...

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17355 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75073/ Test FAILed. ---

[GitHub] spark issue #17355: [SPARK-19955][WIP][PySpark] Jenkins Python Conda based t...

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17355 **[Test build #75073 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75073/testReport)** for PR 17355 at commit

[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...

2017-03-22 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/17276 You are so kind person. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16905 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75070/ Test PASSed. ---

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16905 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16905 **[Test build #75070 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75070/testReport)** for PR 16905 at commit

[GitHub] spark issue #17392: [SPARK-20008] [SQL] DISTINCT and EXCEPT Support on DataF...

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17392 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75075/ Test FAILed. ---

[GitHub] spark issue #17392: [SPARK-20008] [SQL] DISTINCT and EXCEPT Support on DataF...

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17392 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17388: [SPARK-20059][YARN] Use the correct classloader for HBas...

2017-03-22 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/17388 @vanzin @tgravescs @mridulm do you think it necessary to add additional jars and main jar into classloader for yarn cluster mode? In my class I run Spark with HBase in secure cluster, so

[GitHub] spark issue #17392: [SPARK-20008] [SQL] DISTINCT and EXCEPT Support on DataF...

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17392 **[Test build #75075 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75075/testReport)** for PR 17392 at commit

[GitHub] spark issue #17276: [SPARK-19937] Collect metrics of block sizes when shuffl...

2017-03-22 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/17276 no worries, I'm just not sure when to look again, with all the notifications from your commits. Committers tend to think that something is ready to review if its passing tests, so its helpful to add

[GitHub] spark issue #17166: [SPARK-19820] [core] Allow reason to be specified for ta...

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17166 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17166: [SPARK-19820] [core] Allow reason to be specified for ta...

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17166 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75069/ Test PASSed. ---

[GitHub] spark issue #17166: [SPARK-19820] [core] Allow reason to be specified for ta...

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17166 **[Test build #75069 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75069/testReport)** for PR 17166 at commit

[GitHub] spark issue #17219: [SPARK-19876][SS][WIP] OneTime Trigger Executor

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17219 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75077/ Test FAILed. ---

[GitHub] spark issue #17219: [SPARK-19876][SS][WIP] OneTime Trigger Executor

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17219 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17219: [SPARK-19876][SS][WIP] OneTime Trigger Executor

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17219 **[Test build #75077 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75077/testReport)** for PR 17219 at commit

[GitHub] spark issue #17219: [SPARK-19876][SS][WIP] OneTime Trigger Executor

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17219 **[Test build #75077 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75077/testReport)** for PR 17219 at commit

[GitHub] spark pull request #17329: [SPARK-19991]FileSegmentManagedBuffer performance...

2017-03-22 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/17329#discussion_r107572297 --- Diff: common/network-common/src/main/java/org/apache/spark/network/buffer/FileSegmentManagedBuffer.java --- @@ -37,13 +37,24 @@ * A {@link

[GitHub] spark issue #16209: [SPARK-10849][SQL] Adds option to the JDBC data source w...

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16209 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75068/ Test PASSed. ---

[GitHub] spark issue #16209: [SPARK-10849][SQL] Adds option to the JDBC data source w...

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16209 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16209: [SPARK-10849][SQL] Adds option to the JDBC data source w...

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16209 **[Test build #75068 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75068/testReport)** for PR 16209 at commit

[GitHub] spark issue #17389: [MINOR][BUILD] Fix javadoc8 break

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17389 **[Test build #75076 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75076/testReport)** for PR 17389 at commit

[GitHub] spark issue #17389: [MINOR][BUILD] Fix javadoc8 break

2017-03-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17389 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #17389: [MINOR][BUILD] Fix javadoc8 break

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17389 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17392: [SPARK-20008] [SQL] DISTINCT and EXCEPT Support on DataF...

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17392 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75071/ Test FAILed. ---

[GitHub] spark issue #17389: [MINOR][BUILD] Fix javadoc8 break

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17389 **[Test build #75067 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75067/testReport)** for PR 17389 at commit

[GitHub] spark issue #17389: [MINOR][BUILD] Fix javadoc8 break

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17389 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75067/ Test FAILed. ---

[GitHub] spark issue #17392: [SPARK-20008] [SQL] DISTINCT and EXCEPT Support on DataF...

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17392 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17392: [SPARK-20008] [SQL] DISTINCT and EXCEPT Support on DataF...

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17392 **[Test build #75071 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75071/testReport)** for PR 17392 at commit

[GitHub] spark issue #17392: [SPARK-20008] [SQL] DISTINCT and EXCEPT Support on DataF...

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17392 **[Test build #75075 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75075/testReport)** for PR 17392 at commit

[GitHub] spark pull request #17392: [SPARK-20008] [SQL] DISTINCT and EXCEPT Support o...

2017-03-22 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17392#discussion_r107569402 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/ObjectHashAggregateExec.scala --- @@ -147,9 +147,13 @@ case class

[GitHub] spark issue #17219: [SPARK-19876][SS][WIP] OneTime Trigger Executor

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17219 **[Test build #75074 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75074/testReport)** for PR 17219 at commit

[GitHub] spark issue #17219: [SPARK-19876][SS][WIP] OneTime Trigger Executor

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17219 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75074/ Test FAILed. ---

[GitHub] spark issue #17219: [SPARK-19876][SS][WIP] OneTime Trigger Executor

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17219 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17312: [SPARK-19973] Display num of executors for the stage.

2017-03-22 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/17312 @rxin because I killed executor1 and it is not active during this stage. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #17219: [SPARK-19876][SS][WIP] OneTime Trigger Executor

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17219 **[Test build #75074 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75074/testReport)** for PR 17219 at commit

[GitHub] spark pull request #17252: [SPARK-19913][SS] Log warning rather than throw A...

2017-03-22 Thread sarutak
Github user sarutak closed the pull request at: https://github.com/apache/spark/pull/17252 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17252: [SPARK-19913][SS] Log warning rather than throw Analysis...

2017-03-22 Thread sarutak
Github user sarutak commented on the issue: https://github.com/apache/spark/pull/17252 Thanks for the comment. I understand the concern relevant to the consistency. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #17276: [SPARK-19937] Collect metrics of block sizes when shuffl...

2017-03-22 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/17276 @squito oh, I feel sorry if this is disturbing. I will mark it as wip. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #17166: [SPARK-19820] [core] Allow reason to be specified for ta...

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17166 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75064/ Test PASSed. ---

[GitHub] spark issue #17166: [SPARK-19820] [core] Allow reason to be specified for ta...

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17166 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17166: [SPARK-19820] [core] Allow reason to be specified for ta...

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17166 **[Test build #75064 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75064/testReport)** for PR 17166 at commit

[GitHub] spark issue #17379: [SPARK-20048][SQL] Cloning SessionState does not clone q...

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17379 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75066/ Test PASSed. ---

[GitHub] spark issue #17379: [SPARK-20048][SQL] Cloning SessionState does not clone q...

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17379 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17379: [SPARK-20048][SQL] Cloning SessionState does not clone q...

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17379 **[Test build #75066 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75066/testReport)** for PR 17379 at commit

[GitHub] spark issue #17355: [SPARK-19955][WIP][PySpark] Jenkins Python Conda based t...

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17355 **[Test build #75073 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75073/testReport)** for PR 17355 at commit

[GitHub] spark issue #17387: [SPARK-20060][Deploy][Kerberos][Spark Shell] Obtain cred...

2017-03-22 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/17387 Does kerberos authentication really work in non-yarn cluster mode? AFAIK I don't see any code which will ship delegation tokens to executors other than yarn. --- If your project is set up for

[GitHub] spark issue #17252: [SPARK-19913][SS] Log warning rather than throw Analysis...

2017-03-22 Thread marmbrus
Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/17252 Thanks for working on this, but I think this is inconsistent with other APIs in Spark. Also for things like the foreach sink, you might actually be expecting the option to affect the partitioning

[GitHub] spark issue #17355: [SPARK-19955][WIP][PySpark] Jenkins Python Conda based t...

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17355 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75063/ Test FAILed. ---

[GitHub] spark issue #17355: [SPARK-19955][WIP][PySpark] Jenkins Python Conda based t...

2017-03-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17355 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17355: [SPARK-19955][WIP][PySpark] Jenkins Python Conda based t...

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17355 **[Test build #75063 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75063/testReport)** for PR 17355 at commit

[GitHub] spark issue #17375: [SPARK-19019][PYTHON][BRANCH-1.6] Fix hijacked `collecti...

2017-03-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17375 (I will close as soon as it gets merged and the one against branch-2.0 too) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16905 **[Test build #75072 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75072/testReport)** for PR 16905 at commit

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-03-22 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16905 Jenkins add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17392: [SPARK-20008] [SQL] DISTINCT and EXCEPT Support on DataF...

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17392 **[Test build #75071 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75071/testReport)** for PR 17392 at commit

[GitHub] spark issue #16209: [SPARK-10849][SQL] Adds option to the JDBC data source w...

2017-03-22 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16209 LGTM pending Jenkins cc @rxin @joshrosen @srowen This is a nice option to have for JDBC users. If no further comment, I will merge it to master tomorrow. Thanks! --- If your

[GitHub] spark pull request #17392: [SPARK-20008] [SQL] DISTINCT and EXCEPT Support o...

2017-03-22 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/17392 [SPARK-20008] [SQL] DISTINCT and EXCEPT Support on DataFrame with Zero Columns ### What changes were proposed in this pull request? So far, our aggregate does not consider the input with

[GitHub] spark pull request #16209: [SPARK-10849][SQL] Adds option to the JDBC data s...

2017-03-22 Thread sureshthalamati
Github user sureshthalamati commented on a diff in the pull request: https://github.com/apache/spark/pull/16209#discussion_r107562733 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala --- @@ -680,19 +681,63 @@ object JdbcUtils

[GitHub] spark pull request #16209: [SPARK-10849][SQL] Adds option to the JDBC data s...

2017-03-22 Thread sureshthalamati
Github user sureshthalamati commented on a diff in the pull request: https://github.com/apache/spark/pull/16209#discussion_r107562849 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/jdbc/JDBCWriteSuite.scala --- @@ -362,4 +363,80 @@ class JDBCWriteSuite extends

[GitHub] spark pull request #16209: [SPARK-10849][SQL] Adds option to the JDBC data s...

2017-03-22 Thread sureshthalamati
Github user sureshthalamati commented on a diff in the pull request: https://github.com/apache/spark/pull/16209#discussion_r107562605 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala --- @@ -680,19 +681,63 @@ object JdbcUtils

[GitHub] spark pull request #17166: [SPARK-19820] [core] Allow reason to be specified...

2017-03-22 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/17166#discussion_r107561714 --- Diff: core/src/main/scala/org/apache/spark/executor/Executor.scala --- @@ -296,12 +298,13 @@ private[spark] class Executor( //

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16905 **[Test build #75070 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75070/testReport)** for PR 16905 at commit

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-03-22 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16905 Jenkins, this is ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-03-22 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16905 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #14617: [SPARK-17019][Core] Expose on-heap and off-heap m...

2017-03-22 Thread ajbozarth
Github user ajbozarth commented on a diff in the pull request: https://github.com/apache/spark/pull/14617#discussion_r107559778 --- Diff: core/src/main/scala/org/apache/spark/storage/StorageUtils.scala --- @@ -60,11 +63,17 @@ class StorageStatus(val blockManagerId: BlockManagerId,

[GitHub] spark pull request #14617: [SPARK-17019][Core] Expose on-heap and off-heap m...

2017-03-22 Thread ajbozarth
Github user ajbozarth commented on a diff in the pull request: https://github.com/apache/spark/pull/14617#discussion_r107557948 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -378,7 +394,37 @@ $(document).ready(function () {

[GitHub] spark pull request #14617: [SPARK-17019][Core] Expose on-heap and off-heap m...

2017-03-22 Thread ajbozarth
Github user ajbozarth commented on a diff in the pull request: https://github.com/apache/spark/pull/14617#discussion_r107557914 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -378,7 +394,37 @@ $(document).ready(function () {

[GitHub] spark pull request #14617: [SPARK-17019][Core] Expose on-heap and off-heap m...

2017-03-22 Thread ajbozarth
Github user ajbozarth commented on a diff in the pull request: https://github.com/apache/spark/pull/14617#discussion_r107557907 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -378,7 +394,37 @@ $(document).ready(function () {

[GitHub] spark pull request #14617: [SPARK-17019][Core] Expose on-heap and off-heap m...

2017-03-22 Thread ajbozarth
Github user ajbozarth commented on a diff in the pull request: https://github.com/apache/spark/pull/14617#discussion_r107559155 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerSource.scala --- @@ -26,35 +26,39 @@ private[spark] class BlockManagerSource(val

[GitHub] spark issue #17166: [SPARK-19820] [core] Allow reason to be specified for ta...

2017-03-22 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/17166 LGTM. I'll merge once tests pass. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17166: [SPARK-19820] [core] Allow reason to be specified for ta...

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17166 **[Test build #75069 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75069/testReport)** for PR 17166 at commit

[GitHub] spark pull request #17166: [SPARK-19820] [core] Allow reason to be specified...

2017-03-22 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/17166#discussion_r107559342 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala --- @@ -239,14 +239,26 @@ private[spark] class TaskSchedulerImpl

[GitHub] spark pull request #17166: [SPARK-19820] [core] Allow reason to be specified...

2017-03-22 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/17166#discussion_r107559290 --- Diff: core/src/main/scala/org/apache/spark/executor/Executor.scala --- @@ -296,12 +298,13 @@ private[spark] class Executor( // If this

[GitHub] spark issue #16209: [SPARK-10849][SQL] Adds option to the JDBC data source w...

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16209 **[Test build #75068 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75068/testReport)** for PR 16209 at commit

[GitHub] spark pull request #15628: [SPARK-17471][ML] Add compressed method to ML mat...

2017-03-22 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/15628#discussion_r107557490 --- Diff: mllib-local/src/main/scala/org/apache/spark/ml/linalg/Matrices.scala --- @@ -291,31 +395,60 @@ class DenseMatrix @Since("2.0.0") ( override

[GitHub] spark issue #17389: [MINOR][BUILD] Fix javadoc8 break

2017-03-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17389 **[Test build #75067 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75067/testReport)** for PR 17389 at commit

[GitHub] spark pull request #15628: [SPARK-17471][ML] Add compressed method to ML mat...

2017-03-22 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/15628#discussion_r107556503 --- Diff: mllib-local/src/main/scala/org/apache/spark/ml/linalg/Matrices.scala --- @@ -587,18 +722,69 @@ class SparseMatrix @Since("2.0.0") ( }

  1   2   3   4   5   >