[GitHub] spark issue #16787: [SPARK-19448][SQL]optimize some duplication functions be...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16787 **[Test build #72674 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72674/testReport)** for PR 16787 at commit

[GitHub] spark issue #16827: [SPARK-19482][CORE] Fail it if 'spark.master' is set wit...

2017-02-09 Thread uncleGen
Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/16827 @srowen Could you please take a second review? cc @rxin also --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #16818: [SPARK-19451][SQL][Core] Underlying integer overflow in ...

2017-02-09 Thread uncleGen
Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/16818 cc @gatorsmile also --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #16826: [WIP][Spark-19540][SQL] Add ability to clone Spar...

2017-02-09 Thread kunalkhamar
Github user kunalkhamar commented on a diff in the pull request: https://github.com/apache/spark/pull/16826#discussion_r100463301 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala --- @@ -213,6 +218,24 @@ class SparkSession private( new

[GitHub] spark issue #16826: [WIP][Spark-19540][SQL] Add ability to clone SparkSessio...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16826 **[Test build #72679 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72679/testReport)** for PR 16826 at commit

[GitHub] spark issue #16826: [WIP][Spark-19540][SQL] Add ability to clone SparkSessio...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16826 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72679/ Test FAILed. ---

[GitHub] spark issue #16826: [WIP][Spark-19540][SQL] Add ability to clone SparkSessio...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16826 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16826: [WIP][Spark-19540][SQL] Add ability to clone SparkSessio...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16826 **[Test build #72679 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72679/testReport)** for PR 16826 at commit

[GitHub] spark issue #16699: [SPARK-18710][ML] Add offset in GLM

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16699 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72672/ Test PASSed. ---

[GitHub] spark issue #16699: [SPARK-18710][ML] Add offset in GLM

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16699 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16699: [SPARK-18710][ML] Add offset in GLM

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16699 **[Test build #72672 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72672/testReport)** for PR 16699 at commit

[GitHub] spark pull request #16844: [SPARK-19500] [SQL] Fix off-by-one bug in BytesTo...

2017-02-09 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16844#discussion_r100461137 --- Diff: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java --- @@ -695,11 +690,16 @@ public boolean append(Object kbase, long koff, int

[GitHub] spark issue #16715: [Spark-18080][ML] Python API & Examples for Locality Sen...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16715 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72668/ Test PASSed. ---

[GitHub] spark issue #16715: [Spark-18080][ML] Python API & Examples for Locality Sen...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16715 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16715: [Spark-18080][ML] Python API & Examples for Locality Sen...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16715 **[Test build #72668 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72668/testReport)** for PR 16715 at commit

[GitHub] spark issue #16876: [SPARK-19537] Move pendingPartitions to ShuffleMapStage.

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16876 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72662/ Test PASSed. ---

[GitHub] spark issue #16876: [SPARK-19537] Move pendingPartitions to ShuffleMapStage.

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16876 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16876: [SPARK-19537] Move pendingPartitions to ShuffleMapStage.

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16876 **[Test build #72662 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72662/testReport)** for PR 16876 at commit

[GitHub] spark issue #16831: [SPARK-19263] Fix race in SchedulerIntegrationSuite.

2017-02-09 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/16831 @kayousterhout Thanks a lot. Sorry for this and I'll be careful in the future. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #16803: [SPARK-19458][BUILD]load hive jars from local repo which...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16803 **[Test build #72678 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72678/testReport)** for PR 16803 at commit

[GitHub] spark issue #16803: [SPARK-19458][BUILD]load hive jars from local repo which...

2017-02-09 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/16803 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16674: [SPARK-19331][SQL][TESTS] Improve the test coverage of S...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16674 **[Test build #72677 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72677/testReport)** for PR 16674 at commit

[GitHub] spark issue #16776: [SPARK-19436][SQL] Add missing tests for approxQuantile

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16776 **[Test build #72676 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72676/testReport)** for PR 16776 at commit

[GitHub] spark issue #15297: [SPARK-9862]Handling data skew

2017-02-09 Thread deswal-ajit
Github user deswal-ajit commented on the issue: https://github.com/apache/spark/pull/15297 hi --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #16857: [SPARK-19517][SS] KafkaSource fails to initialize partit...

2017-02-09 Thread uncleGen
Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/16857 I think it is best to add a new unit test for this issue? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #16776: [SPARK-19436][SQL] Add missing tests for approxQuantile

2017-02-09 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/16776 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16614: [SPARK-19260] Spaces or "%20" in path parameter are not ...

2017-02-09 Thread zuotingbing
Github user zuotingbing commented on the issue: https://github.com/apache/spark/pull/16614 Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #16879: [SPARK-19541][SQL] High Availability support for ThriftS...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16879 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16879: [SPARK-19541][SQL] High Availability support for ...

2017-02-09 Thread lvdongr
GitHub user lvdongr opened a pull request: https://github.com/apache/spark/pull/16879 [SPARK-19541][SQL] High Availability support for ThriftServer JIRA Issue: https://issues.apache.org/jira/browse/SPARK-19541 ## What changes were proposed in this pull request?

[GitHub] spark issue #16787: [SPARK-19448][SQL]optimize some duplication functions be...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16787 **[Test build #72675 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72675/testReport)** for PR 16787 at commit

[GitHub] spark issue #16857: [SPARK-19517][SS] KafkaSource fails to initialize partit...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16857 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16857: [SPARK-19517][SS] KafkaSource fails to initialize partit...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16857 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72666/ Test PASSed. ---

[GitHub] spark issue #16857: [SPARK-19517][SS] KafkaSource fails to initialize partit...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16857 **[Test build #72666 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72666/testReport)** for PR 16857 at commit

[GitHub] spark issue #16787: [SPARK-19448][SQL]optimize some duplication functions be...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16787 **[Test build #72674 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72674/testReport)** for PR 16787 at commit

[GitHub] spark issue #16813: [SPARK-19466][CORE][SCHEDULER] Improve Fair Scheduler Lo...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16813 **[Test build #72673 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72673/testReport)** for PR 16813 at commit

[GitHub] spark issue #16865: [SPARK-19530][SQL] Use guava weigher for code cache evic...

2017-02-09 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16865 My colleagues recently have a case that their codes throw an exception like this: 12:45:10at

[GitHub] spark issue #16813: [SPARK-19466][CORE][SCHEDULER] Improve Fair Scheduler Lo...

2017-02-09 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16813 Thanks Shane! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #16699: [SPARK-18710][ML] Add offset in GLM

2017-02-09 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/16699 @sethah @imatiach-msft Please review the new commit. Main changes: - Fix issue in null deviance calculation in the presence of offset. Except for special cases (Gaussian with

[GitHub] spark issue #16878: [SPARK-19539][SQL] Block duplicate temp table during cre...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16878 **[Test build #72670 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72670/testReport)** for PR 16878 at commit

[GitHub] spark issue #16813: [SPARK-19466][CORE][SCHEDULER] Improve Fair Scheduler Lo...

2017-02-09 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16813 Jenkins, this is ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16865: [SPARK-19530][SQL] Use guava weigher for code cache evic...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16865 **[Test build #72671 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72671/testReport)** for PR 16865 at commit

[GitHub] spark issue #16699: [SPARK-18710][ML] Add offset in GLM

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16699 **[Test build #72672 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72672/testReport)** for PR 16699 at commit

[GitHub] spark issue #16813: [SPARK-19466][CORE][SCHEDULER] Improve Fair Scheduler Lo...

2017-02-09 Thread shaneknapp
Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/16813 sorted. @kayousterhout try to trigger another build. the daemon checks every 5 mins for status, so be patient. :) --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #16865: [SPARK-19530][SQL] Use guava weigher for code cache evic...

2017-02-09 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16865 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #16878: [SPARK-19539][SQL] Block duplicate temp table during cre...

2017-02-09 Thread xwu0226
Github user xwu0226 commented on the issue: https://github.com/apache/spark/pull/16878 @gatorsmile @cloud-fan Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16674: [SPARK-19331][SQL][TESTS] Improve the test covera...

2017-02-09 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16674#discussion_r100455122 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveSQLViewSuite.scala --- @@ -0,0 +1,190 @@ +/* + * Licensed to the

[GitHub] spark pull request #16878: [SPARK-19539][SQL] Block duplicate temp table dur...

2017-02-09 Thread xwu0226
GitHub user xwu0226 opened a pull request: https://github.com/apache/spark/pull/16878 [SPARK-19539][SQL] Block duplicate temp table during creation ## What changes were proposed in this pull request? Current `CREATE TEMPORARY TABLE ... ` is deprecated and recommend users to use

[GitHub] spark issue #16813: [SPARK-19466][CORE][SCHEDULER] Improve Fair Scheduler Lo...

2017-02-09 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16813 Ok I asked Shane about this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16870: [SPARK-19496][SQL]to_date udf to return null when input ...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16870 **[Test build #72669 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72669/testReport)** for PR 16870 at commit

[GitHub] spark issue #16813: [SPARK-19466][CORE][SCHEDULER] Improve Fair Scheduler Lo...

2017-02-09 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16813 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16862: [SPARK-19520][streaming] Do not encrypt data written to ...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16862 **[Test build #72667 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72667/testReport)** for PR 16862 at commit

[GitHub] spark issue #16715: [Spark-18080][ML] Python API & Examples for Locality Sen...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16715 **[Test build #72668 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72668/testReport)** for PR 16715 at commit

[GitHub] spark issue #16715: [Spark-18080][ML] Python API & Examples for Locality Sen...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16715 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72664/ Test PASSed. ---

[GitHub] spark issue #16715: [Spark-18080][ML] Python API & Examples for Locality Sen...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16715 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16715: [Spark-18080][ML] Python API & Examples for Locality Sen...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16715 **[Test build #72664 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72664/testReport)** for PR 16715 at commit

[GitHub] spark issue #16859: [SPARK-17714][Core][test-maven][test-hadoop2.6]Avoid usi...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16859 **[Test build #72665 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72665/testReport)** for PR 16859 at commit

[GitHub] spark issue #16857: [SPARK-19517][SS] KafkaSource fails to initialize partit...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16857 **[Test build #72666 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72666/testReport)** for PR 16857 at commit

[GitHub] spark issue #16857: [SPARK-19517][SS] KafkaSource fails to initialize partit...

2017-02-09 Thread uncleGen
Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/16857 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16876: [SPARK-19537] Move pendingPartitions to ShuffleMapStage.

2017-02-09 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/16876 It's great to have pendingPartitions in ShuffleMapStage. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #16818: [SPARK-19451][SQL][Core] Underlying integer overflow in ...

2017-02-09 Thread uncleGen
Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/16818 cc @cloud-fan @hvanhovell --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16874: [SPARK-19509][SQL]Fix a NPE problem in grouping s...

2017-02-09 Thread stanzhai
Github user stanzhai closed the pull request at: https://github.com/apache/spark/pull/16874 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16868: [SPARK-19115] [SQL] Supporting Create External Ta...

2017-02-09 Thread ouyangxiaochen
Github user ouyangxiaochen commented on a diff in the pull request: https://github.com/apache/spark/pull/16868#discussion_r100450487 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -926,38 +1006,63 @@ class HiveDDLSuite

[GitHub] spark issue #16847: [SPARK-19318][SQL] Fix to send JDBC connection propertie...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16847 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16847: [SPARK-19318][SQL] Fix to send JDBC connection propertie...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16847 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72661/ Test FAILed. ---

[GitHub] spark issue #16847: [SPARK-19318][SQL] Fix to send JDBC connection propertie...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16847 **[Test build #72661 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72661/testReport)** for PR 16847 at commit

[GitHub] spark issue #16715: [Spark-18080][ML] Python API & Examples for Locality Sen...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16715 **[Test build #72664 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72664/testReport)** for PR 16715 at commit

[GitHub] spark issue #16813: [SPARK-19466][CORE][SCHEDULER] Improve Fair Scheduler Lo...

2017-02-09 Thread erenavsarogullari
Github user erenavsarogullari commented on the issue: https://github.com/apache/spark/pull/16813 I think problem still continues. We can get techops support to trigger jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request #16831: [SPARK-19263] Fix race in SchedulerIntegrationSui...

2017-02-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16831 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16831: [SPARK-19263] Fix race in SchedulerIntegrationSuite.

2017-02-09 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16831 I merged this but just realized the current JIRA number is wrong. I won't do a revert / recommit because this is such a small PR, but in the future, each PR should have its own JIRA (so this

[GitHub] spark issue #16877: [WIP] [SPARK-19538] Explicitly tell the DAGScheduler whe...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16877 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16877: [WIP] [SPARK-19538] Explicitly tell the DAGScheduler whe...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16877 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72663/ Test FAILed. ---

[GitHub] spark issue #16877: [WIP] [SPARK-19538] Explicitly tell the DAGScheduler whe...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16877 **[Test build #72663 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72663/testReport)** for PR 16877 at commit

[GitHub] spark issue #16859: [SPARK-17714][Core][test-maven][test-hadoop2.6]Avoid usi...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16859 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72660/ Test PASSed. ---

[GitHub] spark issue #16862: [SPARK-19520][streaming] Do not encrypt data written to ...

2017-02-09 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16862 Looks good. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #16859: [SPARK-17714][Core][test-maven][test-hadoop2.6]Avoid usi...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16859 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16877: [WIP] [SPARK-19538] Explicitly tell the DAGScheduler whe...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16877 **[Test build #72663 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72663/testReport)** for PR 16877 at commit

[GitHub] spark pull request #16862: [SPARK-19520][streaming] Do not encrypt data writ...

2017-02-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16862#discussion_r100443723 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -758,9 +761,33 @@ private[spark] class BlockManager( blockId:

[GitHub] spark issue #16859: [SPARK-17714][Core][test-maven][test-hadoop2.6]Avoid usi...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16859 **[Test build #72660 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72660/testReport)** for PR 16859 at commit

[GitHub] spark pull request #16862: [SPARK-19520][streaming] Do not encrypt data writ...

2017-02-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16862#discussion_r100443690 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/rdd/WriteAheadLogBackedBlockRDD.scala --- @@ -158,13 +158,16 @@ class

[GitHub] spark pull request #16877: [WIP] [SPARK-19538] Explicitly tell the DAGSchedu...

2017-02-09 Thread kayousterhout
GitHub user kayousterhout opened a pull request: https://github.com/apache/spark/pull/16877 [WIP] [SPARK-19538] Explicitly tell the DAGScheduler when a TaskSet is complete This is not intended to be merged! (see note at bottom) Posting to facilitate discussion around #16620.

[GitHub] spark issue #16876: [SPARK-19537] Move pendingPartitions to ShuffleMapStage.

2017-02-09 Thread markhamstra
Github user markhamstra commented on the issue: https://github.com/apache/spark/pull/16876 You're welcome -- but do be aware that I'm going to be extremely busy with non-Spark stuff for at least the next week, so for awhile my Spark code reviews are likely to be more cursory than

[GitHub] spark issue #16876: [SPARK-19537] Move pendingPartitions to ShuffleMapStage.

2017-02-09 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16876 Thanks for the quick look @markhamstra ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16876: [SPARK-19537] Move pendingPartitions to ShuffleMapStage.

2017-02-09 Thread markhamstra
Github user markhamstra commented on the issue: https://github.com/apache/spark/pull/16876 Makes good sense to me. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16876: [SPARK-19537] Move pendingPartitions to ShuffleMapStage.

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16876 **[Test build #72662 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72662/testReport)** for PR 16876 at commit

[GitHub] spark pull request #16876: [SPARK-19537] Move pendingPartitions to ShuffleMa...

2017-02-09 Thread kayousterhout
GitHub user kayousterhout opened a pull request: https://github.com/apache/spark/pull/16876 [SPARK-19537] Move pendingPartitions to ShuffleMapStage. The pendingPartitions instance variable should be moved to ShuffleMapStage, because it is only used by ShuffleMapStages. This

[GitHub] spark pull request #16862: [SPARK-19520][streaming] Do not encrypt data writ...

2017-02-09 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/16862#discussion_r100441004 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/rdd/WriteAheadLogBackedBlockRDD.scala --- @@ -158,13 +158,16 @@ class

[GitHub] spark issue #16777: [SPARK-19435][SQL] Type coercion between ArrayTypes

2017-02-09 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16777 cc @cloud-fan, WDYT? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16862: [SPARK-19520][streaming] Do not encrypt data writ...

2017-02-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16862#discussion_r100439834 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/rdd/WriteAheadLogBackedBlockRDD.scala --- @@ -158,13 +158,16 @@ class

[GitHub] spark issue #16813: [SPARK-19466][CORE][SCHEDULER] Improve Fair Scheduler Lo...

2017-02-09 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16813 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16744: [SPARK-19405][STREAMING] Support for cross-account Kines...

2017-02-09 Thread budde
Github user budde commented on the issue: https://github.com/apache/spark/pull/16744 @brkyvz Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #16847: [SPARK-19318][SQL] Fix to send JDBC connection propertie...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16847 **[Test build #72661 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72661/testReport)** for PR 16847 at commit

[GitHub] spark issue #16847: [SPARK-19318][SQL] Fix to send JDBC connection propertie...

2017-02-09 Thread sureshthalamati
Github user sureshthalamati commented on the issue: https://github.com/apache/spark/pull/16847 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16865: [SPARK-19530][SQL] Use guava weigher for code cac...

2017-02-09 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16865#discussion_r100431612 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala --- @@ -1004,7 +1016,8 @@ object

[GitHub] spark issue #16813: [SPARK-19466][CORE][SCHEDULER] Improve Fair Scheduler Lo...

2017-02-09 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16813 Jenkins, this is OK to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16813: [SPARK-19466][CORE][SCHEDULER] Improve Fair Scheduler Lo...

2017-02-09 Thread erenavsarogullari
Github user erenavsarogullari commented on the issue: https://github.com/apache/spark/pull/16813 Thanks @kayousterhout. I think jenkins needs to be triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #16865: [SPARK-19530][SQL] Use guava weigher for code cache evic...

2017-02-09 Thread davies
Github user davies commented on the issue: https://github.com/apache/spark/pull/16865 I understand the motivation here, could you show the benefit of this change for a real use case? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #16715: [Spark-18080][ML] Python API & Examples for Locality Sen...

2017-02-09 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/16715 BTW I pointed out some typos or mistakes in certain places, but if it's in one place it generally was everywhere. I didn't point out each individual one. --- If your project is set up for it, you

[GitHub] spark pull request #16865: [SPARK-19530][SQL] Use guava weigher for code cac...

2017-02-09 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/16865#discussion_r100428764 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala --- @@ -1004,7 +1016,8 @@ object CodeGenerator

[GitHub] spark pull request #16715: [Spark-18080][ML] Python API & Examples for Local...

2017-02-09 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/16715#discussion_r100426821 --- Diff: examples/src/main/java/org/apache/spark/examples/ml/JavaMinHashLSHExample.java --- @@ -44,25 +45,67 @@ public static void main(String[] args) {

[GitHub] spark pull request #16715: [Spark-18080][ML] Python API & Examples for Local...

2017-02-09 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/16715#discussion_r100424220 --- Diff: examples/src/main/python/ml/bucketed_random_projection_lsh_example.py --- @@ -0,0 +1,86 @@ +# +# Licensed to the Apache Software

<    1   2   3   4   5   6   >