[GitHub] spark pull request #15125: [SPARK-5484][GraphX] Periodically do checkpoint i...

2017-02-09 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15125#discussion_r100486268 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/util/PeriodicGraphCheckpointer.scala --- @@ -87,10 +88,7 @@ private[mllib] class

[GitHub] spark issue #16876: [SPARK-19537] Move pendingPartitions to ShuffleMapStage.

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16876 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16876: [SPARK-19537] Move pendingPartitions to ShuffleMapStage.

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16876 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72684/ Test PASSed. ---

[GitHub] spark issue #16876: [SPARK-19537] Move pendingPartitions to ShuffleMapStage.

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16876 **[Test build #72684 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72684/testReport)** for PR 16876 at commit

[GitHub] spark issue #16724: [SPARK-19352][SQL] Keep sort order of rows after externa...

2017-02-09 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16724 @cloud-fan Even the specified partitioning is same as the input data, we still need the sorting. Because the rows with same partition values are not guaranteed to be continuous in all rows, so you

[GitHub] spark pull request #16785: [SPARK-19443][SQL] The function to generate const...

2017-02-09 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16785#discussion_r100484586 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/LogicalPlan.scala --- @@ -314,19 +322,29 @@ abstract class UnaryNode

[GitHub] spark issue #16882: [SPARK-19544][SQL] Improve error message when some colum...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16882 **[Test build #72693 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72693/testReport)** for PR 16882 at commit

[GitHub] spark issue #16813: [SPARK-19466][CORE][SCHEDULER] Improve Fair Scheduler Lo...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16813 **[Test build #3572 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3572/testReport)** for PR 16813 at commit

[GitHub] spark issue #16882: [SPARK-19544][SQL] Improve error message when some colum...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16882 **[Test build #72692 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72692/testReport)** for PR 16882 at commit

[GitHub] spark issue #16883: [SPARK-17498][ML] enchance StringIndexer to handle unsee...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16883 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72690/ Test FAILed. ---

[GitHub] spark issue #16883: [SPARK-17498][ML] enchance StringIndexer to handle unsee...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16883 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16882: [SPARK-19544][SQL] Improve error message when some colum...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16882 **[Test build #72691 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72691/testReport)** for PR 16882 at commit

[GitHub] spark issue #16883: [SPARK-17498][ML] enchance StringIndexer to handle unsee...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16883 **[Test build #72690 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72690/testReport)** for PR 16883 at commit

[GitHub] spark issue #16882: [SPARK-19544][SQL] Improve error message when some colum...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16882 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72683/ Test FAILed. ---

[GitHub] spark issue #16882: [SPARK-19544][SQL] Improve error message when some colum...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16882 **[Test build #72683 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72683/testReport)** for PR 16882 at commit

[GitHub] spark issue #16882: [SPARK-19544][SQL] Improve error message when some colum...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16882 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16883: [SPARK-17498][ML] enchance StringIndexer to handle unsee...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16883 **[Test build #72690 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72690/testReport)** for PR 16883 at commit

[GitHub] spark issue #16832: [SPARK-19490][SQL] change hive column names to lower cas...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16832 **[Test build #72689 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72689/testReport)** for PR 16832 at commit

[GitHub] spark issue #16832: [SPARK-19490][SQL] change hive column names to lower cas...

2017-02-09 Thread cenyuhai
Github user cenyuhai commented on the issue: https://github.com/apache/spark/pull/16832 @rxin I think it is safe, it is only used to check whether the schema contains the columns. Hive columns are not case-sensitive. --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #16787: [SPARK-19448][SQL]optimize some duplication functions be...

2017-02-09 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/16787 ping @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #16883: [SPARK-17498][ML] enchance StringIndexer to handle unsee...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16883 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16883: [SPARK-17498][ML] enchance StringIndexer to handle unsee...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16883 **[Test build #72688 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72688/testReport)** for PR 16883 at commit

[GitHub] spark issue #16883: [SPARK-17498][ML] enchance StringIndexer to handle unsee...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16883 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72688/ Test FAILed. ---

[GitHub] spark issue #16881: [SPARK-19543] from_json fails when the input row is empt...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16881 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72681/ Test PASSed. ---

[GitHub] spark issue #16881: [SPARK-19543] from_json fails when the input row is empt...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16881 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16883: [SPARK-17498][ML] enchance StringIndexer to handle unsee...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16883 **[Test build #72688 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72688/testReport)** for PR 16883 at commit

[GitHub] spark issue #16881: [SPARK-19543] from_json fails when the input row is empt...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16881 **[Test build #72681 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72681/testReport)** for PR 16881 at commit

[GitHub] spark issue #16880: [SPARK-19542][SS]Delete the temp checkpoint if a query i...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16880 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16880: [SPARK-19542][SS]Delete the temp checkpoint if a query i...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16880 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72682/ Test PASSed. ---

[GitHub] spark issue #16880: [SPARK-19542][SS]Delete the temp checkpoint if a query i...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16880 **[Test build #72682 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72682/testReport)** for PR 16880 at commit

[GitHub] spark pull request #16844: [SPARK-19500] [SQL] Fix off-by-one bug in BytesTo...

2017-02-09 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16844#discussion_r100478225 --- Diff: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java --- @@ -695,11 +690,16 @@ public boolean append(Object kbase, long koff, int

[GitHub] spark issue #16883: [SPARK-17498][ML] enchance StringIndexer to handle unsee...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16883 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16883: [SPARK-17498][ML] enchance StringIndexer to handle unsee...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16883 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72687/ Test FAILed. ---

[GitHub] spark issue #16883: [SPARK-17498][ML] enchance StringIndexer to handle unsee...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16883 **[Test build #72687 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72687/testReport)** for PR 16883 at commit

[GitHub] spark issue #16880: [SPARK-19542][SS]Delete the temp checkpoint if a query i...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16880 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16883: [SPARK-17498][ML] enchance StringIndexer to handle unsee...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16883 **[Test build #72687 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72687/testReport)** for PR 16883 at commit

[GitHub] spark issue #16880: [SPARK-19542][SS]Delete the temp checkpoint if a query i...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16880 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72680/ Test PASSed. ---

[GitHub] spark issue #16620: [SPARK-19263] DAGScheduler should avoid sending conflict...

2017-02-09 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16620 I spent a long time looking at this and I think @markhamsta's solution is the way to go, and that we should update the tests to address the failures (I think the two tests that fail are

[GitHub] spark issue #16880: [SPARK-19542][SS]Delete the temp checkpoint if a query i...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16880 **[Test build #72680 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72680/testReport)** for PR 16880 at commit

[GitHub] spark pull request #16883: [SPARK-17498][ML] enchance StringIndexer to handl...

2017-02-09 Thread VinceShieh
GitHub user VinceShieh opened a pull request: https://github.com/apache/spark/pull/16883 [SPARK-17498][ML] enchance StringIndexer to handle unseen labels ## What changes were proposed in this pull request? This PR is an enhancement to ML StringIndexer. Before this PR,

[GitHub] spark pull request #16881: [SPARK-19543] from_json fails when the input row ...

2017-02-09 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16881#discussion_r100477537 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/jsonExpressions.scala --- @@ -496,7 +496,7 @@ case class

[GitHub] spark issue #16844: [SPARK-19500] [SQL] Fix off-by-one bug in BytesToBytesMa...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16844 **[Test build #3571 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3571/testReport)** for PR 16844 at commit

[GitHub] spark issue #16847: [SPARK-19318][SQL] Fix to send JDBC connection propertie...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16847 **[Test build #72686 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72686/testReport)** for PR 16847 at commit

[GitHub] spark issue #16847: [SPARK-19318][SQL] Fix to send JDBC connection propertie...

2017-02-09 Thread dilipbiswal
Github user dilipbiswal commented on the issue: https://github.com/apache/spark/pull/16847 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16386: [SPARK-18352][SQL] Support parsing multiline json files

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16386 **[Test build #72685 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72685/testReport)** for PR 16386 at commit

[GitHub] spark pull request #16386: [SPARK-18352][SQL] Support parsing multiline json...

2017-02-09 Thread NathanHowell
Github user NathanHowell commented on a diff in the pull request: https://github.com/apache/spark/pull/16386#discussion_r100474809 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JacksonParser.scala --- @@ -48,69 +47,102 @@ class JacksonParser(

[GitHub] spark pull request #16844: [SPARK-19500] [SQL] Fix off-by-one bug in BytesTo...

2017-02-09 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/spark/pull/16844#discussion_r100473254 --- Diff: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java --- @@ -695,11 +690,16 @@ public boolean append(Object kbase, long koff, int

[GitHub] spark issue #16876: [SPARK-19537] Move pendingPartitions to ShuffleMapStage.

2017-02-09 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/16876 lgtm when tests pass --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #16876: [SPARK-19537] Move pendingPartitions to ShuffleMapStage.

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16876 **[Test build #72684 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72684/testReport)** for PR 16876 at commit

[GitHub] spark pull request #16876: [SPARK-19537] Move pendingPartitions to ShuffleMa...

2017-02-09 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/16876#discussion_r100472977 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -1038,9 +1038,8 @@ class DAGScheduler( }

[GitHub] spark issue #16865: [SPARK-19530][SQL] Use guava weigher for code cache evic...

2017-02-09 Thread davies
Github user davies commented on the issue: https://github.com/apache/spark/pull/16865 @viirya This is a general OOM, should not be caused by cached bytecode, they are way smaller comparing other things in executor, I think this patch will not help either. --- If your project is set

[GitHub] spark issue #16882: [SPARK-19544][SQL] Improve error message when some colum...

2017-02-09 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16882 cc @hvanhovell could you please take a look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16882: [SPARK-19544][SQL] Improve error message when some colum...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16882 **[Test build #72683 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72683/testReport)** for PR 16882 at commit

[GitHub] spark pull request #16882: [SPARK-19544][SQL] Improve error message when som...

2017-02-09 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/16882 [SPARK-19544][SQL] Improve error message when some column types are compatible and others are not in set/union operations ## What changes were proposed in this pull request? This PR

[GitHub] spark issue #16803: [SPARK-19458][BUILD]load hive jars from local repo which...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16803 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72678/ Test PASSed. ---

[GitHub] spark issue #16803: [SPARK-19458][BUILD]load hive jars from local repo which...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16803 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16803: [SPARK-19458][BUILD]load hive jars from local repo which...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16803 **[Test build #72678 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72678/testReport)** for PR 16803 at commit

[GitHub] spark issue #16813: [SPARK-19466][CORE][SCHEDULER] Improve Fair Scheduler Lo...

2017-02-09 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/16813 @shaneknapp the build failed to trigger for me again, I did it manually via spark-prs.appspot.com --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #16813: [SPARK-19466][CORE][SCHEDULER] Improve Fair Scheduler Lo...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16813 **[Test build #3572 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3572/testReport)** for PR 16813 at commit

[GitHub] spark issue #16813: [SPARK-19466][CORE][SCHEDULER] Improve Fair Scheduler Lo...

2017-02-09 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/16813 failure is probably unrelated Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request #16810: [SPARK-19464][CORE][YARN][test-hadoop2.6] Remove ...

2017-02-09 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/spark/pull/16810#discussion_r100470782 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -253,53 +233,24 @@ private[spark] class Client(

[GitHub] spark issue #16674: [SPARK-19331][SQL][TESTS] Improve the test coverage of S...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16674 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16674: [SPARK-19331][SQL][TESTS] Improve the test coverage of S...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16674 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72677/ Test PASSed. ---

[GitHub] spark issue #16674: [SPARK-19331][SQL][TESTS] Improve the test coverage of S...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16674 **[Test build #72677 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72677/testReport)** for PR 16674 at commit

[GitHub] spark issue #16744: [SPARK-19405][STREAMING] Support for cross-account Kines...

2017-02-09 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/16744 @budde This looks good to me, but I've asked @zsxwing to also take a look with a clean set of eyes. We can't backport this to 2.1.1, because of the dependency changes. I'm also wondering if there

[GitHub] spark issue #16776: [SPARK-19436][SQL] Add missing tests for approxQuantile

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16776 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72676/ Test PASSed. ---

[GitHub] spark issue #16776: [SPARK-19436][SQL] Add missing tests for approxQuantile

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16776 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16776: [SPARK-19436][SQL] Add missing tests for approxQuantile

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16776 **[Test build #72676 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72676/testReport)** for PR 16776 at commit

[GitHub] spark pull request #16876: [SPARK-19537] Move pendingPartitions to ShuffleMa...

2017-02-09 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/16876#discussion_r100468844 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -1038,9 +1038,8 @@ class DAGScheduler( } if

[GitHub] spark issue #16880: [SPARK-19542][SS]Delete the temp checkpoint if a query i...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16880 **[Test build #72682 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72682/testReport)** for PR 16880 at commit

[GitHub] spark issue #16844: [SPARK-19500] [SQL] Fix off-by-one bug in BytesToBytesMa...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16844 **[Test build #3571 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3571/testReport)** for PR 16844 at commit

[GitHub] spark issue #16881: [SPARK-19543] from_json fails when the input row is empt...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16881 **[Test build #72681 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72681/testReport)** for PR 16881 at commit

[GitHub] spark issue #16881: [SPARK-19543] from_json fails when the input row is empt...

2017-02-09 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/16881 cc @hvanhovell mind taking a look? You looked at the last PR that touched this code --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request #16881: [SPARK-19543] from_json fails when the input row ...

2017-02-09 Thread brkyvz
GitHub user brkyvz opened a pull request: https://github.com/apache/spark/pull/16881 [SPARK-19543] from_json fails when the input row is empty ## What changes were proposed in this pull request? Using from_json on a column with an empty string results in:

[GitHub] spark issue #16865: [SPARK-19530][SQL] Use guava weigher for code cache evic...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16865 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72671/ Test PASSed. ---

[GitHub] spark issue #16865: [SPARK-19530][SQL] Use guava weigher for code cache evic...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16865 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16880: [SPARK-19542][SS]Delete the temp checkpoint if a query i...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16880 **[Test build #72680 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72680/testReport)** for PR 16880 at commit

[GitHub] spark issue #16865: [SPARK-19530][SQL] Use guava weigher for code cache evic...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16865 **[Test build #72671 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72671/testReport)** for PR 16865 at commit

[GitHub] spark issue #16870: [SPARK-19496][SQL]to_date udf to return null when input ...

2017-02-09 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/16870 cc @cloud-fan @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16880: [SPARK-19542][SS]Delete the temp checkpoint if a ...

2017-02-09 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/16880 [SPARK-19542][SS]Delete the temp checkpoint if a query is stopped without errors ## What changes were proposed in this pull request? When a query uses a temp checkpoint dir, it's better

[GitHub] spark issue #16870: [SPARK-19496][SQL]to_date udf to return null when input ...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16870 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72669/ Test PASSed. ---

[GitHub] spark issue #16870: [SPARK-19496][SQL]to_date udf to return null when input ...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16870 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16870: [SPARK-19496][SQL]to_date udf to return null when input ...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16870 **[Test build #72669 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72669/testReport)** for PR 16870 at commit

[GitHub] spark issue #16862: [SPARK-19520][streaming] Do not encrypt data written to ...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16862 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72667/ Test PASSed. ---

[GitHub] spark issue #16862: [SPARK-19520][streaming] Do not encrypt data written to ...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16862 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16859: [SPARK-17714][Core][test-maven][test-hadoop2.6]Avoid usi...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16859 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72665/ Test PASSed. ---

[GitHub] spark issue #16859: [SPARK-17714][Core][test-maven][test-hadoop2.6]Avoid usi...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16859 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16862: [SPARK-19520][streaming] Do not encrypt data written to ...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16862 **[Test build #72667 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72667/testReport)** for PR 16862 at commit

[GitHub] spark issue #16859: [SPARK-17714][Core][test-maven][test-hadoop2.6]Avoid usi...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16859 **[Test build #72665 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72665/testReport)** for PR 16859 at commit

[GitHub] spark issue #16878: [SPARK-19539][SQL] Block duplicate temp table during cre...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16878 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16878: [SPARK-19539][SQL] Block duplicate temp table during cre...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16878 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72670/ Test PASSed. ---

[GitHub] spark issue #16878: [SPARK-19539][SQL] Block duplicate temp table during cre...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16878 **[Test build #72670 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72670/testReport)** for PR 16878 at commit

[GitHub] spark issue #16813: [SPARK-19466][CORE][SCHEDULER] Improve Fair Scheduler Lo...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16813 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72673/ Test FAILed. ---

[GitHub] spark issue #16813: [SPARK-19466][CORE][SCHEDULER] Improve Fair Scheduler Lo...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16813 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16813: [SPARK-19466][CORE][SCHEDULER] Improve Fair Scheduler Lo...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16813 **[Test build #72673 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72673/testReport)** for PR 16813 at commit

[GitHub] spark issue #16787: [SPARK-19448][SQL]optimize some duplication functions be...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16787 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16787: [SPARK-19448][SQL]optimize some duplication functions be...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16787 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72675/ Test PASSed. ---

[GitHub] spark issue #16787: [SPARK-19448][SQL]optimize some duplication functions be...

2017-02-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16787 **[Test build #72675 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72675/testReport)** for PR 16787 at commit

[GitHub] spark issue #16787: [SPARK-19448][SQL]optimize some duplication functions be...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16787 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16787: [SPARK-19448][SQL]optimize some duplication functions be...

2017-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16787 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72674/ Test PASSed. ---

  1   2   3   4   5   6   >