[GitHub] spark pull request: [SPARK-13750] [SQL] fix sizeInBytes of HadoopF...

2016-03-08 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/11590#issuecomment-194059196 Thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [SPARK-10380] Confusing examples in pyspark SQ...

2016-03-08 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11543#discussion_r55460514 --- Diff: python/pyspark/sql/dataframe.py --- @@ -974,6 +974,35 @@ def dropDuplicates(self, subset=None): jdf = self._jdf.dropDuplicates(sel

[GitHub] spark pull request: [SPARK-13604][Core]Sync worker's state after r...

2016-03-08 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11455#issuecomment-194058366 ping @andrewor14 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-13625][PYSPARK][ML] Added a check to se...

2016-03-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11476 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-13449] Naive Bayes wrapper in SparkR

2016-03-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11486#issuecomment-194058243 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13449] Naive Bayes wrapper in SparkR

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11486#issuecomment-194058224 **[Test build #52713 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52713/consoleFull)** for PR 11486 at commit [`1a685e1`](https://g

[GitHub] spark pull request: [SPARK-13449] Naive Bayes wrapper in SparkR

2016-03-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11486#issuecomment-194058244 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13625][PYSPARK][ML] Added a check to se...

2016-03-08 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/11476#issuecomment-194057856 Merging with master Thanks for the fix! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-13728][SQL] Fix ORC PPD test so that pu...

2016-03-08 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/11593#issuecomment-194057218 LGTM, pending tests. Thanks for tracking this down! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-13449] Naive Bayes wrapper in SparkR

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11486#issuecomment-194055694 **[Test build #52713 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52713/consoleFull)** for PR 11486 at commit [`1a685e1`](https://gi

[GitHub] spark pull request: [SPARK-13698][SQL] Fix Analysis Exceptions whe...

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11538#issuecomment-194055695 **[Test build #52712 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52712/consoleFull)** for PR 11538 at commit [`7ed8ef7`](https://gi

[GitHub] spark pull request: [SPARK-13449] Naive Bayes wrapper in SparkR

2016-03-08 Thread yinxusen
Github user yinxusen commented on the pull request: https://github.com/apache/spark/pull/11486#issuecomment-194054855 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [SPARK-13523] [SQL] Reuse exchanges in a query

2016-03-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11403#issuecomment-194053846 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13523] [SQL] Reuse exchanges in a query

2016-03-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11403#issuecomment-194053848 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13523] [SQL] Reuse exchanges in a query

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11403#issuecomment-194053532 **[Test build #52703 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52703/consoleFull)** for PR 11403 at commit [`7df43ca`](https://g

[GitHub] spark pull request: [SPARK-13750] [SQL] fix sizeInBytes of HadoopF...

2016-03-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11590#issuecomment-194051634 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13750] [SQL] fix sizeInBytes of HadoopF...

2016-03-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11590#issuecomment-194051635 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13750] [SQL] fix sizeInBytes of HadoopF...

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11590#issuecomment-194051370 **[Test build #52701 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52701/consoleFull)** for PR 11590 at commit [`87c1f0a`](https://g

[GitHub] spark pull request: [SPARK-13244][SQL] Migrates DataFrame to Datas...

2016-03-08 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/11443#issuecomment-194051032 @marmbrus the reason is, `DataFrame.collect` will return an object for java, as java don't have generic type array. For long term we should relace all `DataFrame.coll

[GitHub] spark pull request: [SPARK-7286] [SQL] Deprecate !== in favour of ...

2016-03-08 Thread jodersky
Github user jodersky commented on the pull request: https://github.com/apache/spark/pull/11588#issuecomment-194050736 @rxin Looks like finally everything passed :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-10780][ML][WIP] Add initial model to km...

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9#issuecomment-194050123 **[Test build #52711 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52711/consoleFull)** for PR 9 at commit [`08afa4c`](https://gi

[GitHub] spark pull request: [SPARK-13249][SQL] Add Filter checking nullabi...

2016-03-08 Thread viirya
Github user viirya closed the pull request at: https://github.com/apache/spark/pull/11235 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-13249][SQL] Add Filter checking nullabi...

2016-03-08 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/11235#issuecomment-194049145 @davies yea, looks like it is doing the same. Let me close this now. Thanks for reviewing this anyway! --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request: [SPARK-13249][SQL] Add Filter checking nullabi...

2016-03-08 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/11235#discussion_r55457081 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -146,6 +147,56 @@ object EliminateSerialization extends

[GitHub] spark pull request: [SPARK-10780][ML][WIP] Add initial model to km...

2016-03-08 Thread yinxusen
Github user yinxusen commented on the pull request: https://github.com/apache/spark/pull/9#issuecomment-194047596 test it please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[GitHub] spark pull request: [SPARK-13754] Keep old data source name for ba...

2016-03-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11589#issuecomment-194047399 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13754] Keep old data source name for ba...

2016-03-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11589#issuecomment-194047409 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13253] [SQL]avoid checking nullability ...

2016-03-08 Thread yzhou2001
Github user yzhou2001 commented on the pull request: https://github.com/apache/spark/pull/11184#issuecomment-194047202 I'm not sure whether the visitor pattern is a good choice here. First introduction of a visitor just for this fix would see no less code changes; Second Scala pattern

[GitHub] spark pull request: [SPARK-13742][Core] Add non-iterator interface...

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11578#issuecomment-194046907 **[Test build #52710 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52710/consoleFull)** for PR 11578 at commit [`992a356`](https://gi

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `createDataFram...

2016-03-08 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-194044560 follow up JIRA created: https://issues.apache.org/jira/browse/SPARK-13757 @davies I'm not quite understand "We still does not support a schema string with onl

[GitHub] spark pull request: [SPARK-13754] Keep old data source name for ba...

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11589#issuecomment-194045013 **[Test build #52695 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52695/consoleFull)** for PR 11589 at commit [`4e891bf`](https://g

[GitHub] spark pull request: [SPARK-13249][SQL] Add Filter checking nullabi...

2016-03-08 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/11235#issuecomment-194041946 I did not realized that we had merged https://github.com/apache/spark/pull/11372/files, do we still need this? --- If your project is set up for it, you can reply to th

[GitHub] spark pull request: [SPARK-13751] [SQL] generate better code for F...

2016-03-08 Thread sameeragarwal
Github user sameeragarwal commented on the pull request: https://github.com/apache/spark/pull/11585#issuecomment-194042020 Also @davies, if you prefer your current approach, we then need to propagate the constraints in the physical plan as well (currently they are only propagated in t

[GitHub] spark pull request: [SPARK-13751] [SQL] generate better code for F...

2016-03-08 Thread sameeragarwal
Github user sameeragarwal commented on the pull request: https://github.com/apache/spark/pull/11585#issuecomment-194041168 @nongli @davies I think part of the rationale for having https://github.com/apache/spark/pull/11511 was to avoid having the extract the operator's (and its child'

[GitHub] spark pull request: [SPARK-7286] [SQL] Deprecate !== in favour of ...

2016-03-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11588#issuecomment-194041116 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-7286] [SQL] Deprecate !== in favour of ...

2016-03-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11588#issuecomment-194041115 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-7286] [SQL] Deprecate !== in favour of ...

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11588#issuecomment-194040643 **[Test build #52694 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52694/consoleFull)** for PR 11588 at commit [`8d1f435`](https://g

[GitHub] spark pull request: [SPARK-13523] [SQL] Reuse exchanges in a query

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11403#issuecomment-194039988 **[Test build #52709 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52709/consoleFull)** for PR 11403 at commit [`7cd6844`](https://gi

[GitHub] spark pull request: [SPARK-13523] [SQL] Reuse exchanges in a query

2016-03-08 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11403#discussion_r55455063 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/QueryPlan.scala --- @@ -237,4 +237,65 @@ abstract class QueryPlan[PlanType <: Tree

[GitHub] spark pull request: [SPARK-13578] [core] Modify launch scripts to ...

2016-03-08 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/11591#issuecomment-194037786 if you have a fix for it, great. I'm trying to reproduce this locally but so far no luck. --- If your project is set up for it, you can reply to this email and have you

[GitHub] spark pull request: [SPARK-13523] [SQL] Reuse exchanges in a query

2016-03-08 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11403#discussion_r55454531 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ui/SparkPlanGraph.scala --- @@ -101,12 +104,15 @@ private[sql] object SparkPlanGraph {

[GitHub] spark pull request: [SPARK-13578] [core] Modify launch scripts to ...

2016-03-08 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/11591#issuecomment-194037384 Ugh, looks like you're running into the similar issues that I saw with MiMa, so maybe my assembly-free MiMa patch will have to go in first? --- If your project is se

[GitHub] spark pull request: [SPARK-13728][SQL] Fix ORC PPD test so that pu...

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11593#issuecomment-194037164 **[Test build #52708 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52708/consoleFull)** for PR 11593 at commit [`12f8e55`](https://gi

[GitHub] spark pull request: [SPARK-13755] Escape quotes in SQL plan visual...

2016-03-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11587 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-13728][SQL] Fix ORC PPD test so that pu...

2016-03-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/11593#issuecomment-194036038 this this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-13728][SQL] Fix ORC PPD test so that pu...

2016-03-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/11593#issuecomment-194035552 cc @marmbrus --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-13728][SQL] Fix ORC PPD test so that pu...

2016-03-08 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/11593 [SPARK-13728][SQL] Fix ORC PPD test so that pushed filters can be checked. ## What changes were proposed in this pull request? https://github.com/apache/spark/pull/11509 makes the outpu

[GitHub] spark pull request: [SPARK-13755] Escape quotes in SQL plan visual...

2016-03-08 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/11587#issuecomment-194035302 Merging into master and 1.6 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-13523] [SQL] Reuse exchanges in a query

2016-03-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/11403#discussion_r55453649 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -1318,6 +1318,34 @@ class DataFrameSuite extends QueryTest with SharedS

[GitHub] spark pull request: [SPARK-13523] [SQL] Reuse exchanges in a query

2016-03-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/11403#discussion_r55453570 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ui/SparkPlanGraph.scala --- @@ -101,12 +104,15 @@ private[sql] object SparkPlanGraph {

[GitHub] spark pull request: [SPARK-13751] [SQL] generate better code for F...

2016-03-08 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/11585#issuecomment-194034668 @nongli It seems that once we have this, we don't need #11511 anymore, right? --- If your project is set up for it, you can reply to this email and have your reply appe

[GitHub] spark pull request: [SPARK-13523] [SQL] Reuse exchanges in a query

2016-03-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/11403#discussion_r55453451 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/Exchange.scala --- @@ -0,0 +1,91 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request: [SPARK-13523] [SQL] Reuse exchanges in a query

2016-03-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/11403#discussion_r55453277 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/QueryPlan.scala --- @@ -237,4 +237,65 @@ abstract class QueryPlan[PlanType <: T

[GitHub] spark pull request: [SPARK-13523] [SQL] Reuse exchanges in a query

2016-03-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/11403#discussion_r55453264 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/QueryPlan.scala --- @@ -237,4 +237,65 @@ abstract class QueryPlan[PlanType <: T

[GitHub] spark pull request: [SPARK-13523] [SQL] Reuse exchanges in a query

2016-03-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/11403#discussion_r55453192 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/QueryPlan.scala --- @@ -237,4 +237,65 @@ abstract class QueryPlan[PlanType <: T

[GitHub] spark pull request: [SPARK-13696][WIP] Remove BlockStore class & s...

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11534#issuecomment-194033595 **[Test build #52707 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52707/consoleFull)** for PR 11534 at commit [`66796b5`](https://gi

[GitHub] spark pull request: [SPARK-8519][SPARK-11560][SPARK-11559] [ML] [M...

2016-03-08 Thread NarineK
Github user NarineK commented on the pull request: https://github.com/apache/spark/pull/10806#issuecomment-194033385 Hi everyone, @yanboliang, thanks for optimizing Kmeans. I have a question. Is it possible to add Within Cluster Sum Square (in total and for individual cluster)

[GitHub] spark pull request: [SPARK-13696][WIP] Remove BlockStore class & s...

2016-03-08 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/11534#issuecomment-194033260 I went ahead and split up `doPut()`, which greatly simplified the return types. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-13242] [SQL] codegen fallback in case-w...

2016-03-08 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/11592#issuecomment-194032877 cc @joehalliwell --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[GitHub] spark pull request: [SPARK-13242] [SQL] codegen fallback in case-w...

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11592#issuecomment-194032743 **[Test build #52706 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52706/consoleFull)** for PR 11592 at commit [`aace0a3`](https://gi

[GitHub] spark pull request: [SPARK-13242] [SQL] codegen fallback in case-w...

2016-03-08 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/11592 [SPARK-13242] [SQL] codegen fallback in case-when if there many branches ## What changes were proposed in this pull request? If there are many branches in a CaseWhen expression, the generate

[GitHub] spark pull request: [SPARK-13696][WIP] Remove BlockStore class & s...

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11534#issuecomment-194031761 **[Test build #52705 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52705/consoleFull)** for PR 11534 at commit [`a16276e`](https://gi

[GitHub] spark pull request: [SPARK-13696][WIP] Remove BlockStore class & s...

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11534#issuecomment-194030709 **[Test build #52704 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52704/consoleFull)** for PR 11534 at commit [`7a08a17`](https://gi

[GitHub] spark pull request: [SPARK-10387][ML] Add code gen for gbt

2016-03-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9524#issuecomment-194029785 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10387][ML] Add code gen for gbt

2016-03-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9524#issuecomment-194029789 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/5

[GitHub] spark pull request: [SPARK-10387][ML] Add code gen for gbt

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9524#issuecomment-194029555 **[Test build #52691 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52691/consoleFull)** for PR 9524 at commit [`6e484bb`](https://git

[GitHub] spark pull request: [SPARK-13242] [SQL] Fall back to interpreting ...

2016-03-08 Thread joehalliwell
Github user joehalliwell commented on the pull request: https://github.com/apache/spark/pull/11243#issuecomment-194029424 Not at all, please do! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [SPARK-13242] [SQL] Fall back to interpreting ...

2016-03-08 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/11243#issuecomment-194029011 @joehalliwell Do you mind me to take over this one? so we can merge this quickly. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-13242] [SQL] Fall back to interpreting ...

2016-03-08 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11243#discussion_r55449966 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/conditionalExpressions.scala --- @@ -182,11 +183,16 @@ case class CaseWhen(br

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `createDataFram...

2016-03-08 Thread tedyu
Github user tedyu commented on a diff in the pull request: https://github.com/apache/spark/pull/11444#discussion_r55449167 --- Diff: python/pyspark/sql/types.py --- @@ -681,6 +681,129 @@ def __eq__(self, other): for v in [ArrayType, MapType, StructType

[GitHub] spark pull request: [SPARK-13668][SQL] Reorder filter/join predica...

2016-03-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11511 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-13242] [SQL] Fall back to interpreting ...

2016-03-08 Thread joehalliwell
Github user joehalliwell commented on the pull request: https://github.com/apache/spark/pull/11243#issuecomment-194026765 @davies Hi, I guess this missed the window for 1.6.1? Codegen errors of this sort on complex expressions represent a regression with respect to 1.5.2 which are pre

[GitHub] spark pull request: [SPARK-13015][Docs] Replace example code in ml...

2016-03-08 Thread yinxusen
Github user yinxusen commented on the pull request: https://github.com/apache/spark/pull/11128#issuecomment-194026546 @keypointt Examples in the PR are all small ones. I am not sure whether we merge them or not. Either we use this PR https://github.com/apache/spark/pull/9430 to rewrit

[GitHub] spark pull request: [SPARK-13578] [core] Modify launch scripts to ...

2016-03-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11591#issuecomment-194026418 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13578] [core] Modify launch scripts to ...

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11591#issuecomment-194026376 **[Test build #52700 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52700/consoleFull)** for PR 11591 at commit [`79e1bf5`](https://g

[GitHub] spark pull request: [SPARK-13578] [core] Modify launch scripts to ...

2016-03-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11591#issuecomment-194026417 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13668][SQL] Reorder filter/join predica...

2016-03-08 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/11511#issuecomment-194026381 LGTM. Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark pull request: [SPARK-13523] [SQL] Reuse exchanges in a query

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11403#issuecomment-194025753 **[Test build #52703 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52703/consoleFull)** for PR 11403 at commit [`7df43ca`](https://gi

[GitHub] spark pull request: [SPARK-13696][WIP] Remove BlockStore class & s...

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11534#issuecomment-194025752 **[Test build #52702 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52702/consoleFull)** for PR 11534 at commit [`92c5125`](https://gi

[GitHub] spark pull request: [SPARK-12469][CORE][WIP/RFC] Consistent accumu...

2016-03-08 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/11105#discussion_r55448680 --- Diff: core/src/main/scala/org/apache/spark/scheduler/ResultTask.scala --- @@ -66,7 +67,10 @@ private[spark] class ResultTask[T, U]( _executorDes

[GitHub] spark pull request: [SPARK-13523] [SQL] Reuse exchanges in a query

2016-03-08 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11403#discussion_r55448590 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -1318,6 +1318,34 @@ class DataFrameSuite extends QueryTest with SharedSQLC

[GitHub] spark pull request: [SPARK-7286] [SQL] Deprecate !== in favour of ...

2016-03-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11588#issuecomment-194025026 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13750] [SQL] fix sizeInBytes of HadoopF...

2016-03-08 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/11590#issuecomment-194024849 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-7286] [SQL] Deprecate !== in favour of ...

2016-03-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11588#issuecomment-194025025 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-7286] [SQL] Deprecate !== in favour of ...

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11588#issuecomment-194024814 **[Test build #52693 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52693/consoleFull)** for PR 11588 at commit [`8d1f435`](https://g

[GitHub] spark pull request: [SPARK-13750] [SQL] fix sizeInBytes of HadoopF...

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11590#issuecomment-194018846 **[Test build #52701 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52701/consoleFull)** for PR 11590 at commit [`87c1f0a`](https://gi

[GitHub] spark pull request: [SPARK-13578] [core] Modify launch scripts to ...

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11591#issuecomment-194018844 **[Test build #52700 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52700/consoleFull)** for PR 11591 at commit [`79e1bf5`](https://gi

[GitHub] spark pull request: [SPARK-13360][PYSPARK][YARN] PYSPARK_DRIVER_PY...

2016-03-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11238#issuecomment-194018400 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13360][PYSPARK][YARN] PYSPARK_DRIVER_PY...

2016-03-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11238#issuecomment-194018404 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13578] [core] Modify launch scripts to ...

2016-03-08 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/11591 [SPARK-13578] [core] Modify launch scripts to not use assemblies. Instead of looking for a specially-named assembly, the scripts now will blindly add all jars under the libs directory to the clas

[GitHub] spark pull request: [SPARK-13360][PYSPARK][YARN] PYSPARK_DRIVER_PY...

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11238#issuecomment-194017885 **[Test build #52698 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52698/consoleFull)** for PR 11238 at commit [`0d1069b`](https://g

[GitHub] spark pull request: [SPARK-13750] [SQL] fix sizeInBytes of HadoopF...

2016-03-08 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/11590#issuecomment-194017241 cc @marmbrus --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-13750] [SQL] fix sizeInBytes of HadoopF...

2016-03-08 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/11590 [SPARK-13750] [SQL] fix sizeInBytes of HadoopFsRelation ## What changes were proposed in this pull request? This PR fix the sizeInBytes of HadoopFsRelation. ## How was this pat

[GitHub] spark pull request: [SPARK-13668][SQL] Reorder filter/join predica...

2016-03-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11511#issuecomment-194015933 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13668][SQL] Reorder filter/join predica...

2016-03-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11511#issuecomment-194015941 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13702][CORE][SQL][MLLIB] Use diamond op...

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11541#issuecomment-194015437 **[Test build #52699 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52699/consoleFull)** for PR 11541 at commit [`2e20843`](https://gi

[GitHub] spark pull request: SPARK-13034[ML]:PySpark ml.classification supp...

2016-03-08 Thread wangmiao1981
Github user wangmiao1981 commented on the pull request: https://github.com/apache/spark/pull/11582#issuecomment-194014892 @srowen I added the title in the pull request. Sorry for causing the confusion here. I only made changes in one python file. All other changes are merged from mast

[GitHub] spark pull request: [SPARK-13668][SQL] Reorder filter/join predica...

2016-03-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11511#issuecomment-194014876 **[Test build #52692 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52692/consoleFull)** for PR 11511 at commit [`21d8897`](https://g

[GitHub] spark pull request: [SPARK-13738][SQL] Cleanup Data Source resolut...

2016-03-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11572 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-13702][CORE][SQL][MLLIB] Use diamond op...

2016-03-08 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the pull request: https://github.com/apache/spark/pull/11541#issuecomment-194014737 Hi, @mengxr . I removed the change on build related files. Now this PR contains pure `Java` and `md` files. Also, the description of PR/JIRA issue is upda

<    1   2   3   4   5   6   7   8   >