[GitHub] spark pull request: [SPARK-15112][SQL] Allows query plan schema an...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12952#issuecomment-217492075 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15112][SQL] Allows query plan schema an...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12952#issuecomment-217491949 **[Test build #58002 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58002/consoleFull)** for PR 12952 at commit

[GitHub] spark pull request: [SPARK-13370][SQL] Require whitespace between ...

2016-05-06 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/12897#issuecomment-217491293 @hvanhovell What is the behavior of 1.6? Does 1.6 treat `L` as a suffix for a bigint literal? --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARK-14542][CORE] PipeRDD should allow confi...

2016-05-06 Thread sitalkedia
Github user sitalkedia commented on the pull request: https://github.com/apache/spark/pull/12309#issuecomment-217489895 I don't understand `./dev/mima` passes on my laptop. I also verified that `./dev/mima` fails without my changes in `MimaExcludes.scala`. Something weird with the

[GitHub] spark pull request: [Spark-15051] [SQL] Create a TypedColumn alias...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12893#issuecomment-217488982 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [Spark-15051] [SQL] Create a TypedColumn alias...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12893#issuecomment-217488980 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [Spark-15051] [SQL] Create a TypedColumn alias...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12893#issuecomment-217488726 **[Test build #57998 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57998/consoleFull)** for PR 12893 at commit

[GitHub] spark pull request: [SPARK-15112][SQL] Allows query plan schema an...

2016-05-06 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/12952#discussion_r62352447 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -394,7 +405,7 @@ class Dataset[T] private[sql]( * @group basic

[GitHub] spark pull request: [SPARK-15093][SQL] create/delete/rename direct...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12871#issuecomment-217485501 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15093][SQL] create/delete/rename direct...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12871#issuecomment-217485502 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15093][SQL] create/delete/rename direct...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12871#issuecomment-217485371 **[Test build #57999 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57999/consoleFull)** for PR 12871 at commit

[GitHub] spark pull request: SPARK-12639 SQL Improve Explain for Datasource...

2016-05-06 Thread RussellSpitzer
Github user RussellSpitzer commented on the pull request: https://github.com/apache/spark/pull/10655#issuecomment-217483240 Sorry I forgot about this, I'll clean this up tomorrow and get it ready --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-15183][Streaming] Adding outputMode to ...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12958#issuecomment-217482035 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15182] [ML] Copy MLlib doc to ML: ml.fe...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12957#issuecomment-217481568 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15182] [ML] Copy MLlib doc to ML: ml.fe...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12957#issuecomment-217481571 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15182] [ML] Copy MLlib doc to ML: ml.fe...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12957#issuecomment-217481463 **[Test build #58005 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58005/consoleFull)** for PR 12957 at commit

[GitHub] spark pull request: SPARK-15183

2016-05-06 Thread agsachin
GitHub user agsachin opened a pull request: https://github.com/apache/spark/pull/12958 SPARK-15183 ## What changes were proposed in this pull request? while experimenting with structure streaming. I found that mode() is used for non-continuous queries while outputMode() is

[GitHub] spark pull request: [SPARK-15182] [ML] Copy MLlib doc to ML: ml.fe...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12957#issuecomment-217478950 **[Test build #58005 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58005/consoleFull)** for PR 12957 at commit

[GitHub] spark pull request: [SPARK-15182] [ML] Copy MLlib doc to ML: ml.fe...

2016-05-06 Thread hhbyyh
GitHub user hhbyyh opened a pull request: https://github.com/apache/spark/pull/12957 [SPARK-15182] [ML] Copy MLlib doc to ML: ml.feature ## What changes were proposed in this pull request? We should now begin copying algorithm details from the spark.mllib guide to spark.ml

[GitHub] spark pull request: [SPARK-11714][Mesos] Make Spark on Mesos honor...

2016-05-06 Thread skonto
Github user skonto commented on the pull request: https://github.com/apache/spark/pull/11157#issuecomment-217477341 @mgummelt ready. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-12177] [STREAMING] Update KafkaDStreams...

2016-05-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/10953#issuecomment-217477017 @markgrover Mind adding `Closes #10681` in the PR description so that merging script can close that together? --- If your project is set up for it, you can reply

[GitHub] spark pull request: [SPARK-15180][SQL] Support subexpression elimi...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12956#issuecomment-217474807 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11714][Mesos] Make Spark on Mesos honor...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11157#issuecomment-217475441 **[Test build #58004 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58004/consoleFull)** for PR 11157 at commit

[GitHub] spark pull request: [SPARK-15180][SQL] Support subexpression elimi...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12956#issuecomment-217474810 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15180][SQL] Support subexpression elimi...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12956#issuecomment-217474554 **[Test build #57997 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57997/consoleFull)** for PR 12956 at commit

[GitHub] spark pull request: [SPARK-15112][SQL] Allows query plan schema an...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12952#issuecomment-217473744 **[Test build #58002 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58002/consoleFull)** for PR 12952 at commit

[GitHub] spark pull request: [SPARK-15173][SQL] DataFrameWriter.insertInto ...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12949#issuecomment-217473754 **[Test build #58003 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58003/consoleFull)** for PR 12949 at commit

[GitHub] spark pull request: [SPARK-15122][SQL] Fix TPC-DS 41 - Normalize p...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12954#issuecomment-217472088 **[Test build #57994 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57994/consoleFull)** for PR 12954 at commit

[GitHub] spark pull request: [SPARK-15112][SQL] Allows query plan schema an...

2016-05-06 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/12952#discussion_r62345191 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala --- @@ -463,7 +463,12 @@ class SparkSession private( */

[GitHub] spark pull request: [SPARK-15112][SQL] Allows query plan schema an...

2016-05-06 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/12952#discussion_r62345241 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala --- @@ -502,7 +507,7 @@ class SparkSession private( /*

[GitHub] spark pull request: [Spark-15155][Mesos] Optionally ignore default...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12933#issuecomment-217472869 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [Spark-15155][Mesos] Optionally ignore default...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12933#issuecomment-217472873 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [Spark-15155][Mesos] Optionally ignore default...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12933#issuecomment-217472670 **[Test build #57993 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57993/consoleFull)** for PR 12933 at commit

[GitHub] spark pull request: [SPARK-14939][SQL] Add FoldablePropagation opt...

2016-05-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the pull request: https://github.com/apache/spark/pull/12719#issuecomment-217472671 Hi, @cloud-fan . Now, it's ready for review. Could you review this when you have some time? --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-15122][SQL] Fix TPC-DS 41 - Normalize p...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12954#issuecomment-217472331 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15122][SQL] Fix TPC-DS 41 - Normalize p...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12954#issuecomment-217472325 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14476][SQL][WIP] Improve the physical p...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12947#issuecomment-217471682 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14476][SQL][WIP] Improve the physical p...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12947#issuecomment-217471690 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14476][SQL][WIP] Improve the physical p...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12947#issuecomment-217471315 **[Test build #57995 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57995/consoleFull)** for PR 12947 at commit

[GitHub] spark pull request: [SPARK-15087][MINOR][DOC] Follow Up: Fix the C...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12953#issuecomment-217468171 **[Test build #58000 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58000/consoleFull)** for PR 12953 at commit

[GitHub] spark pull request: [SPARK-15173][SQL] DataFrameWriter.insertInto ...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12949#issuecomment-217468181 **[Test build #58001 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58001/consoleFull)** for PR 12949 at commit

[GitHub] spark pull request: [SPARK-13566][CORE] Avoid deadlock between Blo...

2016-05-06 Thread cenyuhai
Github user cenyuhai commented on the pull request: https://github.com/apache/spark/pull/11546#issuecomment-217467789 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-15087][MINOR][DOC] Follow Up: Fix the C...

2016-05-06 Thread techaddict
Github user techaddict commented on a diff in the pull request: https://github.com/apache/spark/pull/12953#discussion_r62342197 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala --- @@ -389,11 +389,10 @@ private[spark] class TaskSchedulerImpl(

[GitHub] spark pull request: [Docs] Added Scaladoc for countApprox and coun...

2016-05-06 Thread ntietz
Github user ntietz commented on the pull request: https://github.com/apache/spark/pull/12955#issuecomment-217467133 Good call, I will add it to the Java version as well. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-13566][CORE] Avoid deadlock between Blo...

2016-05-06 Thread cenyuhai
Github user cenyuhai commented on the pull request: https://github.com/apache/spark/pull/11546#issuecomment-217466944 @andrewor14 I alter the code as what you said, but the test failed because of timeout. It seems like that it is none of my business... --- If your project is set up

[GitHub] spark pull request: [Spark-15051] [SQL] Create a TypedColumn alias...

2016-05-06 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/12893#issuecomment-217463479 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-11714][Mesos] Make Spark on Mesos honor...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11157#issuecomment-217465989 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11714][Mesos] Make Spark on Mesos honor...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11157#issuecomment-217465986 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [Docs] Added Scaladoc for countApprox and coun...

2016-05-06 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/12955#issuecomment-217465951 How about doc'ing the Java version as well in JavaRDDLike.scala? You're welcome to expand on the java/scaladoc of lots of these methods. It'd be nicer to have more

[GitHub] spark pull request: [SPARK-11714][Mesos] Make Spark on Mesos honor...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11157#issuecomment-217465665 **[Test build #57992 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57992/consoleFull)** for PR 11157 at commit

[GitHub] spark pull request: [SPARK-15093][SQL] create/delete/rename direct...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12871#issuecomment-217465398 **[Test build #57999 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57999/consoleFull)** for PR 12871 at commit

[GitHub] spark pull request: [Spark-15051] [SQL] Create a TypedColumn alias...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12893#issuecomment-217465397 **[Test build #57998 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57998/consoleFull)** for PR 12893 at commit

[GitHub] spark pull request: SPARK-12639 SQL Improve Explain for Datasource...

2016-05-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/10655#issuecomment-217465276 ping @RussellSpitzer --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-15087][MINOR][DOC] Follow Up: Fix the C...

2016-05-06 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/12953#discussion_r62340446 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala --- @@ -389,11 +389,10 @@ private[spark] class TaskSchedulerImpl(

[GitHub] spark pull request: [SPARK-12988][SQL] Can't drop columns that con...

2016-05-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/10943#issuecomment-217461632 ping @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-15180][SQL] Support subexpression elimi...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12956#issuecomment-217457647 **[Test build #57997 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57997/consoleFull)** for PR 12956 at commit

[GitHub] spark pull request: [SPARK-15180][SQL] Support subexpression elimi...

2016-05-06 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/12956#issuecomment-217456943 Codes: val ds = Seq(("a", 10), ("a", 20), ("b", 1), ("b", 2), ("c", 1)).toDS().filter("_2 + 1 > 5").filter("_2 + 1 > 20") ds.collect()

[GitHub] spark pull request: [SPARK-12177][Streaming][Kafka] Update KafkaDS...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11863#issuecomment-217456649 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12177][Streaming][Kafka] Update KafkaDS...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11863#issuecomment-217456641 **[Test build #57996 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57996/consoleFull)** for PR 11863 at commit

[GitHub] spark pull request: [SPARK-12177][Streaming][Kafka] Update KafkaDS...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11863#issuecomment-217456651 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13566][CORE] Avoid deadlock between Blo...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11546#issuecomment-217456515 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13566][CORE] Avoid deadlock between Blo...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11546#issuecomment-217456518 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12177][Streaming][Kafka] Update KafkaDS...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11863#issuecomment-217456405 **[Test build #57996 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57996/consoleFull)** for PR 11863 at commit

[GitHub] spark pull request: [SPARK-13566][CORE] Avoid deadlock between Blo...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11546#issuecomment-217456396 **[Test build #57982 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57982/consoleFull)** for PR 11546 at commit

[GitHub] spark pull request: [SPARK-15180][SQL] Support subexpression elimi...

2016-05-06 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/12956 [SPARK-15180][SQL] Support subexpression elimination in Fliter ## What changes were proposed in this pull request? This patch tries to add the support of subexpression elimination in

[GitHub] spark pull request: [SPARK-12177][Streaming][Kafka] Update KafkaDS...

2016-05-06 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/11863#discussion_r62336356 --- Diff: external/kafka-beta/src/main/scala/org/apache/spark/streaming/kafka/KafkaRDD.scala --- @@ -0,0 +1,259 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-12177][Streaming][Kafka] Update KafkaDS...

2016-05-06 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/11863#discussion_r62336181 --- Diff: external/kafka-beta/src/main/scala/org/apache/spark/streaming/kafka/DirectKafkaInputDStream.scala --- @@ -0,0 +1,344 @@ +/* + *

[GitHub] spark pull request: [Docs] Added Scaladoc for countApprox and coun...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12955#issuecomment-217452079 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [Docs] Added Scaladoc for countApprox and coun...

2016-05-06 Thread ntietz
GitHub user ntietz opened a pull request: https://github.com/apache/spark/pull/12955 [Docs] Added Scaladoc for countApprox and countByValueApprox parameters This pull request simply adds Scaladoc documentation of the parameters for countApprox and countByValueApprox. This

[GitHub] spark pull request: [SPARK-13370][SQL] Require whitespace between ...

2016-05-06 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/12897#issuecomment-217451180 @rxin @yhuai what is the next step? Are we changing the behavior? Or keeping it as it is? --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [SPARK-15074][Shuffle] Cache shuffle index fil...

2016-05-06 Thread sitalkedia
Github user sitalkedia commented on a diff in the pull request: https://github.com/apache/spark/pull/12944#discussion_r62334156 --- Diff: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/ShuffleIndexRecord.java --- @@ -0,0 +1,39 @@ +/* + * Licensed to

[GitHub] spark pull request: [SPARK-15074][Shuffle] Cache shuffle index fil...

2016-05-06 Thread sitalkedia
Github user sitalkedia commented on the pull request: https://github.com/apache/spark/pull/12944#issuecomment-217450001 @holdenk - `TransportConf` is not specific to the , it is used to create Transport client in other modules as well. Since number of index cache entry is very

[GitHub] spark pull request: [SPARK-15119] [ML] Add a validator to Decision...

2016-05-06 Thread dominik-jastrzebski
Github user dominik-jastrzebski commented on the pull request: https://github.com/apache/spark/pull/12895#issuecomment-217449436 Ok, I can check the other validators in `treeParams.scala`. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-15087][MINOR][DOC] Follow Up: Fix the C...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12953#issuecomment-217449336 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15087][MINOR][DOC] Follow Up: Fix the C...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12953#issuecomment-217449332 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15087][MINOR][DOC] Follow Up: Fix the C...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12953#issuecomment-217449102 **[Test build #57990 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57990/consoleFull)** for PR 12953 at commit

[GitHub] spark pull request: [SPARK-14476][SQL][WIP] Improve the physical p...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12947#issuecomment-217448700 **[Test build #57995 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57995/consoleFull)** for PR 12947 at commit

[GitHub] spark pull request: [SPARK-14613][ML] Add @Since into the matrix a...

2016-05-06 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/12416#issuecomment-217447705 @pravingadakh go ahead - would be good to get this in for 2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-15074][Shuffle] Cache shuffle index fil...

2016-05-06 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/12944#discussion_r62331757 --- Diff: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/ShuffleIndexRecord.java --- @@ -0,0 +1,39 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-15122][SQL] Fix TPC-DS 41 - Normalize p...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12954#issuecomment-217447455 **[Test build #57994 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57994/consoleFull)** for PR 12954 at commit

[GitHub] spark pull request: [SPARK-15122][SQL] Fix TPC-DS 41 - Normalize p...

2016-05-06 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/12954#issuecomment-217447302 cc @rxin @davies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-15176][Core] Add maxShares setting to P...

2016-05-06 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/12951#discussion_r62332468 --- Diff: core/src/main/scala/org/apache/spark/scheduler/Pool.scala --- @@ -21,6 +21,7 @@ import java.util.concurrent.{ConcurrentHashMap,

[GitHub] spark pull request: [SPARK-15122][SQL] Fix TPC-DS 41 - Normalize p...

2016-05-06 Thread hvanhovell
GitHub user hvanhovell opened a pull request: https://github.com/apache/spark/pull/12954 [SPARK-15122][SQL] Fix TPC-DS 41 - Normalize predicates before pulling them out ## What changes were proposed in this pull request? The official TPC-DS 41 query currently fails because it

[GitHub] spark pull request: [SPARK-1239] Improve fetching of map output st...

2016-05-06 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/12113#discussion_r62332230 --- Diff: core/src/main/scala/org/apache/spark/MapOutputTracker.scala --- @@ -428,40 +503,89 @@ private[spark] class MapOutputTrackerMaster(conf:

[GitHub] spark pull request: [Spark-15155][Mesos] Optionally ignore default...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12933#issuecomment-217446062 **[Test build #57993 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57993/consoleFull)** for PR 12933 at commit

[GitHub] spark pull request: [Spark-15155][Mesos] Optionally ignore default...

2016-05-06 Thread hellertime
Github user hellertime commented on the pull request: https://github.com/apache/spark/pull/12933#issuecomment-217445754 Rebasing against master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-14476][SQL][WIP] Improves the output of...

2016-05-06 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/spark/pull/12947#issuecomment-217445675 @davies I made some changes in UI, please check whether it is better now? ``` scala> spark.sql("select * from tt").explain() == Physical Plan

[GitHub] spark pull request: [SPARK-15080][CORE] Break copyAndReset into co...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12936#issuecomment-217444691 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15080][CORE] Break copyAndReset into co...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12936#issuecomment-217444695 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15176][Core] Add maxShares setting to P...

2016-05-06 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/12951#discussion_r62331312 --- Diff: core/src/main/scala/org/apache/spark/scheduler/Pool.scala --- @@ -21,6 +21,7 @@ import java.util.concurrent.{ConcurrentHashMap,

[GitHub] spark pull request: [SPARK-15080][CORE] Break copyAndReset into co...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12936#issuecomment-21725 **[Test build #57987 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57987/consoleFull)** for PR 12936 at commit

[GitHub] spark pull request: [SPARK-15176][Core] Add maxShares setting to P...

2016-05-06 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/12951#discussion_r62330957 --- Diff: core/src/main/scala/org/apache/spark/scheduler/Pool.scala --- @@ -47,6 +49,15 @@ private[spark] class Pool( var name = poolName

[GitHub] spark pull request: [SPARK-15176][Core] Add maxShares setting to P...

2016-05-06 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/12951#discussion_r62330929 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -98,6 +98,14 @@ private[spark] class TaskSetManager( var

[GitHub] spark pull request: [SPARK-15087][MINOR][DOC] Follow Up: Fix the C...

2016-05-06 Thread techaddict
Github user techaddict commented on a diff in the pull request: https://github.com/apache/spark/pull/12953#discussion_r62330597 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala --- @@ -389,11 +389,10 @@ private[spark] class TaskSchedulerImpl(

[GitHub] spark pull request: [Spark-15051] [SQL] Create a TypedColumn alias...

2016-05-06 Thread kevinyu98
Github user kevinyu98 commented on the pull request: https://github.com/apache/spark/pull/12893#issuecomment-217443570 test please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-15171][SQL][WIP]Deprecate registerTempT...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12945#issuecomment-217443219 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15171][SQL][WIP]Deprecate registerTempT...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12945#issuecomment-217443221 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15176][Core] Add maxShares setting to P...

2016-05-06 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/12951#discussion_r62330358 --- Diff: core/src/main/scala/org/apache/spark/scheduler/Pool.scala --- @@ -21,6 +21,7 @@ import java.util.concurrent.{ConcurrentHashMap,

[GitHub] spark pull request: [SPARK-15171][SQL][WIP]Deprecate registerTempT...

2016-05-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12945#issuecomment-217442978 **[Test build #57986 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57986/consoleFull)** for PR 12945 at commit

[GitHub] spark pull request: [SPARK-15080][CORE] Break copyAndReset into co...

2016-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12936#issuecomment-217442298 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

<    1   2   3   4   5   6   7   >