[GitHub] spark pull request: [SPARK-12951] [SQL] support spilling in genera...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10998#issuecomment-178870796 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12951] [SQL] support spilling in genera...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10998#issuecomment-178870799 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12951] [SQL] support spilling in genera...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10998#issuecomment-178870708 **[Test build #50598 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50598/consoleFull)** for PR 10998 at commit [`0c52897`](https://g

[GitHub] spark pull request: Add FileStreamSource and a simple version of F...

2016-02-02 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/11034 Add FileStreamSource and a simple version of FileStreamSink `FileStreamSource` is an implementation of `org.apache.spark.sql.execution.streaming.Source`. It takes advantage of the existing `Hadoop

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-02 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11030#discussion_r51649279 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/memory.scala --- @@ -131,8 +139,13 @@ class MemorySink(schema: StructType) exten

[GitHub] spark pull request: [SPARK-13149][SQL]Add FileStreamSource and a s...

2016-02-02 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11034#issuecomment-178872016 @marmbrus @tdas Please take a look. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-13135][SQL] Don't print expressions rec...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11019#issuecomment-178872055 **[Test build #2494 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2494/consoleFull)** for PR 11019 at commit [`2c2b007`](https://g

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-02 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/10993#discussion_r51649684 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala --- @@ -245,99 +239,182 @@ private[spark] class Co

[GitHub] spark pull request: [SPARK-13147] [SQL] improve readability of gen...

2016-02-02 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/11032#discussion_r51649811 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeFormatter.scala --- @@ -33,8 +33,15 @@ private class CodeFormatter

[GitHub] spark pull request: [SPARK-12957][SQL] Initial support for constra...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10844#issuecomment-178873146 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12957][SQL] Initial support for constra...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10844#issuecomment-178873147 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-02 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11030#discussion_r51650418 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataStreamWriter.scala --- @@ -84,6 +84,17 @@ final class DataStreamWriter private[sql](df: DataFrame

[GitHub] spark pull request: [SPARK-13147] [SQL] improve readability of gen...

2016-02-02 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11032#discussion_r51650399 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeFormatter.scala --- @@ -33,8 +33,15 @@ private class CodeFormatte

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-02 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/10993#discussion_r51650484 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala --- @@ -245,99 +239,182 @@ private[spark] class Co

[GitHub] spark pull request: [SPARK-12957][SQL] Initial support for constra...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10844#issuecomment-178873821 **[Test build #50603 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50603/consoleFull)** for PR 10844 at commit [`2bd2735`](https://gi

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-02 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/10993#discussion_r51650781 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala --- @@ -245,99 +239,182 @@ private[spark] class Co

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-02 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/10993#discussion_r51650895 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala --- @@ -245,99 +239,182 @@ private[spark] class Co

[GitHub] spark pull request: [SPARK-13149][SQL]Add FileStreamSource and a s...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11034#issuecomment-178875023 **[Test build #50604 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50604/consoleFull)** for PR 11034 at commit [`a2784ff`](https://gi

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-02 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11030#discussion_r51651322 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/memory.scala --- @@ -46,6 +47,8 @@ case class MemoryStream[A : Encoder](id: Int,

[GitHub] spark pull request: [SPARK-7997][Core]Add rpcEnv.awaitTermination(...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11031#issuecomment-178875431 **[Test build #50590 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50590/consoleFull)** for PR 11031 at commit [`224916f`](https://g

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-02 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/10993#discussion_r51651630 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala --- @@ -245,99 +239,182 @@ private[spark] class Co

[GitHub] spark pull request: [SPARK-7997][Core]Add rpcEnv.awaitTermination(...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11031#issuecomment-178875628 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-7997][Core]Add rpcEnv.awaitTermination(...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11031#issuecomment-178875627 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-02 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/10993#discussion_r51651674 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala --- @@ -245,99 +239,182 @@ private[spark] class Co

[GitHub] spark pull request: [SPARK-7997][Core]Add rpcEnv.awaitTermination(...

2016-02-02 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11031#issuecomment-178876202 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request: [SPARK-10820][SQL] Support for the continuous ...

2016-02-02 Thread tedyu
Github user tedyu commented on a diff in the pull request: https://github.com/apache/spark/pull/11006#discussion_r51652148 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataStreamReader.scala --- @@ -0,0 +1,127 @@ +/* +* Licensed to the Apache Software Foundation (

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-02 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/10993#discussion_r51652453 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala --- @@ -373,40 +451,25 @@ private[spark] class Coa

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-02 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/10993#discussion_r51652632 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala --- @@ -426,23 +489,23 @@ private[spark] class Coa

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-02 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/10993#discussion_r51652611 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala --- @@ -245,99 +239,182 @@ private[spark] class Co

[GitHub] spark pull request: [SPARK-12330] [MESOS] Fix mesos coarse mode cl...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10319#issuecomment-178879167 **[Test build #50593 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50593/consoleFull)** for PR 10319 at commit [`75887c4`](https://g

[GitHub] spark pull request: [SPARK-12469][CORE][RFC/WIP] Add Consistent Ac...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10841#issuecomment-178879266 **[Test build #50607 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50607/consoleFull)** for PR 10841 at commit [`a507f74`](https://gi

[GitHub] spark pull request: [SPARK-12330] [MESOS] Fix mesos coarse mode cl...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10319#issuecomment-178879307 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12330] [MESOS] Fix mesos coarse mode cl...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10319#issuecomment-178879309 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12469][CORE][RFC/WIP] Add Consistent Ac...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10841#issuecomment-178881873 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12469][CORE][RFC/WIP] Add Consistent Ac...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10841#issuecomment-178881868 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-7997][Core]Add rpcEnv.awaitTermination(...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11031#issuecomment-178882145 **[Test build #50606 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50606/consoleFull)** for PR 11031 at commit [`224916f`](https://gi

[GitHub] spark pull request: [SPARK-12469][CORE][RFC/WIP] Add Consistent Ac...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10841#issuecomment-178881831 **[Test build #50607 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50607/consoleFull)** for PR 10841 at commit [`a507f74`](https://g

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10993#issuecomment-178882985 **[Test build #50608 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50608/consoleFull)** for PR 10993 at commit [`0a1181a`](https://gi

[GitHub] spark pull request: [SPARK-13147] [SQL] improve readability of gen...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11032#issuecomment-178882684 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13147] [SQL] improve readability of gen...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11032#issuecomment-178882689 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12177] [STREAMING] Update KafkaDStreams...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10953#issuecomment-178884266 **[Test build #50609 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50609/consoleFull)** for PR 10953 at commit [`8fae471`](https://gi

[GitHub] spark pull request: [SPARK-10820][SQL] Support for the continuous ...

2016-02-02 Thread tedyu
Github user tedyu commented on a diff in the pull request: https://github.com/apache/spark/pull/11006#discussion_r51654597 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -0,0 +1,211 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-10820][SQL] Support for the continuous ...

2016-02-02 Thread tedyu
Github user tedyu commented on a diff in the pull request: https://github.com/apache/spark/pull/11006#discussion_r51654640 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -0,0 +1,211 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-13147] [SQL] improve readability of gen...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11032#issuecomment-178885367 **[Test build #2495 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2495/consoleFull)** for PR 11032 at commit [`5849d9b`](https://g

[GitHub] spark pull request: [SPARK-13101][SQL] nullability of array type e...

2016-02-02 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/11035 [SPARK-13101][SQL] nullability of array type element should not fail analysis of encoder nullability should only be considered as an optimization rather than part of the type system, so instead

[GitHub] spark pull request: [SPARK-13101][SQL] nullability of array type e...

2016-02-02 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/11035#issuecomment-178886327 cc @marmbrus @liancheng --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-12177] [STREAMING] Update KafkaDStreams...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10953#issuecomment-178886459 **[Test build #50609 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50609/consoleFull)** for PR 10953 at commit [`8fae471`](https://g

[GitHub] spark pull request: [SPARK-12177] [STREAMING] Update KafkaDStreams...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10953#issuecomment-178886470 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12177] [STREAMING] Update KafkaDStreams...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10953#issuecomment-178886469 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12177] [STREAMING] Update KafkaDStreams...

2016-02-02 Thread markgrover
Github user markgrover commented on the pull request: https://github.com/apache/spark/pull/10953#issuecomment-178887726 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-13122] Fix race condition in MemoryStor...

2016-02-02 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/11012#issuecomment-178887920 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-13101][SQL] nullability of array type e...

2016-02-02 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/11035#discussion_r51656127 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/encoders/EncoderResolutionSuite.scala --- @@ -32,94 +34,49 @@ case class StringIntClas

[GitHub] spark pull request: [SPARK-13101][SQL] nullability of array type e...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11035#issuecomment-178889598 **[Test build #50611 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50611/consoleFull)** for PR 11035 at commit [`aa07e56`](https://gi

[GitHub] spark pull request: [SPARK-12637] [CORE] Print stage info of finis...

2016-02-02 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/10922#discussion_r51656405 --- Diff: core/src/main/scala/org/apache/spark/scheduler/SparkListener.scala --- @@ -296,6 +296,17 @@ class StatsReportListener extends SparkListener with

[GitHub] spark pull request: [SPARK-12177] [STREAMING] Update KafkaDStreams...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10953#issuecomment-178891202 **[Test build #50613 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50613/consoleFull)** for PR 10953 at commit [`7dcb848`](https://gi

[GitHub] spark pull request: [SPARK-12177] [STREAMING] Update KafkaDStreams...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10953#issuecomment-178891812 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12177] [STREAMING] Update KafkaDStreams...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10953#issuecomment-178892002 **[Test build #50610 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50610/consoleFull)** for PR 10953 at commit [`7dcb848`](https://gi

[GitHub] spark pull request: [SPARK-12177] [STREAMING] Update KafkaDStreams...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10953#issuecomment-178891802 **[Test build #50613 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50613/consoleFull)** for PR 10953 at commit [`7dcb848`](https://g

[GitHub] spark pull request: [SPARK-12177] [STREAMING] Update KafkaDStreams...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10953#issuecomment-178891809 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13122] Fix race condition in MemoryStor...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11012#issuecomment-178892226 **[Test build #50612 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50612/consoleFull)** for PR 11012 at commit [`5207fb4`](https://gi

[GitHub] spark pull request: [SPARK-12994][CORE] It is not necessary to cre...

2016-02-02 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/10914#discussion_r51656765 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -531,13 +531,14 @@ class SparkContext(config: SparkConf) extends Logging with Exe

[GitHub] spark pull request: [SPARK-12994][CORE] It is not necessary to cre...

2016-02-02 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/10914#discussion_r51656829 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -531,13 +531,14 @@ class SparkContext(config: SparkConf) extends Logging with Exe

[GitHub] spark pull request: [SPARK-12177] [STREAMING] Update KafkaDStreams...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10953#issuecomment-178892440 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12177] [STREAMING] Update KafkaDStreams...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10953#issuecomment-178892437 **[Test build #50610 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50610/consoleFull)** for PR 10953 at commit [`7dcb848`](https://g

[GitHub] spark pull request: [SPARK-12994][CORE] It is not necessary to cre...

2016-02-02 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/10914#discussion_r51656963 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -2212,9 +2212,9 @@ private[spark] object Utils extends Logging { * incompati

[GitHub] spark pull request: [SPARK-12291] [SQL] Establish a link between S...

2016-02-02 Thread mbautin
GitHub user mbautin opened a pull request: https://github.com/apache/spark/pull/11036 [SPARK-12291] [SQL] Establish a link between SparkPlan and LogicalPlan nodes This is a prerequisite for reusing RDDs corresponding to shared query fragments between different Spark SQL queries,

[GitHub] spark pull request: [SPARK-12994][CORE] It is not necessary to cre...

2016-02-02 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/10914#issuecomment-178893105 @zjffdu the latest changes look more complicated than before. I think it would be best to achieve the following: - all checks involving the conf should be in `Ut

[GitHub] spark pull request: [SPARK-12291] [SQL] Establish a link between S...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11036#issuecomment-178893385 **[Test build #50614 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50614/consoleFull)** for PR 11036 at commit [`b79fd07`](https://gi

[GitHub] spark pull request: [SPARK-12330] [MESOS] Fix mesos coarse mode cl...

2016-02-02 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/10319#issuecomment-178893454 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-12330] [MESOS] Fix mesos coarse mode cl...

2016-02-02 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/10319#discussion_r51657811 --- Diff: docs/running-on-mesos.md --- @@ -387,6 +387,13 @@ See the [configuration page](configuration.html) for information on Spark config

[GitHub] spark pull request: [SPARK-13135][SQL] Don't print expressions rec...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11019#issuecomment-178895272 **[Test build #2494 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2494/consoleFull)** for PR 11019 at commit [`2c2b007`](https://

[GitHub] spark pull request: [SPARK-12330] [MESOS] Fix mesos coarse mode cl...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10319#issuecomment-178897207 **[Test build #50616 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50616/consoleFull)** for PR 10319 at commit [`75887c4`](https://gi

[GitHub] spark pull request: [SPARK-12291] [SQL] Establish a link between S...

2016-02-02 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/11036#issuecomment-178897362 Did you link to the corrected JIRA ticket? And what's your whole design? This is a big change and we need to discuss if it worth. --- If your project is set up for i

[GitHub] spark pull request: [SPARK-11714][Mesos] Make Spark on Mesos honor...

2016-02-02 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/10808#discussion_r51658411 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala --- @@ -340,4 +347,24 @@ private[mesos] trait MesosSched

[GitHub] spark pull request: [SPARK-13101][SQL] nullability of array type e...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11035#issuecomment-178898451 **[Test build #50611 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50611/consoleFull)** for PR 11035 at commit [`aa07e56`](https://g

[GitHub] spark pull request: [SPARK-11714][Mesos] Make Spark on Mesos honor...

2016-02-02 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/10808#discussion_r51658530 --- Diff: core/src/main/scala/org/apache/spark/executor/MesosExecutorBackend.scala --- @@ -81,6 +88,16 @@ private[spark] class MesosExecutorBackend

[GitHub] spark pull request: [SPARK-13101][SQL] nullability of array type e...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11035#issuecomment-178898496 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13101][SQL] nullability of array type e...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11035#issuecomment-178898495 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13020][SQL][test] fix random generator ...

2016-02-02 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/10930#issuecomment-178900829 LGTM. Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark pull request: [SPARK-12177] [STREAMING] Update KafkaDStreams...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10953#issuecomment-178901409 **[Test build #50615 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50615/consoleFull)** for PR 10953 at commit [`edfca9f`](https://gi

[GitHub] spark pull request: [SPARK-13101][SQL] nullability of array type e...

2016-02-02 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/11035#issuecomment-178901752 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-12992][SQL]: Update parquet reader to s...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10908#issuecomment-178901804 **[Test build #2493 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2493/consoleFull)** for PR 10908 at commit [`2ea2d54`](https://

[GitHub] spark pull request: [SPARK-12798] [SQL] generated BroadcastHashJoi...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10989#issuecomment-178901909 **[Test build #2496 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2496/consoleFull)** for PR 10989 at commit [`4d75022`](https://g

[GitHub] spark pull request: [SPARK-12957][SQL] Initial support for constra...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10844#issuecomment-178902239 **[Test build #50603 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50603/consoleFull)** for PR 10844 at commit [`2bd2735`](https://g

[GitHub] spark pull request: [SPARK-12291] [SQL] Establish a link between S...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11036#issuecomment-178902429 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12291] [SQL] Establish a link between S...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11036#issuecomment-178902371 **[Test build #50614 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50614/consoleFull)** for PR 11036 at commit [`b79fd07`](https://g

[GitHub] spark pull request: [SPARK-12291] [SQL] Establish a link between S...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11036#issuecomment-178902428 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12957][SQL] Initial support for constra...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10844#issuecomment-178902496 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12957][SQL] Initial support for constra...

2016-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10844#issuecomment-178902501 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13101][SQL] nullability of array type e...

2016-02-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11035#issuecomment-178902743 **[Test build #50617 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50617/consoleFull)** for PR 11035 at commit [`aa07e56`](https://gi

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-02 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11030#discussion_r51660015 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/ContinuousQueryManager.scala --- @@ -0,0 +1,106 @@ +/* + * Licensed to the Apache Software Fo

[GitHub] spark pull request: [SPARK-12991] [SQL] Establish a link between S...

2016-02-02 Thread mbautin
Github user mbautin commented on the pull request: https://github.com/apache/spark/pull/11036#issuecomment-178902964 Sorry -- linked to the wrong JIRA ticket. Should be https://issues.apache.org/jira/browse/SPARK-12991. --- If your project is set up for it, you can reply to this emai

[GitHub] spark pull request: [SPARK-12705] [SPARK-10777] [SQL] Analyzer Rul...

2016-02-02 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/10678#discussion_r51660099 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -521,38 +522,96 @@ class Analyzer( */ ob

[GitHub] spark pull request: [SPARK-12991] [SQL] Establish a link between S...

2016-02-02 Thread mbautin
Github user mbautin commented on the pull request: https://github.com/apache/spark/pull/11036#issuecomment-178903997 @cloud-fan : the whole design for the feature this is needed for (query fragment RDD reuse) is at https://issues.apache.org/jira/browse/SPARK-11838, but this seems to b

[GitHub] spark pull request: [SPARK-13150] [SQL] disable two flaky tests

2016-02-02 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/11037 [SPARK-13150] [SQL] disable two flaky tests You can merge this pull request into a Git repository by running: $ git pull https://github.com/davies/spark disable_flaky Alternatively you can re

[GitHub] spark pull request: [SPARK-13150] [SQL] disable two flaky tests

2016-02-02 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/11037#issuecomment-178903950 cc @liancheng --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-02 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11030#discussion_r51660259 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/QueryException.scala --- @@ -0,0 +1,59 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-02 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11030#discussion_r51660396 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala --- @@ -845,6 +847,16 @@ class SQLContext private[sql]( } /**

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-02 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11030#discussion_r51660427 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SinkStatus.scala --- @@ -0,0 +1,34 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-13146][SQL] Management API for continuo...

2016-02-02 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/11030#discussion_r51660438 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/ContinuousQuery.scala --- @@ -17,11 +17,45 @@ package org.apache.spark.sql +impor

  1   2   3   4   5   6   7   8   9   >