[GitHub] spark pull request: [SPARK-7150] add range() api

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6081#issuecomment-102290820 [Test build #32791 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32791/consoleFull) for PR 6081 at commit [`617da76`](https://gith

[GitHub] spark pull request: [SPARK-7660] Wrap SnappyOutputStream to work a...

2015-05-14 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/6176#discussion_r30388717 --- Diff: core/src/main/scala/org/apache/spark/io/CompressionCodec.scala --- @@ -154,8 +154,53 @@ class SnappyCompressionCodec(conf: SparkConf) extends Compressi

[GitHub] spark pull request: [SPARK-7659] [SQL] Sort by attributes that are...

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6169#issuecomment-102290810 [Test build #32790 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32790/consoleFull) for PR 6169 at commit [`f559226`](https://gith

[GitHub] spark pull request: [SPARK-7659] [SQL] Sort by attributes that are...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6169#issuecomment-102290516 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7659] [SQL] Sort by attributes that are...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6169#issuecomment-102290494 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7150] add range() api

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6081#issuecomment-102290515 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7150] add range() api

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6081#issuecomment-102290502 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7660] Wrap SnappyOutputStream to work a...

2015-05-14 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/6176#issuecomment-102290375 @JoshRosen does it make sense to re-enable those flakey tests in this patch? --- If your project is set up for it, you can reply to this email and have your reply appea

[GitHub] spark pull request: [SPARK-7150] add range() api

2015-05-14 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/6081#issuecomment-102290220 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [SPARK-7150] add range() api

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6081#issuecomment-102289632 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7650][Streaming][WebUI] Move streaming ...

2015-05-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6160 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-7660] Wrap SnappyOutputStream to work a...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6176#issuecomment-102289609 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7654][SQL] DataFrameReader and DataFram...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6175#issuecomment-102289558 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7150] add range() api

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6081#issuecomment-102289633 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32

[GitHub] spark pull request: [SPARK-7501] [Streaming] DAG visualization: sh...

2015-05-14 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/6034#discussion_r30388533 --- Diff: external/twitter/src/main/scala/org/apache/spark/streaming/twitter/TwitterUtils.scala --- @@ -40,7 +40,7 @@ object TwitterUtils { twitterAu

[GitHub] spark pull request: [SPARK-7150] add range() api

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6081#issuecomment-102289602 [Test build #32775 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32775/consoleFull) for PR 6081 at commit [`617da76`](https://git

[GitHub] spark pull request: [SPARK-7654][SQL] DataFrameReader and DataFram...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6175#issuecomment-102289611 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7660] Wrap SnappyOutputStream to work a...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6176#issuecomment-102289548 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [core] Remove unreachable Heartbeat message fr...

2015-05-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6163 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-7650][Streaming][WebUI] Move streaming ...

2015-05-14 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/6160#issuecomment-102289203 Master 1.4. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-7501] [Streaming] DAG visualization: sh...

2015-05-14 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/6034#discussion_r30388493 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/DStream.scala --- @@ -111,6 +112,50 @@ abstract class DStream[T: ClassTag] ( /* Set

[GitHub] spark pull request: [SPARK-7501] [Streaming] DAG visualization: sh...

2015-05-14 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/6034#discussion_r30388453 --- Diff: external/twitter/src/main/scala/org/apache/spark/streaming/twitter/TwitterUtils.scala --- @@ -40,7 +40,7 @@ object TwitterUtils { twitterAu

[GitHub] spark pull request: [SPARK-7654][SQL] DataFrameReader and DataFram...

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6175#issuecomment-102287622 [Test build #32787 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32787/consoleFull) for PR 6175 at commit [`27b4b88`](https://gith

[GitHub] spark pull request: [SPARK-7660] Wrap SnappyOutputStream to work a...

2015-05-14 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/6176 [SPARK-7660] Wrap SnappyOutputStream to work around snappy-java bug This patch wraps `SnappyOutputStream` to ensure that `close()` is idempotent and to guard against write-after-`close()` bugs. Th

[GitHub] spark pull request: [SPARK-7501] [Streaming] DAG visualization: sh...

2015-05-14 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/6034#discussion_r30388400 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/DStream.scala --- @@ -338,6 +370,48 @@ abstract class DStream[T: ClassTag] ( }

[GitHub] spark pull request: [SPARK-7660] Wrap SnappyOutputStream to work a...

2015-05-14 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/6176#issuecomment-102287325 /cc @rxin @pwendell --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-7501] [Streaming] DAG visualization: sh...

2015-05-14 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/6034#discussion_r30388389 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDDOperationScope.scala --- @@ -88,14 +87,25 @@ private[spark] object RDDOperationScope { /

[GitHub] spark pull request: [SPARK-7654][SQL] DataFrameReader and DataFram...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6175#issuecomment-102287085 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7654][SQL] DataFrameReader and DataFram...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6175#issuecomment-102287016 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7501] [Streaming] DAG visualization: sh...

2015-05-14 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/6034#discussion_r30388347 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/InputDStream.scala --- @@ -49,6 +49,9 @@ abstract class InputDStream[T: ClassTag] (@

[GitHub] spark pull request: [SPARK-7269] [SQL] Incorrect analysis for aggr...

2015-05-14 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/6173#issuecomment-102286749 Hi @chenghao-intel , as far as I know, we can only instantiate leaf expressions which are all case classes. So probably we can design the `semanticEquals` as how case

[GitHub] spark pull request: [SPARK-7659] [SQL] Sort by attributes that are...

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6169#issuecomment-102286704 [Test build #32786 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32786/consoleFull) for PR 6169 at commit [`a8054c3`](https://git

[GitHub] spark pull request: [SPARK-7659] [SQL] Sort by attributes that are...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6169#issuecomment-102286711 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32

[GitHub] spark pull request: [SPARK-7501] [Streaming] DAG visualization: sh...

2015-05-14 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/6034#discussion_r30388323 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/DStream.scala --- @@ -111,6 +112,50 @@ abstract class DStream[T: ClassTag] ( /

[GitHub] spark pull request: [SPARK-7659] [SQL] Sort by attributes that are...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6169#issuecomment-102286707 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7657][YARN] Add driver logs links in ap...

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6166#issuecomment-102286551 [Test build #32784 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32784/consoleFull) for PR 6166 at commit [`402e8e4`](https://gith

[GitHub] spark pull request: [SPARK-7659] [SQL] Sort by attributes that are...

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6169#issuecomment-102286456 [Test build #32786 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32786/consoleFull) for PR 6169 at commit [`a8054c3`](https://gith

[GitHub] spark pull request: [SPARK-7269] [SQL] Incorrect analysis for aggr...

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6173#issuecomment-102286472 [Test build #32785 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32785/consoleFull) for PR 6173 at commit [`cc02045`](https://gith

[GitHub] spark pull request: [SPARK-7659] [SQL] Sort by attributes that are...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6169#issuecomment-102285819 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7269] [SQL] Incorrect analysis for aggr...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6173#issuecomment-102285753 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7657][YARN] Add driver link in applicat...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6166#issuecomment-102285764 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7657][YARN] Add driver link in applicat...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6166#issuecomment-102285818 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7659] [SQL] Sort by attributes that are...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6169#issuecomment-102285758 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7269] [SQL] Incorrect analysis for aggr...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6173#issuecomment-102285817 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [Spark-7511][MLLIB] pyspark ml seed param shou...

2015-05-14 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/6139#issuecomment-102285223 That test failure looks kind of valid. I'll look into it... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-7501] [Streaming] DAG visualization: sh...

2015-05-14 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/6034#discussion_r30388035 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/DStream.scala --- @@ -302,35 +347,22 @@ abstract class DStream[T: ClassTag] ( //

[GitHub] spark pull request: [SPARK-7473][MLLIB] Add reservoir sample in Ra...

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5988#issuecomment-102284514 [Test build #807 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/807/consoleFull) for PR 5988 at commit [`37459e1`](https://gith

[GitHub] spark pull request: [SPARK-7654][SQL] DataFrameReader and DataFram...

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6175#issuecomment-102284229 [Test build #32783 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32783/consoleFull) for PR 6175 at commit [`d8f2444`](https://gith

[GitHub] spark pull request: [SPARK-7575][ml][doc] Example code for OneVsRe...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6115#issuecomment-102284174 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7575][ml][doc] Example code for OneVsRe...

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6115#issuecomment-102284136 [Test build #32774 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32774/consoleFull) for PR 6115 at commit [`87ad3c7`](https://git

[GitHub] spark pull request: [SPARK-7575][ml][doc] Example code for OneVsRe...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6115#issuecomment-102284176 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32

[GitHub] spark pull request: [SPARK-7654][SQL] DataFrameReader and DataFram...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6175#issuecomment-102284091 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7654][SQL] DataFrameReader and DataFram...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6175#issuecomment-102284026 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7501] [Streaming] DAG visualization: sh...

2015-05-14 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/6034#discussion_r30387987 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/DStream.scala --- @@ -111,6 +112,50 @@ abstract class DStream[T: ClassTag] ( /* Set

[GitHub] spark pull request: [SPARK-7501] [Streaming] DAG visualization: sh...

2015-05-14 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/6034#discussion_r30387910 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/FileInputDStream.scala --- @@ -126,6 +126,8 @@ class FileInputDStream[K, V, F <: NewInputF

[GitHub] spark pull request: [SPARK-7654][SQL] DataFrameReader and DataFram...

2015-05-14 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/6175 [SPARK-7654][SQL] DataFrameReader and DataFrameWriter for input/output API TODO: - Documentation update - Move JDBC into reader / writer? - Move the generic load interface into reader.

[GitHub] spark pull request: [SPARK-7501] [Streaming] DAG visualization: sh...

2015-05-14 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/6034#discussion_r30387808 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/InputDStream.scala --- @@ -49,6 +49,9 @@ abstract class InputDStream[T: ClassTag] (@transi

[GitHub] spark pull request: [SPARK-7501] [Streaming] DAG visualization: sh...

2015-05-14 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/6034#discussion_r30387684 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/DStream.scala --- @@ -338,6 +370,48 @@ abstract class DStream[T: ClassTag] ( }

[GitHub] spark pull request: [SPARK-6747][SQL] Support List<> as a return t...

2015-05-14 Thread maropu
Github user maropu commented on the pull request: https://github.com/apache/spark/pull/5395#issuecomment-102276959 @marmbrus Made a mistake to close this pr, so may I make a new pr because I can't re-open it. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARK-7627][SPARK-7472] DAG visualization: st...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6171#issuecomment-102276660 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7627][SPARK-7472] DAG visualization: st...

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6171#issuecomment-102276655 [Test build #32773 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32773/consoleFull) for PR 6171 at commit [`b928cd4`](https://git

[GitHub] spark pull request: [SPARK-7627][SPARK-7472] DAG visualization: st...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6171#issuecomment-102276662 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32

[GitHub] spark pull request: [SPARK-7269] [SQL] Incorrect analysis for aggr...

2015-05-14 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/6173#discussion_r30387349 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Expression.scala --- @@ -76,6 +76,12 @@ abstract class Expression exte

[GitHub] spark pull request: [SPARK-7269] [SQL] Incorrect analysis for aggr...

2015-05-14 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/6173#discussion_r30387287 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Expression.scala --- @@ -76,6 +76,12 @@ abstract class Expression exte

[GitHub] spark pull request: [SQL] [Minor] added check analysis rule for un...

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6174#issuecomment-102276310 [Test build #32782 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32782/consoleFull) for PR 6174 at commit [`cf1475a`](https://gith

[GitHub] spark pull request: [SPARK-7501] [Streaming] DAG visualization: sh...

2015-05-14 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/6034#discussion_r30387251 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDDOperationScope.scala --- @@ -88,14 +87,25 @@ private[spark] object RDDOperationScope { /**

[GitHub] spark pull request: [SQL] [Minor] added check analysis rule for un...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6174#issuecomment-102276122 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SQL] [Minor] added check analysis rule for un...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6174#issuecomment-102276185 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7501] [Streaming] DAG visualization: sh...

2015-05-14 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/6034#discussion_r30387164 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDDOperationScope.scala --- @@ -88,14 +87,25 @@ private[spark] object RDDOperationScope { /**

[GitHub] spark pull request: [SQL] [Minor] added check analysis rule for un...

2015-05-14 Thread scwf
Github user scwf commented on a diff in the pull request: https://github.com/apache/spark/pull/6174#discussion_r30387122 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -105,6 +105,18 @@ trait CheckAnalysis {

[GitHub] spark pull request: [SPARK-7501] [Streaming] DAG visualization: sh...

2015-05-14 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/6034#discussion_r30387131 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDDOperationScope.scala --- @@ -43,10 +43,9 @@ import org.apache.spark.SparkContext @JsonPropertyOrder(Ar

[GitHub] spark pull request: [SPARK-7591] [SQL] Partitioning support API tw...

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6150#issuecomment-102274611 [Test build #32781 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32781/consoleFull) for PR 6150 at commit [`37d1738`](https://gith

[GitHub] spark pull request: [SPARK-7657][YARN] Add driver link in applicat...

2015-05-14 Thread harishreedharan
Github user harishreedharan commented on the pull request: https://github.com/apache/spark/pull/6166#issuecomment-102274593 Looks like this can be fixed using `NodeReport` which was available in Hadoop 2.2. Testing it right now. --- If your project is set up for it, you can reply to

[GitHub] spark pull request: [SPARK-7624] Revert #4147

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6172#issuecomment-102274461 [Test build #32780 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32780/consoleFull) for PR 6172 at commit [`3bfbbde`](https://gith

[GitHub] spark pull request: [SPARK-7624] Revert #4147

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6172#issuecomment-102273883 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7624] Revert #4147

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6172#issuecomment-102274004 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7627][SPARK-7472] DAG visualization: st...

2015-05-14 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/6171#issuecomment-102274457 Testing your PR. Let's see if there is any memory leak tomorrow morning. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-6747][SQL] Support List<> as a return t...

2015-05-14 Thread maropu
Github user maropu closed the pull request at: https://github.com/apache/spark/pull/5395 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-7591] [SQL] Partitioning support API tw...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6150#issuecomment-102274075 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7591] [SQL] Partitioning support API tw...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6150#issuecomment-102273962 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SQL] [Minor] added check analysis rule for un...

2015-05-14 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/6174#discussion_r30387026 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -105,6 +105,18 @@ trait CheckAnalysis {

[GitHub] spark pull request: [SQL] [Minor] added check analysis rule for un...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6174#issuecomment-102272440 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SQL] [Minor] added check analysis rule for un...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6174#issuecomment-102272443 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32

[GitHub] spark pull request: [SQL] [Minor] added check analysis rule for un...

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6174#issuecomment-102272428 [Test build #32778 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32778/consoleFull) for PR 6174 at commit [`6541ec4`](https://git

[GitHub] spark pull request: [SPARK-7269] [SQL] Incorrect analysis for aggr...

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6173#issuecomment-102272309 [Test build #32779 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32779/consoleFull) for PR 6173 at commit [`d7ff8f4`](https://gith

[GitHub] spark pull request: [SPARK-7269] [SQL] Incorrect analysis for aggr...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6173#issuecomment-102271340 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SQL] [Minor] added check analysis rule for un...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6174#issuecomment-102271388 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SQL] [Minor] added check analysis rule for un...

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6174#issuecomment-102271634 [Test build #32778 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32778/consoleFull) for PR 6174 at commit [`6541ec4`](https://gith

[GitHub] spark pull request: [SPARK-7269] [SQL] Incorrect analysis for aggr...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6173#issuecomment-102271389 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SQL] [Minor] added check analysis rule for un...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6174#issuecomment-102271333 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7226][SparkR]Support math functions in ...

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6170#issuecomment-102270852 [Test build #32772 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32772/consoleFull) for PR 6170 at commit [`07aa72e`](https://git

[GitHub] spark pull request: [SPARK-7226][SparkR]Support math functions in ...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6170#issuecomment-102270890 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7226][SparkR]Support math functions in ...

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6170#issuecomment-102270892 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32

[GitHub] spark pull request: [SPARK-7269] [SQL] Incorrect analysis for aggr...

2015-05-14 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/6173#issuecomment-102270319 cc @chenghao-intel @marmbrus --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-4939] revive offers periodically in Loc...

2015-05-14 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/4147#issuecomment-102270390 @pwendell It's discussed here: https://issues.apache.org/jira/browse/SPARK-7624 --- If your project is set up for it, you can reply to this email and have your reply app

[GitHub] spark pull request: [SQL] [Minor] added check analysis rule for un...

2015-05-14 Thread scwf
GitHub user scwf opened a pull request: https://github.com/apache/spark/pull/6174 [SQL] [Minor] added check analysis rule for union node You can merge this pull request into a Git repository by running: $ git pull https://github.com/scwf/spark union Alternatively you can revi

[GitHub] spark pull request: [SPARK-7269] [SQL] Incorrect analysis for aggr...

2015-05-14 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/6173 [SPARK-7269] [SQL] Incorrect analysis for aggregation(use semanticEquals) A modified version of https://github.com/apache/spark/pull/6110, use `semanticEquals` to make it more efficient. You can

[GitHub] spark pull request: [SPARK-7659] [SQL] Sort by attributes that are...

2015-05-14 Thread scwf
Github user scwf commented on the pull request: https://github.com/apache/spark/pull/6169#issuecomment-102269795 Yes, actually this PR is try to add the missing columns before we extract window expressions and add `window` node. i will have a try on this way, if we can not handle it

[GitHub] spark pull request: [SPARK-7624] Revert #4147

2015-05-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6172#issuecomment-102269218 [Test build #32777 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32777/consoleFull) for PR 6172 at commit [`5e5b2e3`](https://gith

[GitHub] spark pull request: [SPARK-7624] Revert #4147

2015-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6172#issuecomment-102268909 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

  1   2   3   4   5   6   7   8   9   10   >