[GitHub] spark pull request: [SQL] Various DataFrame DSL update.

2015-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4260#issuecomment-71983693 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SQL] Various DataFrame DSL update.

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4260#issuecomment-71983685 [Test build #26299 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26299/consoleFull) for PR 4260 at commit [`73466c1`](https://gith

[GitHub] spark pull request: [SPARK-5253] [ML] LinearRegression with L1/L2 ...

2015-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4259#issuecomment-71983353 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5253] [ML] LinearRegression with L1/L2 ...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4259#issuecomment-71983349 [Test build #26298 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26298/consoleFull) for PR 4259 at commit [`dc7dcd7`](https://gith

[GitHub] spark pull request: [STREAMING] SPARK-4986 Wait for receivers to d...

2015-01-28 Thread cleaton
Github user cleaton commented on the pull request: https://github.com/apache/spark/pull/3868#issuecomment-71982990 Thank you for the comments @tdas . I think the diff file for this PR has become a bit misleading. It looks like there is more change than there actually is. This is a sum

[GitHub] spark pull request: [SPARK-3977] Conversion methods for BlockMatri...

2015-01-28 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/4256#issuecomment-71982832 LGTM. Merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-3977] Conversion methods for BlockMatri...

2015-01-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4256 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-5388] Provide a stable application subm...

2015-01-28 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/4216#issuecomment-71982680 Hey so in case it's not clear, the issue is that because Akka makes no guarantees whatsoever about compatibility, we need to define our own protocol if we want the stand

[GitHub] spark pull request: [SPARK-5461] [graphx] Add isCheckpointed, getC...

2015-01-28 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/4253#issuecomment-71982547 is the problem partitionsRDD transient? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-5475][CORE] Java 8 tests are like maint...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4264#issuecomment-71982365 [Test build #26301 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26301/consoleFull) for PR 4264 at commit [`ba716cb`](https://gith

[GitHub] spark pull request: [SPARK-5475][CORE] Java 8 tests are like maint...

2015-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4264#issuecomment-71982373 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SQL] Various DataFrame DSL update.

2015-01-28 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/4260#issuecomment-71982263 @rxin The ALS join code is much easier to read now:) I hope UDFs can be used as functions instead of an argument of `callUDF`. Besides, it would be nice to interpret strin

[GitHub] spark pull request: [SPARK-3562]Periodic cleanup event logs

2015-01-28 Thread viper-kun
Github user viper-kun commented on a diff in the pull request: https://github.com/apache/spark/pull/4214#discussion_r23750788 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala --- @@ -53,8 +79,10 @@ private[history] class FsHistoryProvider(conf:

[GitHub] spark pull request: [SPARK-3562]Periodic cleanup event logs

2015-01-28 Thread viper-kun
Github user viper-kun commented on a diff in the pull request: https://github.com/apache/spark/pull/4214#discussion_r23750759 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala --- @@ -113,12 +129,12 @@ private[history] class FsHistoryProvider(con

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3798#issuecomment-71981965 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3798#issuecomment-71981959 [Test build #26302 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26302/consoleFull) for PR 3798 at commit [`80fd6ae`](https://gith

[GitHub] spark pull request: [SQL] Various DataFrame DSL update.

2015-01-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4260#discussion_r23750711 --- Diff: mllib/src/main/scala/org/apache/spark/ml/recommendation/ALS.scala --- @@ -133,13 +123,14 @@ class ALSModel private[ml] ( } }

[GitHub] spark pull request: [SPARK-5472][SQL] A JDBC data source for Spark...

2015-01-28 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/4261#discussion_r23750587 --- Diff: project/SparkBuild.scala --- @@ -397,6 +397,11 @@ object TestSettings { testOptions += Tests.Argument(TestFrameworks.JUnit, "-v", "-a"),

[GitHub] spark pull request: [SQL] Various DataFrame DSL update.

2015-01-28 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4260#discussion_r23750396 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -133,15 +132,14 @@ class LogisticRegressionModel private[ml]

[GitHub] spark pull request: [SPARK-5474][Build]curl should support URL red...

2015-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4263#issuecomment-71981094 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-3562]Periodic cleanup event logs

2015-01-28 Thread viper-kun
Github user viper-kun closed the pull request at: https://github.com/apache/spark/pull/2471 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[GitHub] spark pull request: [SPARK-5474][Build]curl should support URL red...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4263#issuecomment-71981089 [Test build #26300 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26300/consoleFull) for PR 4263 at commit [`e097b4d`](https://gith

[GitHub] spark pull request: [SPARK-3562]Periodic cleanup event logs

2015-01-28 Thread viper-kun
Github user viper-kun commented on a diff in the pull request: https://github.com/apache/spark/pull/4214#discussion_r23750085 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala --- @@ -163,9 +179,6 @@ private[history] class FsHistoryProvider(conf:

[GitHub] spark pull request: SPARK-3290 [GRAPHX] No unpersist callls in SVD...

2015-01-28 Thread ankurdave
Github user ankurdave commented on the pull request: https://github.com/apache/spark/pull/4234#issuecomment-71979899 Adding `count()` calls would be good. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[GitHub] spark pull request: [SPARK-5012][MLLib][PySpark]Python API for Gau...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4059#issuecomment-71978609 [Test build #26303 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26303/consoleFull) for PR 4059 at commit [`2e14d82`](https://githu

[GitHub] spark pull request: [SPARK-5012][MLLib][PySpark]Python API for Gau...

2015-01-28 Thread FlytxtRnD
Github user FlytxtRnD commented on the pull request: https://github.com/apache/spark/pull/4059#issuecomment-71978435 The PR is updated according to https://github.com/apache/spark/pull/4088 which modifies GaussianMixtureModel to expose instances of MutlivariateGaussian rather than se

[GitHub] spark pull request: Add a config option to print DAG.

2015-01-28 Thread KaiXinXiaoLei
Github user KaiXinXiaoLei commented on the pull request: https://github.com/apache/spark/pull/4257#issuecomment-71976462 15/01/26 22:38:37 INFO SparkContext: RDD.toDebugString: (12) MappedRDD[13] at map at dagPrint.scala:26 [] | MappedRDD[12] at map at dagPrint.scala:25 []

[GitHub] spark pull request: [SPARK-5475][CORE] Java 8 tests are like maint...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4264#issuecomment-71975825 [Test build #26301 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26301/consoleFull) for PR 4264 at commit [`ba716cb`](https://githu

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3798#issuecomment-71975810 [Test build #26302 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26302/consoleFull) for PR 3798 at commit [`80fd6ae`](https://githu

[GitHub] spark pull request: [SPARK-5474][Build]curl should support URL red...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4263#issuecomment-71975823 [Test build #26300 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26300/consoleFull) for PR 4263 at commit [`e097b4d`](https://githu

[GitHub] spark pull request: [SPARK-5253] [ML] LinearRegression with L1/L2 ...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4259#issuecomment-71975805 [Test build #26298 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26298/consoleFull) for PR 4259 at commit [`dc7dcd7`](https://githu

[GitHub] spark pull request: [SQL] Various DataFrame DSL update.

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4260#issuecomment-71975787 [Test build #26299 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26299/consoleFull) for PR 4260 at commit [`73466c1`](https://githu

[GitHub] spark pull request: [SQL] Various DataFrame DSL update.

2015-01-28 Thread shaneknapp
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4260#issuecomment-71975259 jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [SPARK-5474][Build]curl should support URL red...

2015-01-28 Thread shaneknapp
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4263#issuecomment-71975294 jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [SPARK-5475][CORE] Java 8 tests are like maint...

2015-01-28 Thread shaneknapp
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4264#issuecomment-71975278 jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-28 Thread shaneknapp
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/3798#issuecomment-71975308 jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [SQL] Various DataFrame DSL update.

2015-01-28 Thread shaneknapp
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4260#issuecomment-71975248 jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [SPARK-5253] [ML] LinearRegression with L1/L2 ...

2015-01-28 Thread shaneknapp
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4259#issuecomment-71975286 jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [SQL] Various DataFrame DSL update.

2015-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4260#issuecomment-71975091 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5475][CORE] Java 8 tests are like maint...

2015-01-28 Thread shaneknapp
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4264#issuecomment-71975011 i will kick this off again once i restart jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If y

[GitHub] spark pull request: [SQL] Various DataFrame DSL update.

2015-01-28 Thread shaneknapp
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4260#issuecomment-71975104 i will kick this off again once i restart jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If y

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-28 Thread shaneknapp
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/3798#issuecomment-71975061 i will kick this off again once i restart jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If y

[GitHub] spark pull request: [SPARK-5474][Build]curl should support URL red...

2015-01-28 Thread shaneknapp
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4263#issuecomment-71975044 i will kick this off again once i restart jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If y

[GitHub] spark pull request: [SPARK-5253] [ML] LinearRegression with L1/L2 ...

2015-01-28 Thread shaneknapp
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4259#issuecomment-71975031 i will kick this off again once i restart jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If y

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-28 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23748806 --- Diff: external/kafka/src/main/scala/org/apache/spark/rdd/kafka/OffsetRange.scala --- @@ -0,0 +1,70 @@ +/* + * Licensed to the Apache Software Fo

[GitHub] spark pull request: [SPARK-5253] [ML] LinearRegression with L1/L2 ...

2015-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4259#issuecomment-71974801 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5475][CORE] Java 8 tests are like maint...

2015-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4264#issuecomment-71974799 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5474][Build]curl should support URL red...

2015-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4263#issuecomment-71974805 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5473] [EC2] Expose SSH failures after s...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4262#issuecomment-71973865 [Test build #26293 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26293/consoleFull) for PR 4262 at commit [`84250a8`](https://gith

[GitHub] spark pull request: [SPARK-5473] [EC2] Expose SSH failures after s...

2015-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4262#issuecomment-71973870 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-28 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/3798#issuecomment-71972580 Great! The offset range is the one which is still tricky. Lets brainstorm on it a bit more. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-28 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23747942 --- Diff: external/kafka/src/main/scala/org/apache/spark/rdd/kafka/OffsetRange.scala --- @@ -0,0 +1,70 @@ +/* + * Licensed to the Apache Software Foundat

[GitHub] spark pull request: [SPARK-5473] [EC2] Expose SSH failures after s...

2015-01-28 Thread nchammas
Github user nchammas commented on the pull request: https://github.com/apache/spark/pull/4262#issuecomment-71972191 I'm thinking it would be useful for a separate PR to add some information about how many nodes of the cluster are up during a cluster launch like this: ``` W

[GitHub] spark pull request: Add a config option to print DAG.

2015-01-28 Thread ScrapCodes
Github user ScrapCodes commented on the pull request: https://github.com/apache/spark/pull/4257#issuecomment-71972197 You can print the same details by calling rdd.toDebugString in your program ? --- If your project is set up for it, you can reply to this email and have your reply a

[GitHub] spark pull request: [SPARK-5475][CORE] Java 8 tests are like maint...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4264#issuecomment-71971852 [Test build #26297 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26297/consoleFull) for PR 4264 at commit [`ba716cb`](https://githu

[GitHub] spark pull request: [SPARK-5278][SQL] complete the check of ambigu...

2015-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4068#issuecomment-71971690 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5278][SQL] complete the check of ambigu...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4068#issuecomment-71971685 [Test build #26290 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26290/consoleFull) for PR 4068 at commit [`d9cf8fd`](https://gith

[GitHub] spark pull request: [SPARK-5475][CORE] Java 8 tests are like maint...

2015-01-28 Thread ScrapCodes
GitHub user ScrapCodes opened a pull request: https://github.com/apache/spark/pull/4264 [SPARK-5475][CORE] Java 8 tests are like maintenance overhead. Having tests that validate the same code compatible with java 8 and java 7 is like asserting that java 8 is backward compatible with

[GitHub] spark pull request: [SPARK-5473] [EC2] Expose SSH failures after s...

2015-01-28 Thread nchammas
Github user nchammas commented on the pull request: https://github.com/apache/spark/pull/4262#issuecomment-71971574 > FWIW I actually found the dots useful to figure out how long the script was going to wait before trying again I find this useful too, but it doesn't work when

[GitHub] spark pull request: [SPARK-5472][SQL] A JDBC data source for Spark...

2015-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4261#issuecomment-71971280 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5472][SQL] A JDBC data source for Spark...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4261#issuecomment-71971275 [Test build #26288 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26288/consoleFull) for PR 4261 at commit [`41647ef`](https://gith

[GitHub] spark pull request: [SPARK-5473] [EC2] Expose SSH failures after s...

2015-01-28 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/4262#issuecomment-71971288 The idea of printing the error message sounds good to me. FWIW I actually found the dots useful to figure out how long the script was going to wait before trying again -

[GitHub] spark pull request: [SPARK-5278][SQL] complete the check of ambigu...

2015-01-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/4068#discussion_r23747469 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -285,11 +285,22 @@ class Analyzer(catalog: Catalog,

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-28 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23747450 --- Diff: external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaCluster.scala --- @@ -0,0 +1,320 @@ +/* + * Licensed to the Apache Software Found

[GitHub] spark pull request: [SPARK-3872][streaming], Rewrite the test for ...

2015-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4248#issuecomment-71970984 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-3872][streaming], Rewrite the test for ...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4248#issuecomment-71970979 [Test build #26289 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26289/consoleFull) for PR 4248 at commit [`4aedc06`](https://gith

[GitHub] spark pull request: [SPARK-5253] [ML] LinearRegression with L1/L2 ...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4259#issuecomment-71970610 [Test build #26296 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26296/consoleFull) for PR 4259 at commit [`dc7dcd7`](https://githu

[GitHub] spark pull request: [SPARK-5474][Build]curl should support URL red...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4263#issuecomment-71970609 [Test build #26295 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26295/consoleFull) for PR 4263 at commit [`e097b4d`](https://githu

[GitHub] spark pull request: [SQL] Various DataFrame DSL update.

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4260#issuecomment-71970562 [Test build #26287 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26287/consoleFull) for PR 4260 at commit [`d31fcd2`](https://gith

[GitHub] spark pull request: [SQL] Various DataFrame DSL update.

2015-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4260#issuecomment-71970566 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5474][Build]curl should support URL red...

2015-01-28 Thread witgo
GitHub user witgo opened a pull request: https://github.com/apache/spark/pull/4263 [SPARK-5474][Build]curl should support URL redirection in build/mvn You can merge this pull request into a Git repository by running: $ git pull https://github.com/witgo/spark SPARK-5474 Altern

[GitHub] spark pull request: [SPARK-5278][SQL] complete the check of ambigu...

2015-01-28 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/4068#discussion_r23746914 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -285,11 +285,22 @@ class Analyzer(catalog: Catalog,

[GitHub] spark pull request: [SPARK-5473] [EC2] Expose SSH failures after s...

2015-01-28 Thread nchammas
Github user nchammas commented on the pull request: https://github.com/apache/spark/pull/4262#issuecomment-71969718 cc @shivaram @JoshRosen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: [SQL] Various DataFrame DSL update.

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4260#issuecomment-71969716 [Test build #26294 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26294/consoleFull) for PR 4260 at commit [`fab3ccc`](https://githu

[GitHub] spark pull request: [EC2] Expose SSH failures after status checks ...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4262#issuecomment-71969386 [Test build #26293 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26293/consoleFull) for PR 4262 at commit [`84250a8`](https://githu

[GitHub] spark pull request: [EC2] Expose SSH failures after status checks ...

2015-01-28 Thread nchammas
GitHub user nchammas opened a pull request: https://github.com/apache/spark/pull/4262 [EC2] Expose SSH failures after status checks pass If there is some fatal problem with launching a cluster, `spark-ec2` just hangs without giving the user useful feedback on what the problem is.

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-28 Thread koeninger
Github user koeninger commented on the pull request: https://github.com/apache/spark/pull/3798#issuecomment-71968759 packaging, makes sense method name, agreed, named it createNewStream for now offset range, see my explanation of the interface above. I think this is

[GitHub] spark pull request: [SPARK-5253] [ML] LinearRegression with L1/L2 ...

2015-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4259#issuecomment-71968586 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-5253] [ML] LinearRegression with L1/L2 ...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4259#issuecomment-71968583 [Test build #26292 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26292/consoleFull) for PR 4259 at commit [`a29`](https://gith

[GitHub] spark pull request: [SPARK-5253] [ML] LinearRegression with L1/L2 ...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4259#issuecomment-71968285 [Test build #26291 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26291/consoleFull) for PR 4259 at commit [`5b75cda`](https://gith

[GitHub] spark pull request: [SPARK-5253] [ML] LinearRegression with L1/L2 ...

2015-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4259#issuecomment-71968286 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-28 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23746360 --- Diff: external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaCluster.scala --- @@ -0,0 +1,320 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-5253] [ML] LinearRegression with L1/L2 ...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4259#issuecomment-71968251 [Test build #26292 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26292/consoleFull) for PR 4259 at commit [`a29`](https://githu

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-28 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23746302 --- Diff: external/kafka/src/test/scala/org/apache/spark/streaming/kafka/KafkaStreamSuite.scala --- @@ -130,7 +130,7 @@ abstract class KafkaStreamSuiteBase

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-28 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23746262 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala --- @@ -144,4 +150,116 @@ object KafkaUtils { createStre

[GitHub] spark pull request: [SPARK-5253] [ML] LinearRegression with L1/L2 ...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4259#issuecomment-71967929 [Test build #26291 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26291/consoleFull) for PR 4259 at commit [`5b75cda`](https://githu

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-28 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23746235 --- Diff: external/kafka/src/main/scala/org/apache/spark/rdd/kafka/OffsetRange.scala --- @@ -0,0 +1,70 @@ +/* + * Licensed to the Apache Software Fo

[GitHub] spark pull request: [SPARK-5262] [SPARK-5244] [SQL] add coalesce i...

2015-01-28 Thread adrian-wang
Github user adrian-wang commented on the pull request: https://github.com/apache/spark/pull/4057#issuecomment-71967465 @yhuai Thanks for your comments! I'll modify this PR accordingly. --- If your project is set up for it, you can reply to this email and have your reply appear on GitH

[GitHub] spark pull request: [SPARK-5278][SQL] complete the check of ambigu...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4068#issuecomment-71967503 [Test build #26290 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26290/consoleFull) for PR 4068 at commit [`d9cf8fd`](https://githu

[GitHub] spark pull request: [SPARK-3872][streaming], Rewrite the test for ...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4248#issuecomment-71966791 [Test build #26289 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26289/consoleFull) for PR 4248 at commit [`4aedc06`](https://githu

[GitHub] spark pull request: [SPARK-3872][streaming], Rewrite the test for ...

2015-01-28 Thread ScrapCodes
Github user ScrapCodes commented on the pull request: https://github.com/apache/spark/pull/4248#issuecomment-7199 I was confused here whether to use manual clock or system clock ? Since system clock made the test considerably faster. P.S. Test failures seems to be unrelated(

[GitHub] spark pull request: [SPARK-3872][streaming], Rewrite the test for ...

2015-01-28 Thread ScrapCodes
Github user ScrapCodes commented on the pull request: https://github.com/apache/spark/pull/4248#issuecomment-71966684 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-5472][SQL] A JDBC driver for Spark SQL.

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4261#issuecomment-71966019 [Test build #26288 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26288/consoleFull) for PR 4261 at commit [`41647ef`](https://githu

[GitHub] spark pull request: [SQL] Various DataFrame DSL update.

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4260#issuecomment-71965288 [Test build #26287 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26287/consoleFull) for PR 4260 at commit [`d31fcd2`](https://githu

[GitHub] spark pull request: [SPARK-4259][MLlib]: Add Power Iteration Clust...

2015-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4254#issuecomment-71965185 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SPARK-4259][MLlib]: Add Power Iteration Clust...

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4254#issuecomment-71965181 [Test build #26282 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26282/consoleFull) for PR 4254 at commit [`c12dfc8`](https://gith

[GitHub] spark pull request: [SPARK-5470][Core]use defaultClassLoader to lo...

2015-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4258#issuecomment-71964178 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: [SQL] Various DataFrame DSL update.

2015-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4260#issuecomment-71963928 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26

[GitHub] spark pull request: A JDBC driver for Spark SQL.

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4261#issuecomment-71964600 [Test build #26286 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26286/consoleFull) for PR 4261 at commit [`a09eeac`](https://githu

[GitHub] spark pull request: A JDBC driver for Spark SQL.

2015-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4261#issuecomment-71964607 [Test build #26286 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26286/consoleFull) for PR 4261 at commit [`a09eeac`](https://gith

  1   2   3   4   5   6   7   8   >