[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/21623 thanks, merging to master! @dongjoon-hyun is there something similar in ORC? --- - To unsubscribe, e-mail:

[GitHub] spark issue #21675: [SPARK-24698][PYTHON]: Fixed typo in pyspark.ml's Identi...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21675 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92495/ Test PASSed. ---

[GitHub] spark issue #21675: [SPARK-24698][PYTHON]: Fixed typo in pyspark.ml's Identi...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21675 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21675: [SPARK-24698][PYTHON]: Fixed typo in pyspark.ml's Identi...

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21675 **[Test build #92495 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92495/testReport)** for PR 21675 at commit

[GitHub] spark issue #21675: [SPARK-24698][PYTHON]: Fixed typo in pyspark.ml's Identi...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21675 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92494/ Test PASSed. ---

[GitHub] spark issue #21675: [SPARK-24698][PYTHON]: Fixed typo in pyspark.ml's Identi...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21675 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21675: [SPARK-24698][PYTHON]: Fixed typo in pyspark.ml's Identi...

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21675 **[Test build #92494 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92494/testReport)** for PR 21675 at commit

[GitHub] spark issue #21675: [SPARK-24698][PYTHON]: Fixed typo in pyspark.ml's Identi...

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21675 **[Test build #92495 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92495/testReport)** for PR 21675 at commit

[GitHub] spark issue #21669: [SPARK-23257][K8S][WIP] Kerberos Support for Spark on K8...

2018-06-29 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/21669 btw, have you sent out this + doc to d...@spark.apache.org? --- - To unsubscribe, e-mail:

[GitHub] spark issue #21675: [SPARK-24698][PYTHON]: Fixed typo in pyspark.ml's Identi...

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21675 **[Test build #92494 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92494/testReport)** for PR 21675 at commit

[GitHub] spark issue #21675: [SPARK-24698][PYTHON]: Fixed typo in pyspark.ml's Identi...

2018-06-29 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/21675 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #21666: [SPARK-24535][SPARKR] fix tests on java check err...

2018-06-29 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/21666#discussion_r199313370 --- Diff: R/pkg/R/client.R --- @@ -61,6 +61,11 @@ generateSparkSubmitArgs <- function(args, sparkHome, jars, sparkSubmitOpts, pack }

[GitHub] spark pull request #21649: [SPARK-23648][R][SQL]Adds more types for hint in ...

2018-06-29 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/21649#discussion_r199313334 --- Diff: R/pkg/R/DataFrame.R --- @@ -3905,6 +3905,18 @@ setMethod("rollup", groupedData(sgd) })

[GitHub] spark issue #21221: [SPARK-23429][CORE] Add executor memory metrics to heart...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21221 Build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #21221: [SPARK-23429][CORE] Add executor memory metrics to heart...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21221 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92490/ Test PASSed. ---

[GitHub] spark issue #21221: [SPARK-23429][CORE] Add executor memory metrics to heart...

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21221 **[Test build #92490 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92490/testReport)** for PR 21221 at commit

[GitHub] spark issue #21677: [SPARK-24692][TESTS] Improvement FilterPushdownBenchmark

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21677 **[Test build #92493 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92493/testReport)** for PR 21677 at commit

[GitHub] spark issue #21677: [SPARK-24692][TESTS] Improvement FilterPushdownBenchmark

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21677 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/597/

[GitHub] spark issue #21677: [SPARK-24692][TESTS] Improvement FilterPushdownBenchmark

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21677 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21677: [SPARK-24692][TESTS] Improvement FilterPushdownBenchmark

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21677 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21677: [SPARK-24692][TESTS] Improvement FilterPushdownBenchmark

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21677 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92491/ Test PASSed. ---

[GitHub] spark issue #21677: [SPARK-24692][TESTS] Improvement FilterPushdownBenchmark

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21677 **[Test build #92491 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92491/testReport)** for PR 21677 at commit

[GitHub] spark issue #21603: [SPARK-17091][SQL] Add rule to convert IN predicate to e...

2018-06-29 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/21603 Benchmark result: ``` ##[ Pushdown benchmark for InSet -> InFilters ]## Java HotSpot(TM) 64-Bit Server VM 1.8.0_151-b12 on Mac OS X

[GitHub] spark issue #21678: [SPARK-23461][R]vignettes should include model predictio...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21678 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21678: [SPARK-23461][R]vignettes should include model predictio...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21678 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92492/ Test PASSed. ---

[GitHub] spark issue #21678: [SPARK-23461][R]vignettes should include model predictio...

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21678 **[Test build #92492 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92492/testReport)** for PR 21678 at commit

[GitHub] spark issue #21678: [SPARK-23461][R]vignettes should include model predictio...

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21678 **[Test build #92492 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92492/testReport)** for PR 21678 at commit

[GitHub] spark issue #21678: [SPARK-23461][R]vignettes should include model predictio...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21678 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21678: [SPARK-23461][R]vignettes should include model predictio...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21678 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/596/

[GitHub] spark pull request #21678: [SPARK-23461][R]vignettes should include model pr...

2018-06-29 Thread huaxingao
GitHub user huaxingao opened a pull request: https://github.com/apache/spark/pull/21678 [SPARK-23461][R]vignettes should include model predictions for some ML models ## What changes were proposed in this pull request? Add model predictions for Linear Support Vector Machine

[GitHub] spark pull request #21674: [SPARK-24696][SQL] ColumnPruning rule fails to re...

2018-06-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21674#discussion_r199310542 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/dsl/package.scala --- @@ -149,6 +149,7 @@ package object dsl { } }

[GitHub] spark pull request #21674: [SPARK-24696][SQL] ColumnPruning rule fails to re...

2018-06-29 Thread maryannxue
Github user maryannxue commented on a diff in the pull request: https://github.com/apache/spark/pull/21674#discussion_r199310515 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/dsl/package.scala --- @@ -149,6 +149,7 @@ package object dsl { }

[GitHub] spark issue #21546: [WIP][SPARK-23030][SQL][PYTHON] Use Arrow stream format ...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21546 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21546: [WIP][SPARK-23030][SQL][PYTHON] Use Arrow stream format ...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21546 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92487/ Test PASSed. ---

[GitHub] spark issue #21546: [WIP][SPARK-23030][SQL][PYTHON] Use Arrow stream format ...

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21546 **[Test build #92487 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92487/testReport)** for PR 21546 at commit

[GitHub] spark pull request #21674: [SPARK-24696][SQL] ColumnPruning rule fails to re...

2018-06-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21674#discussion_r199309806 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala --- @@ -2792,4 +2792,25 @@ class SQLQuerySuite extends QueryTest with

[GitHub] spark pull request #21674: [SPARK-24696][SQL] ColumnPruning rule fails to re...

2018-06-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21674#discussion_r199309687 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/dsl/package.scala --- @@ -149,6 +149,7 @@ package object dsl { } }

[GitHub] spark issue #21674: [SPARK-24696][SQL] ColumnPruning rule fails to remove ex...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21674 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92486/ Test PASSed. ---

[GitHub] spark issue #21674: [SPARK-24696][SQL] ColumnPruning rule fails to remove ex...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21674 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21674: [SPARK-24696][SQL] ColumnPruning rule fails to remove ex...

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21674 **[Test build #92486 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92486/testReport)** for PR 21674 at commit

[GitHub] spark issue #21674: [SPARK-24696][SQL] ColumnPruning rule fails to remove ex...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21674 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92485/ Test PASSed. ---

[GitHub] spark issue #21674: [SPARK-24696][SQL] ColumnPruning rule fails to remove ex...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21674 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21674: [SPARK-24696][SQL] ColumnPruning rule fails to remove ex...

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21674 **[Test build #92485 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92485/testReport)** for PR 21674 at commit

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/21623 Benchmark result: ``` ###[ Pushdown benchmark for StringStartsWith ]### Java HotSpot(TM) 64-Bit Server VM 1.8.0_151-b12 on Mac OS X

[GitHub] spark issue #21673: SPARK-24697: Fix the reported start offsets in streaming...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21673 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92484/ Test PASSed. ---

[GitHub] spark issue #21673: SPARK-24697: Fix the reported start offsets in streaming...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21673 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21673: SPARK-24697: Fix the reported start offsets in streaming...

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21673 **[Test build #92484 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92484/testReport)** for PR 21673 at commit

[GitHub] spark pull request #21462: [SPARK-24428][K8S] Fix unused code

2018-06-29 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/21462#discussion_r199307562 --- Diff: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterManager.scala --- @@ -46,8 +46,6 @@

[GitHub] spark issue #21677: [SPARK-24692][TESTS] Improvement FilterPushdownBenchmark

2018-06-29 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/21677 cc @maropu --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21556: [SPARK-24549][SQL] Support Decimal type push down to the...

2018-06-29 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/21556 Benchmark results: ``` ###[ Pushdown benchmark for Decimal ] Java HotSpot(TM) 64-Bit Server VM 1.8.0_151-b12 on Mac OS X

[GitHub] spark issue #21677: [SPARK-24692][TESTS] Improvement FilterPushdownBenchmark

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21677 **[Test build #92491 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92491/testReport)** for PR 21677 at commit

[GitHub] spark issue #21677: [SPARK-24692][TESTS] Improvement FilterPushdownBenchmark

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21677 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21677: [SPARK-24692][TESTS] Improvement FilterPushdownBenchmark

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21677 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/595/

[GitHub] spark pull request #21677: [SPARK-24692][TESTS] Improvement FilterPushdownBe...

2018-06-29 Thread wangyum
GitHub user wangyum opened a pull request: https://github.com/apache/spark/pull/21677 [SPARK-24692][TESTS] Improvement FilterPushdownBenchmark ## What changes were proposed in this pull request? 1. Write the result to `benchmarks/FilterPushdownBenchmark-results.txt` for

[GitHub] spark issue #21221: [SPARK-23429][CORE] Add executor memory metrics to heart...

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21221 **[Test build #92490 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92490/testReport)** for PR 21221 at commit

[GitHub] spark issue #21676: [SPARK-24699][SS][WIP] Watermark / Append mode should wo...

2018-06-29 Thread c-horn
Github user c-horn commented on the issue: https://github.com/apache/spark/pull/21676 @tdas @marmbrus --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21672: [SPARK-24694][K8S] Pass all app args to integration test...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21672 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21672: [SPARK-24694][K8S] Pass all app args to integration test...

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21672 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/594/ ---

[GitHub] spark issue #21672: [SPARK-24694][K8S] Pass all app args to integration test...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21672 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/594/

[GitHub] spark issue #21672: [SPARK-24694][K8S] Pass all app args to integration test...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21672 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92489/ Test PASSed. ---

[GitHub] spark issue #21672: [SPARK-24694][K8S] Pass all app args to integration test...

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21672 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/594/ ---

[GitHub] spark issue #21672: [SPARK-24694][K8S] Pass all app args to integration test...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21672 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21672: [SPARK-24694][K8S] Pass all app args to integration test...

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21672 **[Test build #92489 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92489/testReport)** for PR 21672 at commit

[GitHub] spark issue #21672: [SPARK-24694][K8S] Pass all app args to integration test...

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21672 **[Test build #92489 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92489/testReport)** for PR 21672 at commit

[GitHub] spark issue #21672: [SPARK-24694][K8S] Pass all app args to integration test...

2018-06-29 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/21672 @vanzin @ssuchter removed the condition, I think its ok now. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

[GitHub] spark issue #21674: [SPARK-24696][SQL] ColumnPruning rule fails to remove ex...

2018-06-29 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/21674 LGTM, too. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #21662: [SPARK-24662][SQL][SS] Support limit in structure...

2018-06-29 Thread mukulmurthy
Github user mukulmurthy commented on a diff in the pull request: https://github.com/apache/spark/pull/21662#discussion_r199300670 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/MemorySinkSuite.scala --- @@ -70,35 +68,9 @@ class MemorySinkSuite extends

[GitHub] spark issue #21676: [SPARK-24699][SQL][WIP] Watermark / Append mode should w...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21676 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21676: [SPARK-24699][SQL][WIP] Watermark / Append mode should w...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21676 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21676: [SPARK-24699][SQL][WIP] Watermark / Append mode should w...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21676 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21676: [SPARK-24699][SQL][WIP] Watermark / Append mode s...

2018-06-29 Thread c-horn
GitHub user c-horn opened a pull request: https://github.com/apache/spark/pull/21676 [SPARK-24699][SQL][WIP] Watermark / Append mode should work with Trigger.Once ## What changes were proposed in this pull request? https://issues.apache.org/jira/browse/SPARK-24699

[GitHub] spark pull request #21672: [SPARK-24694][K8S] Pass all app args to integrati...

2018-06-29 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/21672#discussion_r199297784 --- Diff: resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/KubernetesTestComponents.scala --- @@

[GitHub] spark pull request #21672: [SPARK-24694][K8S] Pass all app args to integrati...

2018-06-29 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/21672#discussion_r199297547 --- Diff: resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/KubernetesTestComponents.scala --- @@

[GitHub] spark issue #21221: [SPARK-23429][CORE] Add executor memory metrics to heart...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21221 Build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #21221: [SPARK-23429][CORE] Add executor memory metrics to heart...

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21221 **[Test build #92488 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92488/testReport)** for PR 21221 at commit

[GitHub] spark issue #21221: [SPARK-23429][CORE] Add executor memory metrics to heart...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21221 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92488/ Test FAILed. ---

[GitHub] spark issue #21672: [SPARK-24694][K8S] Pass all app args to integration test...

2018-06-29 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/21672 @ssuchter yes if you check the jira, the old behavior does not work with more than one args. In the future might be a problem. ---

[GitHub] spark issue #21221: [SPARK-23429][CORE] Add executor memory metrics to heart...

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21221 **[Test build #92488 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92488/testReport)** for PR 21221 at commit

[GitHub] spark issue #21672: [SPARK-24694][K8S] Pass all app args to integration test...

2018-06-29 Thread ssuchter
Github user ssuchter commented on the issue: https://github.com/apache/spark/pull/21672 BTW, for committers - I think this patch is good to merge. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

[GitHub] spark issue #21672: [SPARK-24694][K8S] Pass all app args to integration test...

2018-06-29 Thread ssuchter
Github user ssuchter commented on the issue: https://github.com/apache/spark/pull/21672 I see why the old behavior was there. I made a minimal change to some existing code to fix a bug: https://github.com/ssuchter/spark/commit/1d8a265d13b65dcec8db11a5be09d4a029037d2c

[GitHub] spark issue #21675: [SPARK-24698][PYTHON]: Fixed typo in pyspark.ml's Identi...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21675 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21675: [SPARK-24698][PYTHON]: Fixed typo in pyspark.ml's Identi...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21675 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21675: [SPARK-24698][PYTHON]: Fixed typo in pyspark.ml's Identi...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21675 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21675: [SPARK-24698][PYTHON]: Fixed typo in pyspark.ml's...

2018-06-29 Thread mcteo
GitHub user mcteo opened a pull request: https://github.com/apache/spark/pull/21675 [SPARK-24698][PYTHON]: Fixed typo in pyspark.ml's Identifiable class. ## What changes were proposed in this pull request? Fixed a small typo in the code that caused 20 random characters to

[GitHub] spark pull request #21440: [SPARK-24307][CORE] Support reading remote cached...

2018-06-29 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/21440#discussion_r199291252 --- Diff: core/src/main/scala/org/apache/spark/util/io/ChunkedByteBufferFileRegion.scala --- @@ -0,0 +1,86 @@ +/* + * Licensed to the Apache

[GitHub] spark issue #21672: [SPARK-24694][K8S] Pass all app args to integration test...

2018-06-29 Thread ssuchter
Github user ssuchter commented on the issue: https://github.com/apache/spark/pull/21672 So this changes behavior, I think. In the old behavior, if the args were ['a', 'b'] then you'd get a single arg of ['a b'] passed through, and with this you'd get ['a', 'b']. This new

[GitHub] spark pull request #21662: [SPARK-24662][SQL][SS] Support limit in structure...

2018-06-29 Thread jose-torres
Github user jose-torres commented on a diff in the pull request: https://github.com/apache/spark/pull/21662#discussion_r199288285 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamingLimitExec.scala --- @@ -0,0 +1,96 @@ +/* + * Licensed to

[GitHub] spark issue #21674: [SPARK-24696][SQL] ColumnPruning rule fails to remove ex...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21674 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21546: [WIP][SPARK-23030][SQL][PYTHON] Use Arrow stream format ...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21546 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21546: [WIP][SPARK-23030][SQL][PYTHON] Use Arrow stream format ...

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21546 **[Test build #92487 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92487/testReport)** for PR 21546 at commit

[GitHub] spark issue #21674: [SPARK-24696][SQL] ColumnPruning rule fails to remove ex...

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21674 **[Test build #92486 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92486/testReport)** for PR 21674 at commit

[GitHub] spark issue #21674: [SPARK-24696][SQL] ColumnPruning rule fails to remove ex...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21674 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/592/

[GitHub] spark issue #21546: [WIP][SPARK-23030][SQL][PYTHON] Use Arrow stream format ...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21546 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/593/

[GitHub] spark pull request #21546: [WIP][SPARK-23030][SQL][PYTHON] Use Arrow stream ...

2018-06-29 Thread BryanCutler
Github user BryanCutler commented on a diff in the pull request: https://github.com/apache/spark/pull/21546#discussion_r199287248 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -3236,13 +3237,50 @@ class Dataset[T] private[sql]( }

[GitHub] spark pull request #21662: [SPARK-24662][SQL][SS] Support limit in structure...

2018-06-29 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/21662#discussion_r199286570 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamingLimitExec.scala --- @@ -0,0 +1,96 @@ +/* + * Licensed to the

[GitHub] spark pull request #21662: [SPARK-24662][SQL][SS] Support limit in structure...

2018-06-29 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/21662#discussion_r199286349 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamingLimitExec.scala --- @@ -0,0 +1,96 @@ +/* + * Licensed to the

[GitHub] spark issue #21674: [SPARK-24696][SQL] ColumnPruning rule fails to remove ex...

2018-06-29 Thread maryannxue
Github user maryannxue commented on the issue: https://github.com/apache/spark/pull/21674 cc @gatorsmile --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21674: [SPARK-24696][SQL] ColumnPruning rule fails to remove ex...

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21674 **[Test build #92485 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92485/testReport)** for PR 21674 at commit

[GitHub] spark issue #21674: [SPARK-24696][SQL] ColumnPruning rule fails to remove ex...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21674 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/591/

[GitHub] spark issue #21674: [SPARK-24696][SQL] ColumnPruning rule fails to remove ex...

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21674 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

  1   2   3   4   >