[GitHub] [spark] wackxu commented on issue #27029: [SPARK-30371][K8S] Add spark.kubernetes.driver.master conf

2020-01-19 Thread GitBox
wackxu commented on issue #27029: [SPARK-30371][K8S] Add spark.kubernetes.driver.master conf URL: https://github.com/apache/spark/pull/27029#issuecomment-576070533 @dongjoon-hyun @liyinan926 Thank you for your patient response and detailed review. -

[GitHub] [spark] HyukjinKwon closed pull request #27275: [SPARK-30566][BUILD] Iterator doesn't refer outer identifier named "iterator" properly in Scala 2.13

2020-01-19 Thread GitBox
HyukjinKwon closed pull request #27275: [SPARK-30566][BUILD] Iterator doesn't refer outer identifier named "iterator" properly in Scala 2.13 URL: https://github.com/apache/spark/pull/27275 This is an automated message from t

[GitHub] [spark] HyukjinKwon commented on issue #27275: [SPARK-30566][BUILD] Iterator doesn't refer outer identifier named "iterator" properly in Scala 2.13

2020-01-19 Thread GitBox
HyukjinKwon commented on issue #27275: [SPARK-30566][BUILD] Iterator doesn't refer outer identifier named "iterator" properly in Scala 2.13 URL: https://github.com/apache/spark/pull/27275#issuecomment-576070456 Merged to master. -

[GitHub] [spark] HeartSaVioR commented on a change in pull request #26162: [SPARK-29438][SS] Use partition ID of StateStoreAwareZipPartitionsRDD for determining partition ID of state store in stream-s

2020-01-19 Thread GitBox
HeartSaVioR commented on a change in pull request #26162: [SPARK-29438][SS] Use partition ID of StateStoreAwareZipPartitionsRDD for determining partition ID of state store in stream-stream join URL: https://github.com/apache/spark/pull/26162#discussion_r368340462 ## File path: sql

[GitHub] [spark] zsxwing commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2020-01-19 Thread GitBox
zsxwing commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#discussion_r367979192 ## File path: sql/core/src/main/scala/org/apache/spark/sql/streaming/ui/StreamingQueryStatusListener.scala

[GitHub] [spark] zsxwing commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2020-01-19 Thread GitBox
zsxwing commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#discussion_r367667827 ## File path: sql/core/src/main/scala/org/apache/spark/sql/streaming/ui/StreamingQueryStatisticsPage.scala

[GitHub] [spark] zsxwing commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2020-01-19 Thread GitBox
zsxwing commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#discussion_r367971958 ## File path: sql/core/src/main/scala/org/apache/spark/sql/internal/SharedState.scala ## @@ -138,

[GitHub] [spark] dilipbiswal opened a new pull request #27282: [SPARK-30573][DOC] Document WHERE Clause of SELECT statement in SQL Reference

2020-01-19 Thread GitBox
dilipbiswal opened a new pull request #27282: [SPARK-30573][DOC] Document WHERE Clause of SELECT statement in SQL Reference URL: https://github.com/apache/spark/pull/27282 ### What changes were proposed in this pull request? Document SELECT statement in SQL Reference Guide. In this PR in

[GitHub] [spark] zsxwing commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2020-01-19 Thread GitBox
zsxwing commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#discussion_r367668002 ## File path: sql/core/src/main/scala/org/apache/spark/sql/streaming/ui/StreamingQueryPage.scala #

[GitHub] [spark] zsxwing commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2020-01-19 Thread GitBox
zsxwing commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#discussion_r367972764 ## File path: sql/core/src/main/scala/org/apache/spark/sql/streaming/ui/StreamingQueryTab.scala ##

[GitHub] [spark] zsxwing commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2020-01-19 Thread GitBox
zsxwing commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#discussion_r368339219 ## File path: sql/core/src/main/scala/org/apache/spark/sql/streaming/StreamingQueryListener.scala

[GitHub] [spark] zsxwing commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2020-01-19 Thread GitBox
zsxwing commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#discussion_r367972600 ## File path: sql/core/src/main/scala/org/apache/spark/sql/streaming/ui/StreamingQueryStatusListener.scala

[GitHub] [spark] zsxwing commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2020-01-19 Thread GitBox
zsxwing commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#discussion_r367972801 ## File path: sql/core/src/main/scala/org/apache/spark/sql/streaming/ui/StreamingQueryTab.scala ##

[GitHub] [spark] tdas commented on issue #26162: [SPARK-29438][SS] Use partition ID of StateStoreAwareZipPartitionsRDD for determining partition ID of state store in stream-stream join

2020-01-19 Thread GitBox
tdas commented on issue #26162: [SPARK-29438][SS] Use partition ID of StateStoreAwareZipPartitionsRDD for determining partition ID of state store in stream-stream join URL: https://github.com/apache/spark/pull/26162#issuecomment-576069468 @HeartSaVioR @uncleGen This is a good PR. Thank you

[GitHub] [spark] tdas commented on a change in pull request #26162: [SPARK-29438][SS] Use partition ID of StateStoreAwareZipPartitionsRDD for determining partition ID of state store in stream-stream j

2020-01-19 Thread GitBox
tdas commented on a change in pull request #26162: [SPARK-29438][SS] Use partition ID of StateStoreAwareZipPartitionsRDD for determining partition ID of state store in stream-stream join URL: https://github.com/apache/spark/pull/26162#discussion_r368339416 ## File path: sql/core/s

[GitHub] [spark] tdas commented on a change in pull request #26162: [SPARK-29438][SS] Use partition ID of StateStoreAwareZipPartitionsRDD for determining partition ID of state store in stream-stream j

2020-01-19 Thread GitBox
tdas commented on a change in pull request #26162: [SPARK-29438][SS] Use partition ID of StateStoreAwareZipPartitionsRDD for determining partition ID of state store in stream-stream join URL: https://github.com/apache/spark/pull/26162#discussion_r368339416 ## File path: sql/core/s

[GitHub] [spark] AmplabJenkins removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576068503 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins removed a comment on issue #27278: [SPARK-30569][SQL][PYSPARK][SPARKR] Add percentile_approx DSL functions.

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27278: [SPARK-30569][SQL][PYSPARK][SPARKR] Add percentile_approx DSL functions. URL: https://github.com/apache/spark/pull/27278#issuecomment-576068392 Test FAILed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] [spark] AmplabJenkins commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
AmplabJenkins commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576068499 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] SparkQA removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
SparkQA removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576064204 **[Test build #117036 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117036/te

[GitHub] [spark] AmplabJenkins removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576068499 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
AmplabJenkins commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576068503 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins commented on issue #27278: [SPARK-30569][SQL][PYSPARK][SPARKR] Add percentile_approx DSL functions.

2020-01-19 Thread GitBox
AmplabJenkins commented on issue #27278: [SPARK-30569][SQL][PYSPARK][SPARKR] Add percentile_approx DSL functions. URL: https://github.com/apache/spark/pull/27278#issuecomment-576068387 Merged build finished. Test FAILed. This

[GitHub] [spark] tdas commented on a change in pull request #26162: [SPARK-29438][SS] Use partition ID of StateStoreAwareZipPartitionsRDD for determining partition ID of state store in stream-stream j

2020-01-19 Thread GitBox
tdas commented on a change in pull request #26162: [SPARK-29438][SS] Use partition ID of StateStoreAwareZipPartitionsRDD for determining partition ID of state store in stream-stream join URL: https://github.com/apache/spark/pull/26162#discussion_r368338952 ## File path: sql/core/s

[GitHub] [spark] AmplabJenkins removed a comment on issue #27278: [SPARK-30569][SQL][PYSPARK][SPARKR] Add percentile_approx DSL functions.

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27278: [SPARK-30569][SQL][PYSPARK][SPARKR] Add percentile_approx DSL functions. URL: https://github.com/apache/spark/pull/27278#issuecomment-576068387 Merged build finished. Test FAILed. -

[GitHub] [spark] AmplabJenkins commented on issue #27278: [SPARK-30569][SQL][PYSPARK][SPARKR] Add percentile_approx DSL functions.

2020-01-19 Thread GitBox
AmplabJenkins commented on issue #27278: [SPARK-30569][SQL][PYSPARK][SPARKR] Add percentile_approx DSL functions. URL: https://github.com/apache/spark/pull/27278#issuecomment-576068392 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] SparkQA commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
SparkQA commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576068450 **[Test build #117036 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117036/testRepor

[GitHub] [spark] AmplabJenkins removed a comment on issue #27088: [SPARK-30413][SQL] Avoid WrappedArray roundtrip in GenericArrayData constructor, plus related optimization in ParquetMapConverter

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27088: [SPARK-30413][SQL] Avoid WrappedArray roundtrip in GenericArrayData constructor, plus related optimization in ParquetMapConverter URL: https://github.com/apache/spark/pull/27088#issuecomment-576068243 Test PASSed. Refer to this link for b

[GitHub] [spark] AmplabJenkins removed a comment on issue #27088: [SPARK-30413][SQL] Avoid WrappedArray roundtrip in GenericArrayData constructor, plus related optimization in ParquetMapConverter

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27088: [SPARK-30413][SQL] Avoid WrappedArray roundtrip in GenericArrayData constructor, plus related optimization in ParquetMapConverter URL: https://github.com/apache/spark/pull/27088#issuecomment-576068240 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #27088: [SPARK-30413][SQL] Avoid WrappedArray roundtrip in GenericArrayData constructor, plus related optimization in ParquetMapConverter

2020-01-19 Thread GitBox
AmplabJenkins commented on issue #27088: [SPARK-30413][SQL] Avoid WrappedArray roundtrip in GenericArrayData constructor, plus related optimization in ParquetMapConverter URL: https://github.com/apache/spark/pull/27088#issuecomment-576068240 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #27088: [SPARK-30413][SQL] Avoid WrappedArray roundtrip in GenericArrayData constructor, plus related optimization in ParquetMapConverter

2020-01-19 Thread GitBox
AmplabJenkins commented on issue #27088: [SPARK-30413][SQL] Avoid WrappedArray roundtrip in GenericArrayData constructor, plus related optimization in ParquetMapConverter URL: https://github.com/apache/spark/pull/27088#issuecomment-576068243 Test PASSed. Refer to this link for build res

[GitHub] [spark] SparkQA removed a comment on issue #27278: [SPARK-30569][SQL][PYSPARK][SPARKR] Add percentile_approx DSL functions.

2020-01-19 Thread GitBox
SparkQA removed a comment on issue #27278: [SPARK-30569][SQL][PYSPARK][SPARKR] Add percentile_approx DSL functions. URL: https://github.com/apache/spark/pull/27278#issuecomment-576048406 **[Test build #117022 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1

[GitHub] [spark] SparkQA commented on issue #27278: [SPARK-30569][SQL][PYSPARK][SPARKR] Add percentile_approx DSL functions.

2020-01-19 Thread GitBox
SparkQA commented on issue #27278: [SPARK-30569][SQL][PYSPARK][SPARKR] Add percentile_approx DSL functions. URL: https://github.com/apache/spark/pull/27278#issuecomment-576068224 **[Test build #117022 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117022/t

[GitHub] [spark] AmplabJenkins removed a comment on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository URL: https://github.com/apache/spark/pull/27281#issuecomment-576067968 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berke

[GitHub] [spark] SparkQA removed a comment on issue #27088: [SPARK-30413][SQL] Avoid WrappedArray roundtrip in GenericArrayData constructor, plus related optimization in ParquetMapConverter

2020-01-19 Thread GitBox
SparkQA removed a comment on issue #27088: [SPARK-30413][SQL] Avoid WrappedArray roundtrip in GenericArrayData constructor, plus related optimization in ParquetMapConverter URL: https://github.com/apache/spark/pull/27088#issuecomment-576044459 **[Test build #117019 has started](https://am

[GitHub] [spark] AmplabJenkins removed a comment on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository URL: https://github.com/apache/spark/pull/27281#issuecomment-576067967 Merged build finished. Test PASSed. This is an autom

[GitHub] [spark] SparkQA commented on issue #27088: [SPARK-30413][SQL] Avoid WrappedArray roundtrip in GenericArrayData constructor, plus related optimization in ParquetMapConverter

2020-01-19 Thread GitBox
SparkQA commented on issue #27088: [SPARK-30413][SQL] Avoid WrappedArray roundtrip in GenericArrayData constructor, plus related optimization in ParquetMapConverter URL: https://github.com/apache/spark/pull/27088#issuecomment-576067973 **[Test build #117019 has finished](https://amplab.cs

[GitHub] [spark] AmplabJenkins commented on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository

2020-01-19 Thread GitBox
AmplabJenkins commented on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository URL: https://github.com/apache/spark/pull/27281#issuecomment-576067967 Merged build finished. Test PASSed. This is an automated mes

[GitHub] [spark] AmplabJenkins commented on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository

2020-01-19 Thread GitBox
AmplabJenkins commented on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository URL: https://github.com/apache/spark/pull/27281#issuecomment-576067968 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/

[GitHub] [spark] SparkQA commented on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository

2020-01-19 Thread GitBox
SparkQA commented on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository URL: https://github.com/apache/spark/pull/27281#issuecomment-576067733 **[Test build #117039 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117039/testReport)** for PR

[GitHub] [spark] tdas commented on a change in pull request #26162: [SPARK-29438][SS] Use partition ID of StateStoreAwareZipPartitionsRDD for determining partition ID of state store in stream-stream j

2020-01-19 Thread GitBox
tdas commented on a change in pull request #26162: [SPARK-29438][SS] Use partition ID of StateStoreAwareZipPartitionsRDD for determining partition ID of state store in stream-stream join URL: https://github.com/apache/spark/pull/26162#discussion_r368338229 ## File path: sql/core/s

[GitHub] [spark] maropu commented on a change in pull request #27216: [SPARK-28801][DOC] Document SELECT statement in SQL Reference (Main page)

2020-01-19 Thread GitBox
maropu commented on a change in pull request #27216: [SPARK-28801][DOC] Document SELECT statement in SQL Reference (Main page) URL: https://github.com/apache/spark/pull/27216#discussion_r368338264 ## File path: docs/sql-ref-syntax-qry-select.md ## @@ -18,8 +18,119 @@ licen

[GitHub] [spark] srowen commented on a change in pull request #27281: [SPARK-30572][BUILD] Add a fallback Maven repository

2020-01-19 Thread GitBox
srowen commented on a change in pull request #27281: [SPARK-30572][BUILD] Add a fallback Maven repository URL: https://github.com/apache/spark/pull/27281#discussion_r368338260 ## File path: pom.xml ## @@ -257,6 +257,22 @@ false + Review commen

[GitHub] [spark] tdas commented on a change in pull request #26162: [SPARK-29438][SS] Use partition ID of StateStoreAwareZipPartitionsRDD for determining partition ID of state store in stream-stream j

2020-01-19 Thread GitBox
tdas commented on a change in pull request #26162: [SPARK-29438][SS] Use partition ID of StateStoreAwareZipPartitionsRDD for determining partition ID of state store in stream-stream join URL: https://github.com/apache/spark/pull/26162#discussion_r368338271 ## File path: sql/core/s

[GitHub] [spark] dongjoon-hyun commented on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository

2020-01-19 Thread GitBox
dongjoon-hyun commented on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository URL: https://github.com/apache/spark/pull/27281#issuecomment-576067171 Hi, @srowen and @maropu . I added the following comment to the `GitHub Action`. As I wrote in the comment, this aims to fix t

[GitHub] [spark] dongjoon-hyun edited a comment on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository

2020-01-19 Thread GitBox
dongjoon-hyun edited a comment on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository URL: https://github.com/apache/spark/pull/27281#issuecomment-576067171 Hi, @srowen and @maropu . I added the following comment to the `GitHub Action` script. As I wrote in the comment, this

[GitHub] [spark] dongjoon-hyun edited a comment on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository

2020-01-19 Thread GitBox
dongjoon-hyun edited a comment on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository URL: https://github.com/apache/spark/pull/27281#issuecomment-576067171 Hi, @srowen and @maropu . I added the following comment to the `GitHub Action` script. As I wrote in the comment, this

[GitHub] [spark] AmplabJenkins removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576066877 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-19 Thread GitBox
AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-576066905 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-576066901 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576066873 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-576066905 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
AmplabJenkins commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576066877 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] AmplabJenkins commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
AmplabJenkins commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576066873 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-19 Thread GitBox
AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-576066901 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] SparkQA commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
SparkQA commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576066690 **[Test build #117037 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117037/testReport

[GitHub] [spark] SparkQA commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-19 Thread GitBox
SparkQA commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-576066687 **[Test build #117038 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117038/testReport)

[GitHub] [spark] maropu commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-19 Thread GitBox
maropu commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-576066482 retest this please This is an automated message from the

[GitHub] [spark] HeartSaVioR commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
HeartSaVioR commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576066007 retest this, please This is an automated message f

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27281: [SPARK-30572][BUILD] Add a fallback Maven repository

2020-01-19 Thread GitBox
dongjoon-hyun commented on a change in pull request #27281: [SPARK-30572][BUILD] Add a fallback Maven repository URL: https://github.com/apache/spark/pull/27281#discussion_r368337083 ## File path: pom.xml ## @@ -257,6 +257,22 @@ false + Review

[GitHub] [spark] maropu commented on a change in pull request #27281: [SPARK-30572][BUILD] Add a fallback Maven repository

2020-01-19 Thread GitBox
maropu commented on a change in pull request #27281: [SPARK-30572][BUILD] Add a fallback Maven repository URL: https://github.com/apache/spark/pull/27281#discussion_r368337032 ## File path: pom.xml ## @@ -257,6 +257,22 @@ false + + central_w

[GitHub] [spark] maropu commented on issue #27262: [SPARK-30551][SQL] Disable comparison for interval type

2020-01-19 Thread GitBox
maropu commented on issue #27262: [SPARK-30551][SQL] Disable comparison for interval type URL: https://github.com/apache/spark/pull/27262#issuecomment-576065272 Checked; late LGTM. This is an automated message from the Apache

[GitHub] [spark] HyukjinKwon edited a comment on issue #27251: [SPARK-30539][PYTHON][SQL] Add DataFrame.tail in PySpark

2020-01-19 Thread GitBox
HyukjinKwon edited a comment on issue #27251: [SPARK-30539][PYTHON][SQL] Add DataFrame.tail in PySpark URL: https://github.com/apache/spark/pull/27251#issuecomment-576065253 We could have things like `df.limit(n, reverse=True).toPandas()`; however, this implementation was not added yet bec

[GitHub] [spark] HyukjinKwon commented on issue #27251: [SPARK-30539][PYTHON][SQL] Add DataFrame.tail in PySpark

2020-01-19 Thread GitBox
HyukjinKwon commented on issue #27251: [SPARK-30539][PYTHON][SQL] Add DataFrame.tail in PySpark URL: https://github.com/apache/spark/pull/27251#issuecomment-576065253 We could have things like `df.limit(n, reverse=True).toPandas()`; however, this implementation was added yet because we sho

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27281: [SPARK-30572][BUILD] Add a fallback Maven repository

2020-01-19 Thread GitBox
dongjoon-hyun commented on a change in pull request #27281: [SPARK-30572][BUILD] Add a fallback Maven repository URL: https://github.com/apache/spark/pull/27281#discussion_r368336769 ## File path: pom.xml ## @@ -257,6 +257,22 @@ false + + ce

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27281: [SPARK-30572][BUILD] Add a fallback Maven repository

2020-01-19 Thread GitBox
dongjoon-hyun commented on a change in pull request #27281: [SPARK-30572][BUILD] Add a fallback Maven repository URL: https://github.com/apache/spark/pull/27281#discussion_r368336738 ## File path: pom.xml ## @@ -257,6 +257,22 @@ false + Review

[GitHub] [spark] maropu commented on a change in pull request #27281: [SPARK-30572][BUILD] Add a fallback Maven repository

2020-01-19 Thread GitBox
maropu commented on a change in pull request #27281: [SPARK-30572][BUILD] Add a fallback Maven repository URL: https://github.com/apache/spark/pull/27281#discussion_r368336287 ## File path: pom.xml ## @@ -257,6 +257,22 @@ false + + central_w

[GitHub] [spark] AmplabJenkins removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576064321 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] AmplabJenkins removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576064319 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
AmplabJenkins commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576064319 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] AmplabJenkins commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
AmplabJenkins commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576064321 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] SparkQA commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
SparkQA commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576064204 **[Test build #117036 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117036/testReport

[GitHub] [spark] AmplabJenkins removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576063659 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576063661 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] AmplabJenkins commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
AmplabJenkins commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576063661 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] AmplabJenkins commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
AmplabJenkins commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576063659 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] HeartSaVioR commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
HeartSaVioR commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576063615 retest this, please This is an automated message f

[GitHub] [spark] AmplabJenkins removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576063277 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576063275 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
AmplabJenkins commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576063277 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] SparkQA removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
SparkQA removed a comment on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576059991 **[Test build #117034 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117034/te

[GitHub] [spark] AmplabJenkins commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
AmplabJenkins commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576063275 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] SparkQA commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure

2020-01-19 Thread GitBox
SparkQA commented on issue #27259: [DO-NOT-MERGE][WIP] Investigating SPARK-30541 flaky test failure URL: https://github.com/apache/spark/pull/27259#issuecomment-576063248 **[Test build #117034 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117034/testRepor

[GitHub] [spark] github-actions[bot] closed pull request #16415: [SPARK-19063][ML]Speedup and optimize the GradientBoostedTrees

2020-01-19 Thread GitBox
github-actions[bot] closed pull request #16415: [SPARK-19063][ML]Speedup and optimize the GradientBoostedTrees URL: https://github.com/apache/spark/pull/16415 This is an automated message from the Apache Git Service. To resp

[GitHub] [spark] github-actions[bot] commented on issue #25977: [SPARK-29268][SQL]isolationOn value is wrong in case of spark.sql.hive.metastore.jars != builtin

2020-01-19 Thread GitBox
github-actions[bot] commented on issue #25977: [SPARK-29268][SQL]isolationOn value is wrong in case of spark.sql.hive.metastore.jars != builtin URL: https://github.com/apache/spark/pull/25977#issuecomment-576062908 We're closing this PR because it hasn't been updated in a while. This isn't

[GitHub] [spark] github-actions[bot] closed pull request #13379: [SPARK-12431][GraphX] Add local checkpointing to GraphX.

2020-01-19 Thread GitBox
github-actions[bot] closed pull request #13379: [SPARK-12431][GraphX] Add local checkpointing to GraphX. URL: https://github.com/apache/spark/pull/13379 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] github-actions[bot] closed pull request #16476: [SPARK-19084][SQL] Implement expression field

2020-01-19 Thread GitBox
github-actions[bot] closed pull request #16476: [SPARK-19084][SQL] Implement expression field URL: https://github.com/apache/spark/pull/16476 This is an automated message from the Apache Git Service. To respond to the messa

[GitHub] [spark] github-actions[bot] closed pull request #15970: [SPARK-18134][SQL] Comparable MapTypes [POC]

2020-01-19 Thread GitBox
github-actions[bot] closed pull request #15970: [SPARK-18134][SQL] Comparable MapTypes [POC] URL: https://github.com/apache/spark/pull/15970 This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [spark] github-actions[bot] closed pull request #16755: [SPARK-19606][MESOS] Support constraints in spark-dispatcher

2020-01-19 Thread GitBox
github-actions[bot] closed pull request #16755: [SPARK-19606][MESOS] Support constraints in spark-dispatcher URL: https://github.com/apache/spark/pull/16755 This is an automated message from the Apache Git Service. To respon

[GitHub] [spark] AmplabJenkins removed a comment on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository URL: https://github.com/apache/spark/pull/27281#issuecomment-576062787 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berke

[GitHub] [spark] github-actions[bot] commented on issue #13326: [SPARK-15560] [Mesos] Queued/Supervise drivers waiting for retry drivers disappear for kill command in Mesos mode

2020-01-19 Thread GitBox
github-actions[bot] commented on issue #13326: [SPARK-15560] [Mesos] Queued/Supervise drivers waiting for retry drivers disappear for kill command in Mesos mode URL: https://github.com/apache/spark/pull/13326#issuecomment-576062928 We're closing this PR because it hasn't been updated in a

[GitHub] [spark] github-actions[bot] closed pull request #13440: [SPARK-15699] [ML] Implement a Chi-Squared test statistic option for measuring split quality

2020-01-19 Thread GitBox
github-actions[bot] closed pull request #13440: [SPARK-15699] [ML] Implement a Chi-Squared test statistic option for measuring split quality URL: https://github.com/apache/spark/pull/13440 This is an automated message from t

[GitHub] [spark] AmplabJenkins removed a comment on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository URL: https://github.com/apache/spark/pull/27281#issuecomment-576062784 Merged build finished. Test PASSed. This is an autom

[GitHub] [spark] github-actions[bot] closed pull request #13650: [SPARK-9623] [ML] Provide conditional variance for RandomForestRegressor

2020-01-19 Thread GitBox
github-actions[bot] closed pull request #13650: [SPARK-9623] [ML] Provide conditional variance for RandomForestRegressor URL: https://github.com/apache/spark/pull/13650 This is an automated message from the Apache Git Servic

[GitHub] [spark] github-actions[bot] closed pull request #14431: [SPARK-16258][SparkR] Automatically append the grouping keys in SparkR's gapply

2020-01-19 Thread GitBox
github-actions[bot] closed pull request #14431: [SPARK-16258][SparkR] Automatically append the grouping keys in SparkR's gapply URL: https://github.com/apache/spark/pull/14431 This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository

2020-01-19 Thread GitBox
AmplabJenkins commented on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository URL: https://github.com/apache/spark/pull/27281#issuecomment-576062784 Merged build finished. Test PASSed. This is an automated mes

[GitHub] [spark] AmplabJenkins commented on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository

2020-01-19 Thread GitBox
AmplabJenkins commented on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository URL: https://github.com/apache/spark/pull/27281#issuecomment-576062787 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/

[GitHub] [spark] SparkQA commented on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository

2020-01-19 Thread GitBox
SparkQA commented on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository URL: https://github.com/apache/spark/pull/27281#issuecomment-576062635 **[Test build #117035 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117035/testReport)** for PR

[GitHub] [spark] AmplabJenkins removed a comment on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository URL: https://github.com/apache/spark/pull/27281#issuecomment-576062524 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkel

[GitHub] [spark] AmplabJenkins removed a comment on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository

2020-01-19 Thread GitBox
AmplabJenkins removed a comment on issue #27281: [SPARK-30572][BUILD] Add a fallback Maven repository URL: https://github.com/apache/spark/pull/27281#issuecomment-576062519 Merged build finished. Test PASSed. This is an autom

<    3   4   5   6   7   8   9   10   11   12   >