[GitHub] [spark] AmplabJenkins removed a comment on issue #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalIterator

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalIterator URL: https://github.com/apache/spark/pull/25515#issuecomment-523286205 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalIterator

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalIterator URL: https://github.com/apache/spark/pull/25515#issuecomment-523286205 Merged build finished. Test PASSed. This i

[GitHub] [spark] AmplabJenkins commented on issue #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalIterator

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalIterator URL: https://github.com/apache/spark/pull/25515#issuecomment-523286206 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] WeichenXu123 commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

2019-08-20 Thread GitBox
WeichenXu123 commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523286194 Jenkins retest this please. This is an a

[GitHub] [spark] SparkQA commented on issue #25430: [SPARK-28540][WEBUI] Document Environment page

2019-08-20 Thread GitBox
SparkQA commented on issue #25430: [SPARK-28540][WEBUI] Document Environment page URL: https://github.com/apache/spark/pull/25430#issuecomment-523286026 **[Test build #109459 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109459/testReport)** for PR 25430

[GitHub] [spark] SparkQA removed a comment on issue #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalIterator

2019-08-20 Thread GitBox
SparkQA removed a comment on issue #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalIterator URL: https://github.com/apache/spark/pull/25515#issuecomment-523252585 **[Test build #109448 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109

[GitHub] [spark] SparkQA commented on issue #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalIterator

2019-08-20 Thread GitBox
SparkQA commented on issue #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalIterator URL: https://github.com/apache/spark/pull/25515#issuecomment-523285855 **[Test build #109448 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109448/tes

[GitHub] [spark] AmplabJenkins removed a comment on issue #25430: [SPARK-28540][WEBUI] Document Environment page

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25430: [SPARK-28540][WEBUI] Document Environment page URL: https://github.com/apache/spark/pull/25430#issuecomment-523285672 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.ed

[GitHub] [spark] AmplabJenkins removed a comment on issue #25430: [SPARK-28540][WEBUI] Document Environment page

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25430: [SPARK-28540][WEBUI] Document Environment page URL: https://github.com/apache/spark/pull/25430#issuecomment-523285669 Merged build finished. Test PASSed. This is an automated m

[GitHub] [spark] AmplabJenkins commented on issue #25516: [SPARK-26895][CORE][branch-2.4] prepareSubmitEnvironment should be called within doAs for proxy users

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25516: [SPARK-26895][CORE][branch-2.4] prepareSubmitEnvironment should be called within doAs for proxy users URL: https://github.com/apache/spark/pull/25516#issuecomment-523285595 Test PASSed. Refer to this link for build results (access rights to CI ser

[GitHub] [spark] AmplabJenkins commented on issue #25430: [SPARK-28540][WEBUI] Document Environment page

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25430: [SPARK-28540][WEBUI] Document Environment page URL: https://github.com/apache/spark/pull/25430#issuecomment-523285672 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkin

[GitHub] [spark] AmplabJenkins commented on issue #25430: [SPARK-28540][WEBUI] Document Environment page

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25430: [SPARK-28540][WEBUI] Document Environment page URL: https://github.com/apache/spark/pull/25430#issuecomment-523285669 Merged build finished. Test PASSed. This is an automated message f

[GitHub] [spark] AmplabJenkins removed a comment on issue #25516: [SPARK-26895][CORE][branch-2.4] prepareSubmitEnvironment should be called within doAs for proxy users

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25516: [SPARK-26895][CORE][branch-2.4] prepareSubmitEnvironment should be called within doAs for proxy users URL: https://github.com/apache/spark/pull/25516#issuecomment-523285588 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25516: [SPARK-26895][CORE][branch-2.4] prepareSubmitEnvironment should be called within doAs for proxy users

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25516: [SPARK-26895][CORE][branch-2.4] prepareSubmitEnvironment should be called within doAs for proxy users URL: https://github.com/apache/spark/pull/25516#issuecomment-523285595 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins commented on issue #25516: [SPARK-26895][CORE][branch-2.4] prepareSubmitEnvironment should be called within doAs for proxy users

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25516: [SPARK-26895][CORE][branch-2.4] prepareSubmitEnvironment should be called within doAs for proxy users URL: https://github.com/apache/spark/pull/25516#issuecomment-523285588 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #25516: [SPARK-26895][CORE][branch-2.4] prepareSubmitEnvironment should be called within doAs for proxy users

2019-08-20 Thread GitBox
SparkQA removed a comment on issue #25516: [SPARK-26895][CORE][branch-2.4] prepareSubmitEnvironment should be called within doAs for proxy users URL: https://github.com/apache/spark/pull/25516#issuecomment-523224772 **[Test build #109441 has started](https://amplab.cs.berkeley.edu/jenkins/

[GitHub] [spark] SparkQA commented on issue #25516: [SPARK-26895][CORE][branch-2.4] prepareSubmitEnvironment should be called within doAs for proxy users

2019-08-20 Thread GitBox
SparkQA commented on issue #25516: [SPARK-26895][CORE][branch-2.4] prepareSubmitEnvironment should be called within doAs for proxy users URL: https://github.com/apache/spark/pull/25516#issuecomment-523285289 **[Test build #109441 has finished](https://amplab.cs.berkeley.edu/jenkins/job/Spa

[GitHub] [spark] SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-20 Thread GitBox
SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523284745 **[Test build #109458 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109458/testReport)**

[GitHub] [spark] keypointt commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

2019-08-20 Thread GitBox
keypointt commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#issuecomment-523284861 > > I'm seeing a lot of renaming from USE_V1_SOURCE_READER_LIST to USE_V1_SOURCE_LIST in test classes > > This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523284365 Merged build finished. Test PASSed. This is a

[GitHub] [spark] AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523284371 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523284371 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkel

[GitHub] [spark] nvander1 commented on a change in pull request #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-20 Thread GitBox
nvander1 commented on a change in pull request #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#discussion_r315989115 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameFunctionsSuite.scala ###

[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523284365 Merged build finished. Test PASSed. This is an automa

[GitHub] [spark] nvander1 edited a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-20 Thread GitBox
nvander1 edited a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-520112443 I'm also adding tests for the overloads that accept Java Functional Interfaces. - ~transform~ - ~map_filte

[GitHub] [spark] ajithme commented on issue #25448: [SPARK-28697][SQL] Invalidate Database/Table names starting with underscore

2019-08-20 Thread GitBox
ajithme commented on issue #25448: [SPARK-28697][SQL] Invalidate Database/Table names starting with underscore URL: https://github.com/apache/spark/pull/25448#issuecomment-523283547 > According to the discussions in this PR, seems there are many other databases allowing the identifiers to

[GitHub] [spark] AmplabJenkins commented on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners()

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners() URL: https://github.com/apache/spark/pull/25518#issuecomment-523282738 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins removed a comment on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners()

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners() URL: https://github.com/apache/spark/pull/25518#issuecomment-523282738 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins commented on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners()

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners() URL: https://github.com/apache/spark/pull/25518#issuecomment-523282734 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] AmplabJenkins removed a comment on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners()

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners() URL: https://github.com/apache/spark/pull/25518#issuecomment-523282734 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA removed a comment on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners()

2019-08-20 Thread GitBox
SparkQA removed a comment on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners() URL: https://github.com/apache/spark/pull/25518#issuecomment-523237250 **[Test build #109447 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109447/te

[GitHub] [spark] SparkQA commented on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners()

2019-08-20 Thread GitBox
SparkQA commented on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners() URL: https://github.com/apache/spark/pull/25518#issuecomment-523282376 **[Test build #109447 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109447/testRepor

[GitHub] [spark] AmplabJenkins removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523280367 Test FAILed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] AmplabJenkins removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523280362 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523280362 Merged build finished. Test FAILed. Thi

[GitHub] [spark] SparkQA removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

2019-08-20 Thread GitBox
SparkQA removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523264562 **[Test build #109451 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] [spark] AmplabJenkins commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523280367 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] SparkQA commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

2019-08-20 Thread GitBox
SparkQA commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523280272 **[Test build #109451 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109451/

[GitHub] [spark] SparkQA commented on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage

2019-08-20 Thread GitBox
SparkQA commented on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage URL: https://github.com/apache/spark/pull/25509#issuecomment-523279293 **[Test build #109457 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109457

[GitHub] [spark] AmplabJenkins removed a comment on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-523278949 Merged build finished. Test PASSed. Th

[GitHub] [spark] AmplabJenkins removed a comment on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-523278958 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] [spark] AmplabJenkins removed a comment on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage URL: https://github.com/apache/spark/pull/25509#issuecomment-523278876 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-523278949 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage URL: https://github.com/apache/spark/pull/25509#issuecomment-523278876 Merged build finished. Test PASSed. T

[GitHub] [spark] AmplabJenkins removed a comment on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage URL: https://github.com/apache/spark/pull/25509#issuecomment-523278881 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-523278958 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] [spark] AmplabJenkins commented on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage URL: https://github.com/apache/spark/pull/25509#issuecomment-523278881 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] ueshin commented on a change in pull request #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-20 Thread GitBox
ueshin commented on a change in pull request #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#discussion_r315983284 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameFunctionsSuite.scala #

[GitHub] [spark] imback82 commented on a change in pull request #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-20 Thread GitBox
imback82 commented on a change in pull request #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#discussion_r315983843 ## File path: sql/core/src/test/scala/org/apache/spark/sql/sources/v2/DataSourceV2SQLSuite

[GitHub] [spark] xuanyuanking commented on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage

2019-08-20 Thread GitBox
xuanyuanking commented on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage URL: https://github.com/apache/spark/pull/25509#issuecomment-523278015 retest this please. This is an automat

[GitHub] [spark] AmplabJenkins commented on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#issuecomment-523277818 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//

[GitHub] [spark] AmplabJenkins removed a comment on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#issuecomment-523277811 Merged build finished. Test PASSed. This is an automated mes

[GitHub] [spark] imback82 commented on a change in pull request #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-20 Thread GitBox
imback82 commented on a change in pull request #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#discussion_r315983615 ## File path: sql/core/src/test/scala/org/apache/spark/sql/sources/v2/TestInMemoryTableCat

[GitHub] [spark] SparkQA commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-20 Thread GitBox
SparkQA commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-523277836 **[Test build #109456 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109456/testRepo

[GitHub] [spark] AmplabJenkins removed a comment on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#issuecomment-523277818 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/j

[GitHub] [spark] AmplabJenkins commented on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#issuecomment-523277811 Merged build finished. Test PASSed. This is an automated message fro

[GitHub] [spark] SparkQA commented on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-20 Thread GitBox
SparkQA commented on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#issuecomment-523277511 **[Test build #109446 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109446/testReport)** for PR 25354 at

[GitHub] [spark] SparkQA removed a comment on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-20 Thread GitBox
SparkQA removed a comment on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#issuecomment-523234016 **[Test build #109446 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109446/testReport)** for PR

[GitHub] [spark] ueshin commented on a change in pull request #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-20 Thread GitBox
ueshin commented on a change in pull request #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#discussion_r315983284 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameFunctionsSuite.scala #

[GitHub] [spark] xuanyuanking commented on issue #25508: [SPARK-28699][CORE][2.3] Fix a corner case for aborting indeterminate stage

2019-08-20 Thread GitBox
xuanyuanking commented on issue #25508: [SPARK-28699][CORE][2.3] Fix a corner case for aborting indeterminate stage URL: https://github.com/apache/spark/pull/25508#issuecomment-523276850 Yeah, I'm looking into this, seems the behavior is not the same between 2.3 and 2.4. -

[GitHub] [spark] ueshin commented on a change in pull request #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-20 Thread GitBox
ueshin commented on a change in pull request #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#discussion_r315982743 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameFunctionsSuite.scala #

[GitHub] [spark] SparkQA commented on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
SparkQA commented on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#issuecomment-523276463 **[Test build #109455 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBu

[GitHub] [spark] AmplabJenkins removed a comment on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#issuecomment-523276026 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#issuecomment-523276028 Test PASSed. Refer to this link for build results (access rights to CI server ne

[GitHub] [spark] AmplabJenkins commented on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#issuecomment-523276026 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#issuecomment-523276028 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] imback82 commented on a change in pull request #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-20 Thread GitBox
imback82 commented on a change in pull request #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#discussion_r315982094 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourc

[GitHub] [spark] akirillov commented on a change in pull request #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
akirillov commented on a change in pull request #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#discussion_r315981567 ## File path: resource-managers/mesos/src/main/scala/org/apache/spar

[GitHub] [spark] nvander1 commented on a change in pull request #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-20 Thread GitBox
nvander1 commented on a change in pull request #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#discussion_r315981432 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameFunctionsSuite.scala ###

[GitHub] [spark] SparkQA commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-20 Thread GitBox
SparkQA commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-523275035 **[Test build #109454 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109454/testRe

[GitHub] [spark] AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-523274704 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-523274698 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-523274704 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-523274698 Merged build finished. Test PASSed. This is

[GitHub] [spark] gengliangwang commented on issue #25239: [WIP][SPARK-28495][SQL] Table insertion: follow store assignment rules of ANSI SQL

2019-08-20 Thread GitBox
gengliangwang commented on issue #25239: [WIP][SPARK-28495][SQL] Table insertion: follow store assignment rules of ANSI SQL URL: https://github.com/apache/spark/pull/25239#issuecomment-523274718 Yes, this will be added after #25453 is merged. ---

[GitHub] [spark] imback82 commented on a change in pull request #25368: [SPARK-28635][SQL] create CatalogManager to track registered v2 catalogs

2019-08-20 Thread GitBox
imback82 commented on a change in pull request #25368: [SPARK-28635][SQL] create CatalogManager to track registered v2 catalogs URL: https://github.com/apache/spark/pull/25368#discussion_r315980456 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalog/v2/CatalogMan

[GitHub] [spark] ueshin commented on a change in pull request #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-20 Thread GitBox
ueshin commented on a change in pull request #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#discussion_r315980998 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameFunctionsSuite.scala #

[GitHub] [spark] AmplabJenkins removed a comment on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users URL: https://github.com/apache/spark/pull/25517#issuecomment-523274127 Test FAILed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins removed a comment on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users URL: https://github.com/apache/spark/pull/25517#issuecomment-523274124 Merged build finished. Test FAILed. ---

[GitHub] [spark] imback82 commented on a change in pull request #25368: [SPARK-28635][SQL] create CatalogManager to track registered v2 catalogs

2019-08-20 Thread GitBox
imback82 commented on a change in pull request #25368: [SPARK-28635][SQL] create CatalogManager to track registered v2 catalogs URL: https://github.com/apache/spark/pull/25368#discussion_r315980456 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalog/v2/CatalogMan

[GitHub] [spark] AmplabJenkins commented on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users URL: https://github.com/apache/spark/pull/25517#issuecomment-523274124 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users URL: https://github.com/apache/spark/pull/25517#issuecomment-523274127 Test FAILed. Refer to this link for build results (access rights to CI ser

[GitHub] [spark] imback82 commented on a change in pull request #25368: [SPARK-28635][SQL] create CatalogManager to track registered v2 catalogs

2019-08-20 Thread GitBox
imback82 commented on a change in pull request #25368: [SPARK-28635][SQL] create CatalogManager to track registered v2 catalogs URL: https://github.com/apache/spark/pull/25368#discussion_r315980292 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalog/v2/CatalogMan

[GitHub] [spark] SparkQA removed a comment on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users

2019-08-20 Thread GitBox
SparkQA removed a comment on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users URL: https://github.com/apache/spark/pull/25517#issuecomment-523228587 **[Test build #109442 has started](https://amplab.cs.berkeley.edu/jenkins/

[GitHub] [spark] SparkQA commented on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users

2019-08-20 Thread GitBox
SparkQA commented on issue #25517: [SPARK-26895][CORE][branch-2.3] prepareSubmitEnvironment should be called within doAs for proxy users URL: https://github.com/apache/spark/pull/25517#issuecomment-523273705 **[Test build #109442 has finished](https://amplab.cs.berkeley.edu/jenkins/job/Spa

[GitHub] [spark] SparkQA commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

2019-08-20 Thread GitBox
SparkQA commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523273497 **[Test build #109453 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109453/t

[GitHub] [spark] AmplabJenkins removed a comment on issue #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command URL: https://github.com/apache/spark/pull/24759#issuecomment-523272890 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-523272799 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523273104 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] AmplabJenkins removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523273102 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command URL: https://github.com/apache/spark/pull/24759#issuecomment-523272892 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.ed

[GitHub] [spark] AmplabJenkins commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523273102 Merged build finished. Test PASSed. Thi

[GitHub] [spark] AmplabJenkins commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523273104 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://am

[GitHub] [spark] zhengruifeng edited a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-20 Thread GitBox
zhengruifeng edited a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-523272292 @srowen I make extra modifications, which move `setLeafCol` into a superclass. I am looking into the

[GitHub] [spark] AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-523272795 Merged build finished. Test FAILed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-523272795 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command URL: https://github.com/apache/spark/pull/24759#issuecomment-523272892 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkin

[GitHub] [spark] SparkQA removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-20 Thread GitBox
SparkQA removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-523270620 **[Test build #109452 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10945

[GitHub] [spark] AmplabJenkins commented on issue #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command URL: https://github.com/apache/spark/pull/24759#issuecomment-523272890 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-523272799 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

<    1   2   3   4   5   6   7   8   9   10   >