[GitHub] [spark] rednaxelafx commented on a change in pull request #20965: [SPARK-21870][SQL] Split aggregation code into small functions

2019-08-21 Thread GitBox
rednaxelafx commented on a change in pull request #20965: [SPARK-21870][SQL] Split aggregation code into small functions URL: https://github.com/apache/spark/pull/20965#discussion_r316429335 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/HashAggregat

[GitHub] [spark] rednaxelafx commented on a change in pull request #20965: [SPARK-21870][SQL] Split aggregation code into small functions

2019-08-21 Thread GitBox
rednaxelafx commented on a change in pull request #20965: [SPARK-21870][SQL] Split aggregation code into small functions URL: https://github.com/apache/spark/pull/20965#discussion_r316428178 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/HashAggregat

[GitHub] [spark] rednaxelafx commented on a change in pull request #20965: [SPARK-21870][SQL] Split aggregation code into small functions

2019-08-21 Thread GitBox
rednaxelafx commented on a change in pull request #20965: [SPARK-21870][SQL] Split aggregation code into small functions URL: https://github.com/apache/spark/pull/20965#discussion_r316428843 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/HashAggregat

[GitHub] [spark] huaxingao edited a comment on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
huaxingao edited a comment on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25524#issuecomment-523617420 ![image](https://user-images.githubusercontent.com/13592258/63473791-9a20f600-c42b-11e9-97a7-16f01

[GitHub] [spark] AmplabJenkins commented on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25524#issuecomment-523679800 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] AmplabJenkins removed a comment on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25524#issuecomment-523679800 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] AmplabJenkins removed a comment on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25524#issuecomment-523679797 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25524#issuecomment-523679797 Merged build finished. Test PASSed. This

[GitHub] [spark] huaxingao commented on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
huaxingao commented on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25524#issuecomment-523680193 I rewrote some of the sentences to make sure no sentence is the same as in databrick's docs. --

[GitHub] [spark] SparkQA commented on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
SparkQA commented on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25524#issuecomment-523680206 **[Test build #109530 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109530/te

[GitHub] [spark] srowen opened a new pull request #25544: [SPARK-17875][CORE][BUILD] Remove dependency on Netty 3

2019-08-21 Thread GitBox
srowen opened a new pull request #25544: [SPARK-17875][CORE][BUILD] Remove dependency on Netty 3 URL: https://github.com/apache/spark/pull/25544 ### What changes were proposed in this pull request? Spark uses Netty 4 directly, but also includes Netty 3 only because transitive depend

[GitHub] [spark] brkyvz commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-21 Thread GitBox
brkyvz commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#discussion_r316432364 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriterV2.scala ## @@ -0,0 +1,415 @@ +

[GitHub] [spark] brkyvz commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-21 Thread GitBox
brkyvz commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#discussion_r316428510 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ## @@ -3178,6 +3178,34 @@ class

[GitHub] [spark] brkyvz commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-21 Thread GitBox
brkyvz commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#discussion_r316429077 ## File path: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ## @@ -3900,6 +3900,61 @@ obje

[GitHub] [spark] brkyvz commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-21 Thread GitBox
brkyvz commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#discussion_r316430062 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriterV2.scala ## @@ -0,0 +1,415 @@ +

[GitHub] [spark] brkyvz commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-21 Thread GitBox
brkyvz commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#discussion_r316428240 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ## @@ -3178,6 +3178,34 @@ class

[GitHub] [spark] brkyvz commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-21 Thread GitBox
brkyvz commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#discussion_r316431604 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriterV2.scala ## @@ -0,0 +1,415 @@ +

[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523681443 Merged build finished. Test PASSed. This is an automa

[GitHub] [spark] AmplabJenkins commented on issue #25544: [SPARK-17875][CORE][BUILD] Remove dependency on Netty 3

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25544: [SPARK-17875][CORE][BUILD] Remove dependency on Netty 3 URL: https://github.com/apache/spark/pull/25544#issuecomment-523681463 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.e

[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523681448 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkel

[GitHub] [spark] rdblue opened a new pull request #25545: NETFLIX-BUILD: Set OMP_NUM_THREADS to executor cores for python.

2019-08-21 Thread GitBox
rdblue opened a new pull request #25545: NETFLIX-BUILD: Set OMP_NUM_THREADS to executor cores for python. URL: https://github.com/apache/spark/pull/25545 ### What changes were proposed in this pull request? When starting python processes, set `OMP_NUM_THREADS` to `spark.executor.cor

[GitHub] [spark] AmplabJenkins commented on issue #25544: [SPARK-17875][CORE][BUILD] Remove dependency on Netty 3

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25544: [SPARK-17875][CORE][BUILD] Remove dependency on Netty 3 URL: https://github.com/apache/spark/pull/25544#issuecomment-523681457 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] nvander1 commented on a change in pull request #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
nvander1 commented on a change in pull request #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#discussion_r316436841 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameFunctionsSuite.scala ###

[GitHub] [spark] AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523681443 Merged build finished. Test PASSed. This is a

[GitHub] [spark] AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523681448 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] nvander1 commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
nvander1 commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523681767 @ueshin I've removed the java overloads and made tests for `transform` in java. I'll be working on porting the remaining te

[GitHub] [spark] SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523681986 **[Test build #109533 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109533/testReport)**

[GitHub] [spark] SparkQA commented on issue #25544: [SPARK-17875][CORE][BUILD] Remove dependency on Netty 3

2019-08-21 Thread GitBox
SparkQA commented on issue #25544: [SPARK-17875][CORE][BUILD] Remove dependency on Netty 3 URL: https://github.com/apache/spark/pull/25544#issuecomment-523681967 **[Test build #109532 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109532/testReport)** for

[GitHub] [spark] SparkQA commented on issue #25545: NETFLIX-BUILD: Set OMP_NUM_THREADS to executor cores for python.

2019-08-21 Thread GitBox
SparkQA commented on issue #25545: NETFLIX-BUILD: Set OMP_NUM_THREADS to executor cores for python. URL: https://github.com/apache/spark/pull/25545#issuecomment-523681992 **[Test build #109531 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109531/testReport

[GitHub] [spark] AmplabJenkins removed a comment on issue #25544: [SPARK-17875][CORE][BUILD] Remove dependency on Netty 3

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25544: [SPARK-17875][CORE][BUILD] Remove dependency on Netty 3 URL: https://github.com/apache/spark/pull/25544#issuecomment-523681463 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins removed a comment on issue #25544: [SPARK-17875][CORE][BUILD] Remove dependency on Netty 3

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25544: [SPARK-17875][CORE][BUILD] Remove dependency on Netty 3 URL: https://github.com/apache/spark/pull/25544#issuecomment-523681457 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] SparkQA commented on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
SparkQA commented on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25524#issuecomment-523682862 **[Test build #109530 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109530/t

[GitHub] [spark] AmplabJenkins commented on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25524#issuecomment-523682956 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins removed a comment on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25524#issuecomment-523682950 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25524#issuecomment-523682950 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25524#issuecomment-523682956 Test PASSed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] [spark] rdblue commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-21 Thread GitBox
rdblue commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#discussion_r316438488 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ## @@ -3178,6 +3178,34 @@ class

[GitHub] [spark] SparkQA removed a comment on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
SparkQA removed a comment on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25524#issuecomment-523680206 **[Test build #109530 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1

[GitHub] [spark] AmplabJenkins commented on issue #25545: NETFLIX-BUILD: Set OMP_NUM_THREADS to executor cores for python.

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25545: NETFLIX-BUILD: Set OMP_NUM_THREADS to executor cores for python. URL: https://github.com/apache/spark/pull/25545#issuecomment-523683316 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] AmplabJenkins commented on issue #25545: NETFLIX-BUILD: Set OMP_NUM_THREADS to executor cores for python.

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25545: NETFLIX-BUILD: Set OMP_NUM_THREADS to executor cores for python. URL: https://github.com/apache/spark/pull/25545#issuecomment-523683309 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] AmplabJenkins removed a comment on issue #25545: NETFLIX-BUILD: Set OMP_NUM_THREADS to executor cores for python.

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25545: NETFLIX-BUILD: Set OMP_NUM_THREADS to executor cores for python. URL: https://github.com/apache/spark/pull/25545#issuecomment-523683316 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] AmplabJenkins removed a comment on issue #25545: NETFLIX-BUILD: Set OMP_NUM_THREADS to executor cores for python.

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25545: NETFLIX-BUILD: Set OMP_NUM_THREADS to executor cores for python. URL: https://github.com/apache/spark/pull/25545#issuecomment-523683309 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523683377 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkel

[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523683543 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkele

[GitHub] [spark] SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523683529 **[Test build #109533 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109533/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523683377 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523683370 Merged build finished. Test PASSed. This is a

[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523683538 Merged build finished. Test FAILed. This is an automa

[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523683370 Merged build finished. Test PASSed. This is an automa

[GitHub] [spark] AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523683538 Merged build finished. Test FAILed. This is a

[GitHub] [spark] SparkQA removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
SparkQA removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523681986 **[Test build #109533 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109533/testRep

[GitHub] [spark] huaxingao removed a comment on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
huaxingao removed a comment on issue #25524: [SPARK-28788][DOC][SQL]Document ANALYZE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25524#issuecomment-523680193 I rewrote some of the sentences to make sure no sentence is the same as in databrick's docs. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523683543 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] [spark] SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523683802 **[Test build #109534 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109534/testReport)**

[GitHub] [spark] rdblue commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-21 Thread GitBox
rdblue commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#discussion_r316439432 ## File path: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ## @@ -3900,6 +3900,61 @@ obje

[GitHub] [spark] maropu commented on issue #25464: [SPARK-28746][SQL] Add partitionby hint for sql queries

2019-08-21 Thread GitBox
maropu commented on issue #25464: [SPARK-28746][SQL] Add partitionby hint for sql queries URL: https://github.com/apache/spark/pull/25464#issuecomment-523684735 Yea, that approach looks more reasonable to me. Could you brush up the code based on the suggestion? @ulysses-you

[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523684970 Merged build finished. Test FAILed. This is an automa

[GitHub] [spark] SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523684958 **[Test build #109534 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109534/testReport)**

[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523684977 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkele

[GitHub] [spark] AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523684970 Merged build finished. Test FAILed. This is a

[GitHub] [spark] SparkQA removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
SparkQA removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523683802 **[Test build #109534 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109534/testRep

[GitHub] [spark] AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-523684977 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] [spark] brkyvz commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-21 Thread GitBox
brkyvz commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#discussion_r316441986 ## File path: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ## @@ -3900,6 +3900,61 @@ obje

[GitHub] [spark] rdblue commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-21 Thread GitBox
rdblue commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#discussion_r316443121 ## File path: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ## @@ -3900,6 +3900,61 @@ obje

[GitHub] [spark] rdblue commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-21 Thread GitBox
rdblue commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#discussion_r316443335 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriterV2.scala ## @@ -0,0 +1,415 @@ +

[GitHub] [spark] huaxingao commented on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference

2019-08-21 Thread GitBox
huaxingao commented on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference URL: https://github.com/apache/spark/pull/25522#issuecomment-523687767 updated This is an automated message from th

[GitHub] [spark] AmplabJenkins commented on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference URL: https://github.com/apache/spark/pull/25522#issuecomment-523688210 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] AmplabJenkins commented on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference URL: https://github.com/apache/spark/pull/25522#issuecomment-523688204 Merged build finished. Test PASSed. This is

[GitHub] [spark] huaxingao edited a comment on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference

2019-08-21 Thread GitBox
huaxingao edited a comment on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference URL: https://github.com/apache/spark/pull/25522#issuecomment-523607371 Here is the screen shot ![image](https://user-images.githubusercontent.com/13592258/63475316-34376d00-c

[GitHub] [spark] AmplabJenkins removed a comment on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference URL: https://github.com/apache/spark/pull/25522#issuecomment-523688210 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] AmplabJenkins removed a comment on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference URL: https://github.com/apache/spark/pull/25522#issuecomment-523688204 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference

2019-08-21 Thread GitBox
SparkQA commented on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference URL: https://github.com/apache/spark/pull/25522#issuecomment-523688729 **[Test build #109535 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109535/testRe

[GitHub] [spark] brkyvz commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-21 Thread GitBox
brkyvz commented on a change in pull request #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#discussion_r316445417 ## File path: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ## @@ -3900,6 +3900,61 @@ obje

[GitHub] [spark] SparkQA removed a comment on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-21 Thread GitBox
SparkQA removed a comment on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-523625017 **[Test build #109523 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109523/

[GitHub] [spark] SparkQA commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-21 Thread GitBox
SparkQA commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-523690647 **[Test build #109523 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109523/testRep

[GitHub] [spark] AmplabJenkins removed a comment on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference URL: https://github.com/apache/spark/pull/25522#issuecomment-523690851 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins removed a comment on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference URL: https://github.com/apache/spark/pull/25522#issuecomment-523690848 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference URL: https://github.com/apache/spark/pull/25522#issuecomment-523690851 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] SparkQA removed a comment on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference

2019-08-21 Thread GitBox
SparkQA removed a comment on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference URL: https://github.com/apache/spark/pull/25522#issuecomment-523688729 **[Test build #109535 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10953

[GitHub] [spark] huaxingao commented on issue #25532: [SPARK-28790][DOC][SQL]Document CACHE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
huaxingao commented on issue #25532: [SPARK-28790][DOC][SQL]Document CACHE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25532#issuecomment-523690824 ![image](https://user-images.githubusercontent.com/13592258/63475754-13701700-c433-11e9-863d-3c6a311897ef.png)

[GitHub] [spark] SparkQA commented on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference

2019-08-21 Thread GitBox
SparkQA commented on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference URL: https://github.com/apache/spark/pull/25522#issuecomment-523690784 **[Test build #109535 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109535/testR

[GitHub] [spark] AmplabJenkins commented on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25522: [SPARK-28787][DOC][SQL]Document LOAD DATA statement in SQL Reference URL: https://github.com/apache/spark/pull/25522#issuecomment-523690848 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-523690998 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] [spark] AmplabJenkins commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-523690994 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-523690998 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://am

[GitHub] [spark] AmplabJenkins removed a comment on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-523690994 Merged build finished. Test PASSed. Th

[GitHub] [spark] AmplabJenkins commented on issue #25532: [SPARK-28790][DOC][SQL]Document CACHE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25532: [SPARK-28790][DOC][SQL]Document CACHE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25532#issuecomment-523691234 Merged build finished. Test PASSed. This i

[GitHub] [spark] AmplabJenkins removed a comment on issue #25532: [SPARK-28790][DOC][SQL]Document CACHE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25532: [SPARK-28790][DOC][SQL]Document CACHE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25532#issuecomment-523691234 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25532: [SPARK-28790][DOC][SQL]Document CACHE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins removed a comment on issue #25532: [SPARK-28790][DOC][SQL]Document CACHE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25532#issuecomment-523691240 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] AmplabJenkins commented on issue #25532: [SPARK-28790][DOC][SQL]Document CACHE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
AmplabJenkins commented on issue #25532: [SPARK-28790][DOC][SQL]Document CACHE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25532#issuecomment-523691240 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] dilipbiswal commented on a change in pull request #24759: [SPARK-27395][SQL] Improve EXPLAIN command

2019-08-21 Thread GitBox
dilipbiswal commented on a change in pull request #24759: [SPARK-27395][SQL] Improve EXPLAIN command URL: https://github.com/apache/spark/pull/24759#discussion_r316447614 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/ExplainUtils.scala ## @@ -0,0 +1

[GitHub] [spark] SparkQA commented on issue #25532: [SPARK-28790][DOC][SQL]Document CACHE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
SparkQA commented on issue #25532: [SPARK-28790][DOC][SQL]Document CACHE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25532#issuecomment-523691720 **[Test build #109536 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109536/test

[GitHub] [spark] dilipbiswal commented on a change in pull request #24759: [SPARK-27395][SQL] Improve EXPLAIN command

2019-08-21 Thread GitBox
dilipbiswal commented on a change in pull request #24759: [SPARK-27395][SQL] Improve EXPLAIN command URL: https://github.com/apache/spark/pull/24759#discussion_r316447655 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/ExplainUtils.scala ## @@ -0,0 +1

[GitHub] [spark] dilipbiswal commented on a change in pull request #24759: [SPARK-27395][SQL] Improve EXPLAIN command

2019-08-21 Thread GitBox
dilipbiswal commented on a change in pull request #24759: [SPARK-27395][SQL] Improve EXPLAIN command URL: https://github.com/apache/spark/pull/24759#discussion_r316448199 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/ExplainUtils.scala ## @@ -0,0 +1

[GitHub] [spark] dilipbiswal commented on a change in pull request #24759: [SPARK-27395][SQL] Improve EXPLAIN command

2019-08-21 Thread GitBox
dilipbiswal commented on a change in pull request #24759: [SPARK-27395][SQL] Improve EXPLAIN command URL: https://github.com/apache/spark/pull/24759#discussion_r316448584 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/QueryPlan.scala ## @@ -

[GitHub] [spark] maropu commented on a change in pull request #25536: [SPARK-28837][SQL] CTAS/RTAS should use nullable schema

2019-08-21 Thread GitBox
maropu commented on a change in pull request #25536: [SPARK-28837][SQL] CTAS/RTAS should use nullable schema URL: https://github.com/apache/spark/pull/25536#discussion_r316448667 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/WriteToDataSourceV2

[GitHub] [spark] maropu commented on issue #25536: [SPARK-28837][SQL] CTAS/RTAS should use nullable schema

2019-08-21 Thread GitBox
maropu commented on issue #25536: [SPARK-28837][SQL] CTAS/RTAS should use nullable schema URL: https://github.com/apache/spark/pull/25536#issuecomment-523692881 +1; the change looks reasonable to me. This is an automated mess

[GitHub] [spark] huaxingao commented on issue #25540: [SPARK-28830][DOC][SQL]Document UNCACHE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
huaxingao commented on issue #25540: [SPARK-28830][DOC][SQL]Document UNCACHE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25540#issuecomment-523693037 ![image](https://user-images.githubusercontent.com/13592258/63476136-a52c5400-c434-11e9-8c61-cc5fc29af086.png

[GitHub] [spark] SparkQA commented on issue #25540: [SPARK-28830][DOC][SQL]Document UNCACHE TABLE statement in SQL Reference

2019-08-21 Thread GitBox
SparkQA commented on issue #25540: [SPARK-28830][DOC][SQL]Document UNCACHE TABLE statement in SQL Reference URL: https://github.com/apache/spark/pull/25540#issuecomment-523693196 **[Test build #109537 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109537/te

[GitHub] [spark] shrutig commented on issue #25514: [SPARK-28784][SS]StreamExecution and StreamingQueryManager should utilize CheckpointFileManager to interact with checkpoint directories

2019-08-21 Thread GitBox
shrutig commented on issue #25514: [SPARK-28784][SS]StreamExecution and StreamingQueryManager should utilize CheckpointFileManager to interact with checkpoint directories URL: https://github.com/apache/spark/pull/25514#issuecomment-523693327 Checking the tests. The tests seemed to have pas

<    5   6   7   8   9   10   11   >